-- Logs begin at Thu 2022-06-02 12:55:31 UTC, end at Thu 2022-06-02 13:54:22 UTC. -- Jun 02 13:24:59.299969 dv-cinder-836083-8-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 02 13:24:59.313388 dv-cinder-836083-8-smb devstack@keystone.service[80225]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 02 13:24:59.313892 dv-cinder-836083-8-smb devstack@keystone.service[80225]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 13:24:59 2022] *** Jun 02 13:24:59.313892 dv-cinder-836083-8-smb devstack@keystone.service[80225]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 13:24:59.313892 dv-cinder-836083-8-smb devstack@keystone.service[80225]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 13:24:59.313892 dv-cinder-836083-8-smb devstack@keystone.service[80225]: nodename: dv-cinder-836083-8-smb Jun 02 13:24:59.313892 dv-cinder-836083-8-smb devstack@keystone.service[80225]: machine: x86_64 Jun 02 13:24:59.313892 dv-cinder-836083-8-smb devstack@keystone.service[80225]: clock source: unix Jun 02 13:24:59.313892 dv-cinder-836083-8-smb devstack@keystone.service[80225]: pcre jit disabled Jun 02 13:24:59.313892 dv-cinder-836083-8-smb devstack@keystone.service[80225]: detected number of CPU cores: 4 Jun 02 13:24:59.314294 dv-cinder-836083-8-smb devstack@keystone.service[80225]: current working directory: / Jun 02 13:24:59.314294 dv-cinder-836083-8-smb devstack@keystone.service[80225]: detected binary path: /usr/bin/uwsgi-core Jun 02 13:24:59.314294 dv-cinder-836083-8-smb devstack@keystone.service[80225]: your processes number limit is 47680 Jun 02 13:24:59.314294 dv-cinder-836083-8-smb devstack@keystone.service[80225]: your memory page size is 4096 bytes Jun 02 13:24:59.314294 dv-cinder-836083-8-smb devstack@keystone.service[80225]: detected max file descriptor number: 2048 Jun 02 13:24:59.314294 dv-cinder-836083-8-smb devstack@keystone.service[80225]: lock engine: pthread robust mutexes Jun 02 13:24:59.314294 dv-cinder-836083-8-smb devstack@keystone.service[80225]: thunder lock: enabled Jun 02 13:24:59.314294 dv-cinder-836083-8-smb devstack@keystone.service[80225]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 02 13:24:59.314294 dv-cinder-836083-8-smb devstack@keystone.service[80225]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 13:24:59.358793 dv-cinder-836083-8-smb devstack@keystone.service[80225]: Python main interpreter initialized at 0x562c0e25c9c0 Jun 02 13:24:59.358793 dv-cinder-836083-8-smb devstack@keystone.service[80225]: python threads support enabled Jun 02 13:24:59.358793 dv-cinder-836083-8-smb devstack@keystone.service[80225]: your server socket listen backlog is limited to 100 connections Jun 02 13:24:59.358793 dv-cinder-836083-8-smb devstack@keystone.service[80225]: your mercy for graceful operations on workers is 90 seconds Jun 02 13:24:59.359308 dv-cinder-836083-8-smb devstack@keystone.service[80225]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 13:24:59.359435 dv-cinder-836083-8-smb devstack@keystone.service[80225]: *** Operational MODE: preforking *** Jun 02 13:24:59.359693 dv-cinder-836083-8-smb devstack@keystone.service[80225]: *** uWSGI is running in multiple interpreter mode *** Jun 02 13:24:59.359693 dv-cinder-836083-8-smb devstack@keystone.service[80225]: spawned uWSGI master process (pid: 80225) Jun 02 13:24:59.359868 dv-cinder-836083-8-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 02 13:24:59.360970 dv-cinder-836083-8-smb devstack@keystone.service[80225]: spawned uWSGI worker 1 (pid: 80237, cores: 1) Jun 02 13:24:59.360970 dv-cinder-836083-8-smb devstack@keystone.service[80225]: spawned uWSGI worker 2 (pid: 80238, cores: 1) Jun 02 13:24:59.360970 dv-cinder-836083-8-smb devstack@keystone.service[80225]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 13:25:05.037134 dv-cinder-836083-8-smb devstack@keystone.service[80238]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:25:05.037134 dv-cinder-836083-8-smb devstack@keystone.service[80238]: from cryptography.utils import int_from_bytes Jun 02 13:25:05.037958 dv-cinder-836083-8-smb devstack@keystone.service[80237]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:25:05.037958 dv-cinder-836083-8-smb devstack@keystone.service[80237]: from cryptography.utils import int_from_bytes Jun 02 13:25:05.037958 dv-cinder-836083-8-smb devstack@keystone.service[80237]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:25:05.037958 dv-cinder-836083-8-smb devstack@keystone.service[80237]: from cryptography.utils import int_from_bytes Jun 02 13:25:05.038468 dv-cinder-836083-8-smb devstack@keystone.service[80238]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:25:05.038468 dv-cinder-836083-8-smb devstack@keystone.service[80238]: from cryptography.utils import int_from_bytes Jun 02 13:25:05.087096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 13:25:05.087282 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 13:25:05.087360 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 13:25:05.087454 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 13:25:05.087527 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] command line args: [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 13:25:05.087592 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] command line args: [] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 13:25:05.087736 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 13:25:05.087867 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 13:25:05.087955 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ================================================================================ {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 13:25:05.088037 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ================================================================================ {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 13:25:05.088136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] admin_token = **** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.088375 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] config_dir = [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.088550 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] admin_token = **** {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.088640 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.088703 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] config_source = [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.088776 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] config_dir = [] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.088850 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] debug = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.088911 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.089047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] config_source = [] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.089133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.089342 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] debug = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.089408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.089490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.089610 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.089683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.089786 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.089858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.090069 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.090197 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.090270 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.090332 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] list_limit = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.090467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] log_config_append = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.090553 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] list_limit = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.090662 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.090731 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] log_config_append = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.090862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] log_dir = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.090939 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.091012 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] log_file = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.091072 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] log_dir = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.091195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] log_file = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.091269 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.091436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.091590 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.091691 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.091761 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.091889 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.091966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.092077 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.092173 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.092249 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.092382 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.092460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.092526 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.092649 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.092850 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.092971 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.093153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.093300 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.093476 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.093551 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.093634 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.093714 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.093792 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.093917 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.093994 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.094114 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.094202 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.094332 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.094414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.094665 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.094935 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.095073 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] publish_errors = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.095160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.095311 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] publish_errors = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.095454 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.095544 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.095628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.095701 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.095826 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.095903 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.095987 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.096186 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.096278 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.096357 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.096431 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] standard_threads = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.096593 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] standard_threads = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.096733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.096860 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.096988 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.096988 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.097232 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.097355 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] use_journal = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.097432 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.097503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] use_json = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.097573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] use_journal = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.097643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] use_stderr = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.097726 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] use_json = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.097798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] use_syslog = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.097868 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] use_stderr = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.097868 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] use_syslog = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.098001 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.098071 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:25:05.098149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.098258 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.098352 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.098514 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.098656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.098776 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.098886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.099038 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.099161 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.099241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.099313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.099513 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.099725 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.099817 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.099899 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.099972 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.100048 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.100176 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.100262 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.100425 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.100550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.100641 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.100715 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.100876 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.100969 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.101100 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.101188 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.101343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.101424 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.101582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.101673 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.101815 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.101909 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.102032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.102161 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.102284 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.102381 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.102524 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.102621 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.102784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.102881 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.103015 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.103108 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.103266 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.103349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.103524 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.103607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.103778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.103873 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.104009 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.104106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.104236 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.104313 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.104462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.104549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.104685 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.104769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.104916 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.104994 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.105152 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.105228 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.105381 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.105464 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.105603 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.105680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.105829 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.105908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.106076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.106161 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.106312 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.106395 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.106548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.106662 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.106797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.106873 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.107029 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.107115 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.107264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.107343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.107492 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.107569 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.107719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.107802 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.107947 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.108024 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.108171 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.108297 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.108431 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.108556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.108689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.108813 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.108972 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.109142 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.109278 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.109409 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.109547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.109676 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.109800 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.109923 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.110047 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.110286 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.110372 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.110435 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.110524 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.110621 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.110687 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.110745 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.110810 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.110870 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.110938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.111030 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.111099 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.111309 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.111572 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.111702 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.111818 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.111939 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.112058 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.112180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.112310 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.112439 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.112566 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.112694 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.112815 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.112943 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.113069 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.113198 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.113332 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.113462 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.113583 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.113703 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.113822 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.113954 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.114085 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.114205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.114343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.114470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.114707 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.114855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.115004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.115004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.115240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.115367 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.115489 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.115618 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.115740 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.115861 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.116003 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.116123 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.116248 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.116393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.116518 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.116643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.116767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.116908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.117032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.117228 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.117355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.117481 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.117606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.117730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.117863 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.117995 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.118124 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.118254 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.118379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.118501 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.118655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.118786 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.118912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.119042 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.119165 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.119290 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.119415 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.119548 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.119682 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.119807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.119931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.120056 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.120186 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.120319 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.120465 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.120602 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.120727 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.120852 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.120977 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.121099 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.121223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.121355 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.121480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.121611 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.121738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.121863 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.121987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.122119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.122252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.122376 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.122500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.122652 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.122785 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.122785 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.123029 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.123154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.123278 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.123402 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.123534 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.123534 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] auth.external = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.123775 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.123900 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.124219 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.124219 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] auth.external = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.124414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.124514 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.124642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.124642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] auth.password = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.124767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.124827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] auth.token = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.124886 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.124950 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.125020 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] auth.password = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.125020 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] auth.token = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.125133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.125264 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.125535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.125661 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.125795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.125922 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.126057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.126184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.126307 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.126307 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.126556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.126556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.126817 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] credential.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.126944 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.127079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.127205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] credential.caching = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.127339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.127465 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.127590 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.127715 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.127840 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.127966 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.128099 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.128225 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.128350 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.128474 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.128598 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.128723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.128936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.129064 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.129190 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.129323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.129449 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.129574 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.129708 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.129840 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.129966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.130101 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.130228 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.130355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.130491 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.130640 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.130772 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.130904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.131030 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] federation.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.131156 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.131289 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.131416 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] federation.caching = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.131542 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.131667 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.131792 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.131918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.132125 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.132254 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.132388 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.132530 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.132655 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.132781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.132915 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.133042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.133167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.133293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.133418 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.133541 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.133674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.133799 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.133924 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.134049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.134184 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.134306 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.134446 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.134629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.caching = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.134754 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.134881 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.135029 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.135162 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.135291 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.135416 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.135541 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.135667 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.135791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.135924 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.136063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.136189 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.136315 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.136441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.136565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.136700 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.136825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.136950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.137074 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.137198 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.137323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.137457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.137582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.137707 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.137841 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.137965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.138090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.138201 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.138371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.138497 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.138635 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.138758 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.138884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.139019 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.139146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.139271 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.139396 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.139532 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.139689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.139824 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.139947 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.140067 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.140192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.140316 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.140441 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.140574 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.140697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.140818 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.140941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.141070 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.141192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.141333 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.141456 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.141579 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.141700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.141822 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.141943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.142072 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.142194 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.142315 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.142436 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.142558 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.142745 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.142882 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.143019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.143144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.143269 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.143394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.143521 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.143654 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.143780 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.143910 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.144035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.144160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.144284 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.144421 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.144547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.144673 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.144808 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.144935 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.145059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.145192 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.145315 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.145440 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.145565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.145689 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.145816 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.145954 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.146074 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.146205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.146330 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.146486 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.146633 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.146722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.146786 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.146846 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.146905 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.146965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.147023 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.147090 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.147150 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.147208 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.147208 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.147311 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.147311 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.147426 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.147485 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.147544 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.147609 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.147671 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.147737 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.149046 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.149182 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.149306 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.149428 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.149549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.149679 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.149803 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.149926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.150058 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.150181 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.150303 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.150432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.150555 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.150727 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.150853 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.150853 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.151091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.151233 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.151359 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.151483 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.151483 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.151728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.151854 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.151854 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.152100 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.152225 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.152350 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.152475 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.152600 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.152733 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.152859 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.152985 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.153111 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.153236 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.153361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.153502 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.153626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.153750 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.153875 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.154000 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.154125 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.154257 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.154383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.154512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.154652 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.155140 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.155326 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.155462 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.155656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.155885 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.156011 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.156133 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.156256 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.156388 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.156511 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.156635 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.156757 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.156883 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.157004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.157199 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.157325 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.157447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] resource.caching = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.157569 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.157702 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.157824 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] resource.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.157955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.158077 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.158205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.158328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.158450 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.158616 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.158770 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.158897 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.159022 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.159146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.159271 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.159408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.159542 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.159669 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.159796 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.159921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.160048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] role.caching = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.160172 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.160306 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] role.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.160433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] role.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.160558 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.160683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] role.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.160809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.160941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.161075 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.161216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.161342 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.161467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.161594 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.161719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.161872 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.161996 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.162121 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.162246 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.162372 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.162530 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.162667 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.162790 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.162923 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.163046 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.163170 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.163306 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.163306 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.163537 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.163661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.163783 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.163905 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.164036 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.164159 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.164280 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.164402 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.164537 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.164661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.164791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.164915 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.165037 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.165158 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.165280 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.165401 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.165531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.165654 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.165776 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.165900 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.166022 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.166154 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.166284 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.166407 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.166529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.166692 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.166822 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.166943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.167077 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.167204 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.167328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.167453 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.167577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.167709 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.167843 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.167978 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.168103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.168234 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.168359 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.168492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.168617 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.168741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.168867 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.168993 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.169117 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] token.caching = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.169249 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] token.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.169374 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.169500 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.169624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.169763 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.169889 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.170022 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.170147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.170272 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.170396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.170520 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.170654 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.170813 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.170938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.171104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.171233 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.171370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.171552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.171688 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.171815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.171942 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.172068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.172194 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.172283 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.172412 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.172535 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.172656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.172777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.172897 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.173019 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.173149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.173282 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.173404 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.173526 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.173648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.173769 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] database.connection = **** {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.173903 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.connection = **** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.174043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.174174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.174305 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.174428 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.174550 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.174693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.174815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.174936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.175078 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.175206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.175329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.175450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.175576 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.175698 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.175827 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.175949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.176070 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.176193 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.176316 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.176438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.176567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.176689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.176825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.176946 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.177027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.177187 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.177383 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.177383 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.177615 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.177736 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.177858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.177985 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.178115 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.178238 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.178361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.178493 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 13:25:05.178662 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:25:05.178662 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 13:25:05.200930 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.201116 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.201248 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.201330 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.201423 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.201592 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.210042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.210256 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.238620 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.238858 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.240610 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.240840 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.293013 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.293173 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.341597 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.341803 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.341975 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.342220 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.408676 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.408861 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.409027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.409179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.409262 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.409339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.409434 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.409521 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.409679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.409804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.409883 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.410083 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.434431 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.434668 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.434894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.435109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.435323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.435536 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.435720 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.445935 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.446152 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.446396 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.446621 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.446867 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.447062 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.447284 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.447636 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.455729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.461754 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.461988 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.462162 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.462415 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.462609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.462854 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.463034 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.465997 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.466229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.466449 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.466699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.466920 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.467137 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.467347 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:25:05.480709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.480868 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 13:25:05.481236 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.481377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.481518 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 13:25:05.481601 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 13:25:05.481665 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.481905 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.482033 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.482185 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 13:25:05.482270 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.482335 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.482409 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.482591 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.482878 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.483128 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.493273 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.493540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.493802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.494057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.494203 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.494343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.494628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.494879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.502281 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.503076 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.505696 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.505965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.506236 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.506358 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.506558 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.506711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.506854 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.506982 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.507105 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.507301 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.507394 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.507519 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.507639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.507764 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.507884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.508023 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.508154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.508281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.508408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.508547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.508776 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.509040 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.535066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.535793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.536859 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.537134 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.537487 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.537762 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.542320 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.542563 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.542890 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.543124 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.543346 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.543618 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.550109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.550385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.551047 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.551333 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.554828 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.555214 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.555490 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.555767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.555888 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.556082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.556208 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.556349 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.556473 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.556609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.556738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.556864 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.556983 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.557257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.557528 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.557795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.575655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.575925 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.576114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.576387 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.580698 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.581118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.584444 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.584715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.584910 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.585004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.589624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.589891 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.593226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.593564 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.598297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.598628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.598754 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.598989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.599085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.599304 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.599388 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.599511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.599591 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.599751 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.599853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.600013 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.618752 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.618878 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.619040 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.619184 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.619314 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.619441 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.619522 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.619675 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.627451 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.627677 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.629141 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.629336 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.629506 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.629737 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.632533 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.632656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.632818 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.632934 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.633088 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.634005 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.634005 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.634238 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.634343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.634458 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.647684 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.647967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.648091 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.648232 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.648329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.648476 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.648570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.648774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.648902 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.649054 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.649141 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.649296 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.649420 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.649557 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.667481 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.668137 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.670795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.671489 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.674104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.674769 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.675735 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.676344 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.677363 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.677639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.677916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.678110 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.678345 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.678600 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.685266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.685910 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.686994 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.687556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.690078 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.690358 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.690642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.690761 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.690979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.691107 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.691338 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.691621 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.699961 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.700238 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.700616 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.700738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.700959 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.701328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.708489 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.708767 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.709043 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.709276 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:25:05.709401 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.709593 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.709788 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.709885 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.710013 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.710138 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.710264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.710395 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.710556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.710706 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.710845 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.711031 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.711173 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.711303 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.711430 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.711557 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.711683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.711818 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.711947 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.712075 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.712204 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.712331 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.712331 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.712610 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:25:05.749638 dv-cinder-836083-8-smb devstack@keystone.service[80237]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562c0e25c9c0 pid: 80237 (default app) Jun 02 13:25:05.750806 dv-cinder-836083-8-smb devstack@keystone.service[80238]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562c0e25c9c0 pid: 80238 (default app) Jun 02 13:25:05.753079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d2e6d-816c-4aa0-bcce-dc09d3dab285 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:05.753369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d2e6d-816c-4aa0-bcce-dc09d3dab285 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:05.753645 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d2e6d-816c-4aa0-bcce-dc09d3dab285 None None] PATH_INFO: `/v3` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:05.758006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Thu Jun 2 13:25:05 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:13.813098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc6f74-3841-4193-aea1-15407a7ce1c6 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:13.814000 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc6f74-3841-4193-aea1-15407a7ce1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:13.814625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc6f74-3841-4193-aea1-15407a7ce1c6 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:13.824465 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:13 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:13.833095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7700ebc-f375-43ad-9b11-85795779942b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:13.833523 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7700ebc-f375-43ad-9b11-85795779942b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:13.833698 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7700ebc-f375-43ad-9b11-85795779942b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:13.910494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: INFO dbcounter [None req-a7700ebc-f375-43ad-9b11-85795779942b None None] Registered counter for database keystone Jun 02 13:25:13.935165 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG oslo_db.sqlalchemy.engines [None req-a7700ebc-f375-43ad-9b11-85795779942b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80237) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:25:13.947226 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writer thread running {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:25:14.239399 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG passlib.handlers.bcrypt [None req-a7700ebc-f375-43ad-9b11-85795779942b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80237) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 02 13:25:14.239805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG passlib.handlers.bcrypt [None req-a7700ebc-f375-43ad-9b11-85795779942b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80237) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 02 13:25:14.296360 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a7700ebc-f375-43ad-9b11-85795779942b None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:14.297960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a7700ebc-f375-43ad-9b11-85795779942b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:14.432643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 601 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 02 13:25:14.643000 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc6f74-3841-4193-aea1-15407a7ce1c6 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:14.712585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: INFO dbcounter [None req-78cc6f74-3841-4193-aea1-15407a7ce1c6 None None] Registered counter for database keystone Jun 02 13:25:14.733888 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG oslo_db.sqlalchemy.engines [None req-78cc6f74-3841-4193-aea1-15407a7ce1c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80238) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:25:14.742453 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writer thread running {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:25:14.969855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc6f74-3841-4193-aea1-15407a7ce1c6 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:14.975303 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fffedf-b4c4-4a80-b9ef-675999659b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:14.975985 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fffedf-b4c4-4a80-b9ef-675999659b22 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:14.976265 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fffedf-b4c4-4a80-b9ef-675999659b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:14.976542 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fffedf-b4c4-4a80-b9ef-675999659b22 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:14.985801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fffedf-b4c4-4a80-b9ef-675999659b22 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:15.037550 dv-cinder-836083-8-smb devstack@keystone.service[80238]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f3fffedf-b4c4-4a80-b9ef-675999659b22 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 02 13:25:15.037875 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fffedf-b4c4-4a80-b9ef-675999659b22 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:15.048142 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Thu Jun 2 13:25:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:25:15.055187 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7700ebc-f375-43ad-9b11-85795779942b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:15.072639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7700ebc-f375-43ad-9b11-85795779942b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:15.078986 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23bb30-07d8-4623-8f93-dca973286c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:15.080127 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23bb30-07d8-4623-8f93-dca973286c87 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:15.080405 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23bb30-07d8-4623-8f93-dca973286c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:15.080706 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23bb30-07d8-4623-8f93-dca973286c87 admin admin] PATH_INFO: `/v3/projects/119d80c3d10b4ce0978a2de4f94e5475` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:15.082437 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23bb30-07d8-4623-8f93-dca973286c87 admin admin] RBAC: Authorizing `identity:get_project(project_id=119d80c3d10b4ce0978a2de4f94e5475)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:15.133138 dv-cinder-836083-8-smb devstack@keystone.service[80237]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9d23bb30-07d8-4623-8f93-dca973286c87 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 02 13:25:15.133474 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23bb30-07d8-4623-8f93-dca973286c87 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:15.138130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Thu Jun 2 13:25:15 2022] GET /identity/v3/projects/119d80c3d10b4ce0978a2de4f94e5475 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:17.366833 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80fe04-86dc-43cd-a444-34c88f0bcac4 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:17.367387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80fe04-86dc-43cd-a444-34c88f0bcac4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:17.367387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80fe04-86dc-43cd-a444-34c88f0bcac4 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:17.371623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:25:17.377816 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899185b-e019-4e29-9047-4b2f8ea9ce5f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:17.378227 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899185b-e019-4e29-9047-4b2f8ea9ce5f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:17.378321 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899185b-e019-4e29-9047-4b2f8ea9ce5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:17.399611 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a899185b-e019-4e29-9047-4b2f8ea9ce5f None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:17.401118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a899185b-e019-4e29-9047-4b2f8ea9ce5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:17.410468 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 02 13:25:17.433640 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80fe04-86dc-43cd-a444-34c88f0bcac4 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:17.449554 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80fe04-86dc-43cd-a444-34c88f0bcac4 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:17.454562 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ee295-c3a2-444e-9575-3eb101d3c42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:17.455224 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ee295-c3a2-444e-9575-3eb101d3c42d admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:17.455504 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ee295-c3a2-444e-9575-3eb101d3c42d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:17.455778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ee295-c3a2-444e-9575-3eb101d3c42d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:17.463706 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ee295-c3a2-444e-9575-3eb101d3c42d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:17.465474 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ee295-c3a2-444e-9575-3eb101d3c42d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:17.474603 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Thu Jun 2 13:25:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:25:17.481134 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899185b-e019-4e29-9047-4b2f8ea9ce5f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:17.492143 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899185b-e019-4e29-9047-4b2f8ea9ce5f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:17.497900 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68a1dd-202d-4468-a93c-ed6ea615cf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:17.498922 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68a1dd-202d-4468-a93c-ed6ea615cf8c admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:17.499442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68a1dd-202d-4468-a93c-ed6ea615cf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:17.499748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68a1dd-202d-4468-a93c-ed6ea615cf8c admin admin] PATH_INFO: `/v3/users/27881d4c1bda4cb38dd2046d66b10c4e` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:17.501317 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68a1dd-202d-4468-a93c-ed6ea615cf8c admin admin] RBAC: Authorizing `identity:get_user(user_id=27881d4c1bda4cb38dd2046d66b10c4e)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:17.503213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68a1dd-202d-4468-a93c-ed6ea615cf8c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:17.504798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Thu Jun 2 13:25:17 2022] GET /identity/v3/users/27881d4c1bda4cb38dd2046d66b10c4e => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:19.836745 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d15687-5847-41e3-ac39-039e6c4cfbcd None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:19.837309 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d15687-5847-41e3-ac39-039e6c4cfbcd None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:19.837309 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d15687-5847-41e3-ac39-039e6c4cfbcd None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:19.838867 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:19.845342 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2bfb0-537f-440c-82b7-e23b83c31adb None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:19.845812 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2bfb0-537f-440c-82b7-e23b83c31adb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:19.846468 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2bfb0-537f-440c-82b7-e23b83c31adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:19.865270 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-40c2bfb0-537f-440c-82b7-e23b83c31adb None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:19.866437 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-40c2bfb0-537f-440c-82b7-e23b83c31adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:19.906634 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549f882-271a-47e0-87e5-2cb28533ea3a None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:19.906831 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549f882-271a-47e0-87e5-2cb28533ea3a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:19.907084 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549f882-271a-47e0-87e5-2cb28533ea3a None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:19.908656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:25:19.913537 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32a8ae-8ed6-4da5-a8a6-64a4ed614025 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:19.913824 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32a8ae-8ed6-4da5-a8a6-64a4ed614025 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:19.914103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32a8ae-8ed6-4da5-a8a6-64a4ed614025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:19.953295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:25:19.955325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG passlib.handlers.bcrypt [None req-fe32a8ae-8ed6-4da5-a8a6-64a4ed614025 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80238) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 02 13:25:19.955754 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG passlib.handlers.bcrypt [None req-fe32a8ae-8ed6-4da5-a8a6-64a4ed614025 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80238) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 02 13:25:19.976250 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2bfb0-537f-440c-82b7-e23b83c31adb None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:19.999941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:20.001732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-fe32a8ae-8ed6-4da5-a8a6-64a4ed614025 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:20.003460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-fe32a8ae-8ed6-4da5-a8a6-64a4ed614025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:20.081332 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2bfb0-537f-440c-82b7-e23b83c31adb None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:20.105826 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:25:20.114972 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e6498-6e16-4dba-b5ef-fdf205a73872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:20.115792 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e6498-6e16-4dba-b5ef-fdf205a73872 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:20.116070 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e6498-6e16-4dba-b5ef-fdf205a73872 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:20.116346 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e6498-6e16-4dba-b5ef-fdf205a73872 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:20.128477 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32a8ae-8ed6-4da5-a8a6-64a4ed614025 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:20.129958 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e6498-6e16-4dba-b5ef-fdf205a73872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:20.148927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-f36e6498-6e16-4dba-b5ef-fdf205a73872 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:25:20.148927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:20.148927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:20.148927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:20.148927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:20.148927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:20.148927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:20.148927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:20.148927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:20.148927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:20.148927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:20.148927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:20.148927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:20.148927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:20.148927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:20.148927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:20.150026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:20.150026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:20.150026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:20.150026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:20.150026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:20.150026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:20.150026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:20.150026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:20.150026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:20.150026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:20.150026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:20.150026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:20.150026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:20.150026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:20.150026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:20.150026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:20.150881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:20.150881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:20.150881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:20.150881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:20.150881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:20.150881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:20.150881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:20.150881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:20.150881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:20.150881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:20.150881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:25:20.150881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:25:20.151485 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:25:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:25:20.158519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e6498-6e16-4dba-b5ef-fdf205a73872 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:20.238050 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32a8ae-8ed6-4da5-a8a6-64a4ed614025 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:20.240422 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:20.257773 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:20.276382 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef6e38-3a0c-4234-bdb7-933f30d2d21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:20.276730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e6498-6e16-4dba-b5ef-fdf205a73872 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:20.277306 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef6e38-3a0c-4234-bdb7-933f30d2d21b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:20.277585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef6e38-3a0c-4234-bdb7-933f30d2d21b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:20.277853 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef6e38-3a0c-4234-bdb7-933f30d2d21b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:20.311822 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4244a37-63c1-45c2-9405-905334a208f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:20.312496 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4244a37-63c1-45c2-9405-905334a208f4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:20.312773 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4244a37-63c1-45c2-9405-905334a208f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:20.313027 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4244a37-63c1-45c2-9405-905334a208f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:20.313774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4244a37-63c1-45c2-9405-905334a208f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:20.314074 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4244a37-63c1-45c2-9405-905334a208f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:20.315514 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4244a37-63c1-45c2-9405-905334a208f4 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:20.328987 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:25:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:20.335320 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4244a37-63c1-45c2-9405-905334a208f4 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:20.349933 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef6e38-3a0c-4234-bdb7-933f30d2d21b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:20.351505 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef6e38-3a0c-4234-bdb7-933f30d2d21b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:20.432422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4244a37-63c1-45c2-9405-905334a208f4 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:20.450414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:25:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:25:20.456225 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef6e38-3a0c-4234-bdb7-933f30d2d21b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:20.458969 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:20.466477 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f4516-ee8d-44e5-9481-be4f008e47a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:20.467397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f4516-ee8d-44e5-9481-be4f008e47a1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:20.467728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f4516-ee8d-44e5-9481-be4f008e47a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:20.467989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f4516-ee8d-44e5-9481-be4f008e47a1 None admin] PATH_INFO: `/v3/users/27881d4c1bda4cb38dd2046d66b10c4e` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:20.469238 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f4516-ee8d-44e5-9481-be4f008e47a1 None admin] RBAC: Authorizing `identity:get_user(user_id=27881d4c1bda4cb38dd2046d66b10c4e)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:20.470713 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f4516-ee8d-44e5-9481-be4f008e47a1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:20.472323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:20 2022] GET /identity/v3/users/27881d4c1bda4cb38dd2046d66b10c4e => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:25:20.477759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f4516-ee8d-44e5-9481-be4f008e47a1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:20.491951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:20.565495 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef6e38-3a0c-4234-bdb7-933f30d2d21b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:20.583032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f4516-ee8d-44e5-9481-be4f008e47a1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:20.599618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5cd78-6b49-4fb6-97e2-0e997dbd69df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:20.600434 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5cd78-6b49-4fb6-97e2-0e997dbd69df None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:20.600717 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5cd78-6b49-4fb6-97e2-0e997dbd69df None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:20.600992 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5cd78-6b49-4fb6-97e2-0e997dbd69df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:20.616504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3037b4-61b4-4875-873c-86e47b4e271a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:20.617306 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3037b4-61b4-4875-873c-86e47b4e271a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:20.617584 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3037b4-61b4-4875-873c-86e47b4e271a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:20.617854 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3037b4-61b4-4875-873c-86e47b4e271a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:20.619039 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5cd78-6b49-4fb6-97e2-0e997dbd69df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:20.619163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3037b4-61b4-4875-873c-86e47b4e271a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:20.620477 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3037b4-61b4-4875-873c-86e47b4e271a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:20.620572 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5cd78-6b49-4fb6-97e2-0e997dbd69df None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:20.622064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 10/18] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:25:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:20.627912 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3037b4-61b4-4875-873c-86e47b4e271a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:20.642201 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-fdf5cd78-6b49-4fb6-97e2-0e997dbd69df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:25:20.642201 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:20.642201 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:20.642201 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:20.642201 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:20.642201 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:20.642201 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:20.642201 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:20.642201 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:20.642201 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:20.642201 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:20.642201 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:20.642201 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:25:20.642201 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:25:20.642201 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:25:20.643116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:25:20.643116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:20.643116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:20.643116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:20.643116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:20.643116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:20.643116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:20.643116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:20.643116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:20.643116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:20.643116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:20.643116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:20.643116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:20.643116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:20.643116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:20.643116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:20.643116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:20.643896 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:25:20.643896 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:25:20.643896 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:25:20.643896 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:25:20.643896 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 9/19] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:20.649606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5cd78-6b49-4fb6-97e2-0e997dbd69df None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:20.707984 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:20.708383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:20.728772 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3037b4-61b4-4875-873c-86e47b4e271a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:20.751768 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5cd78-6b49-4fb6-97e2-0e997dbd69df None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:20.761977 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01113d3-9c47-4ec3-88d7-75f65a9fea5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:20.762665 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01113d3-9c47-4ec3-88d7-75f65a9fea5e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:20.762945 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01113d3-9c47-4ec3-88d7-75f65a9fea5e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:20.763199 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01113d3-9c47-4ec3-88d7-75f65a9fea5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:20.764037 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01113d3-9c47-4ec3-88d7-75f65a9fea5e None admin] RBAC: Adding query filter params (role.id=6edd584a77084fa78240661ea76cddb5, scope.domain.id=default, user.id=27881d4c1bda4cb38dd2046d66b10c4e) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:20.764453 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01113d3-9c47-4ec3-88d7-75f65a9fea5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:20.765969 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01113d3-9c47-4ec3-88d7-75f65a9fea5e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:20.772950 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 11/20] 10.222.0.18 () {56 vars in 1322 bytes} [Thu Jun 2 13:25:20 2022] GET /identity/v3/role_assignments?user.id=27881d4c1bda4cb38dd2046d66b10c4e&scope.domain.id=default&role.id=6edd584a77084fa78240661ea76cddb5 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:25:20.785253 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b0678-c71d-442e-86be-047c3ef27612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:20.786041 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b0678-c71d-442e-86be-047c3ef27612 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:20.786365 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b0678-c71d-442e-86be-047c3ef27612 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:20.786668 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b0678-c71d-442e-86be-047c3ef27612 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:20.787409 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b0678-c71d-442e-86be-047c3ef27612 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:20.787712 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b0678-c71d-442e-86be-047c3ef27612 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:20.789170 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b0678-c71d-442e-86be-047c3ef27612 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:20.810486 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 10/21] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:25:23.503384 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfe4bf-ccc4-47a2-97f7-13c5eaa3c820 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:23.503928 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfe4bf-ccc4-47a2-97f7-13c5eaa3c820 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:23.504078 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfe4bf-ccc4-47a2-97f7-13c5eaa3c820 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:23.505714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 12/22] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:23.511417 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f848791-fe77-4585-846b-7035c0796d2f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:23.512240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f848791-fe77-4585-846b-7035c0796d2f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:23.512717 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f848791-fe77-4585-846b-7035c0796d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:23.539583 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-2f848791-fe77-4585-846b-7035c0796d2f None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:23.541125 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2f848791-fe77-4585-846b-7035c0796d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:23.584482 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7f0e0-6c86-442d-940d-c304bf550e5f None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:23.585168 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7f0e0-6c86-442d-940d-c304bf550e5f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:23.585664 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7f0e0-6c86-442d-940d-c304bf550e5f None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:23.587367 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 13/23] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:25:23.593371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0425efc-e608-4837-9030-13b2c31a5d8e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:23.594045 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0425efc-e608-4837-9030-13b2c31a5d8e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:23.594544 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0425efc-e608-4837-9030-13b2c31a5d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:23.628643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b0425efc-e608-4837-9030-13b2c31a5d8e None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:23.630414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b0425efc-e608-4837-9030-13b2c31a5d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:23.676059 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 11/24] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:25:23.747641 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 14/25] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:25:23.750662 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f848791-fe77-4585-846b-7035c0796d2f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:23.809021 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0425efc-e608-4837-9030-13b2c31a5d8e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:23.825741 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:23.908835 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f848791-fe77-4585-846b-7035c0796d2f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:23.951611 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84b1da-3629-4e54-9c21-309cd35b9e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:23.952815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84b1da-3629-4e54-9c21-309cd35b9e79 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:23.953233 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84b1da-3629-4e54-9c21-309cd35b9e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:23.953641 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84b1da-3629-4e54-9c21-309cd35b9e79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:23.962781 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:23.964738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84b1da-3629-4e54-9c21-309cd35b9e79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:23.966444 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84b1da-3629-4e54-9c21-309cd35b9e79 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:23.996894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-9d84b1da-3629-4e54-9c21-309cd35b9e79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:25:23.996894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:23.996894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:23.996894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:23.996894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:23.996894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:23.996894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:23.996894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:23.996894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:23.996894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:23.996894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:23.996894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:23.996894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:25:23.996894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:25:23.996894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:25:23.997759 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:25:23.997759 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:23.997759 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:23.997759 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:23.997759 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:23.997759 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:23.997759 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:23.997759 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:23.997759 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:23.997759 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:23.997759 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:23.997759 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:23.997759 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:23.997759 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:23.997759 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:23.997759 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:23.997759 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:23.998532 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:25:23.998532 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:25:23.998532 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:25:23.998532 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:25:23.999207 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 12/26] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:24.003959 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84b1da-3629-4e54-9c21-309cd35b9e79 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:24.017891 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0425efc-e608-4837-9030-13b2c31a5d8e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:24.054333 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33e9d5-bc31-4337-8adc-c68b6d38e190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:24.055361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33e9d5-bc31-4337-8adc-c68b6d38e190 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:24.055745 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33e9d5-bc31-4337-8adc-c68b6d38e190 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:24.056120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33e9d5-bc31-4337-8adc-c68b6d38e190 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:24.074997 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33e9d5-bc31-4337-8adc-c68b6d38e190 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:24.076504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-ef33e9d5-bc31-4337-8adc-c68b6d38e190 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:25:24.076504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:24.076504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:24.076504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:24.076504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:24.076504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:24.076504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:24.076504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:24.076504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:24.076504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:24.076504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:24.076504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:24.076504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:24.076504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:24.076504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:24.076504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:24.077507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:24.077507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:24.077507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:24.077507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:24.077507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:24.077507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:24.077507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:24.077507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:24.077507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:24.077507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:24.077507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:24.077507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:24.077507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:24.077507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:24.077507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:24.077507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:24.078385 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:24.078385 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:24.078385 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:24.078385 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:24.078385 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:24.078385 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:24.078385 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:24.078385 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:24.078385 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:24.078385 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:24.078385 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:25:24.078385 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:25:24.080637 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 15/27] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:25:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:24.086496 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33e9d5-bc31-4337-8adc-c68b6d38e190 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:24.157123 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84b1da-3629-4e54-9c21-309cd35b9e79 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:24.172547 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:24.201958 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33e9d5-bc31-4337-8adc-c68b6d38e190 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:24.219832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0256ad-c49a-4822-abef-b630dc719605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:24.220828 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0256ad-c49a-4822-abef-b630dc719605 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:24.221245 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0256ad-c49a-4822-abef-b630dc719605 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:24.221652 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0256ad-c49a-4822-abef-b630dc719605 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:24.222542 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0256ad-c49a-4822-abef-b630dc719605 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:24.230605 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0256ad-c49a-4822-abef-b630dc719605 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:24.232548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0256ad-c49a-4822-abef-b630dc719605 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:24.242615 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307dab77-ce94-4eb4-8986-0d6a3e83f4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:24.243495 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307dab77-ce94-4eb4-8986-0d6a3e83f4bd None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:24.250627 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307dab77-ce94-4eb4-8986-0d6a3e83f4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:24.250627 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307dab77-ce94-4eb4-8986-0d6a3e83f4bd None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:24.250627 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307dab77-ce94-4eb4-8986-0d6a3e83f4bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:24.250627 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307dab77-ce94-4eb4-8986-0d6a3e83f4bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:24.250627 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307dab77-ce94-4eb4-8986-0d6a3e83f4bd None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:24.250627 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:24.254929 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 13/28] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:25:24.256486 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614f219-ae40-4907-9feb-75720e8ce890 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:24.256909 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614f219-ae40-4907-9feb-75720e8ce890 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:24.257315 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614f219-ae40-4907-9feb-75720e8ce890 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:24.260300 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 16/29] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:25:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:24.261065 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 14/30] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:24.261731 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307dab77-ce94-4eb4-8986-0d6a3e83f4bd None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:24.266326 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16bdaf-bf01-4e88-a21d-2fdf5a0739c8 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:24.266887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16bdaf-bf01-4e88-a21d-2fdf5a0739c8 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:24.267299 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16bdaf-bf01-4e88-a21d-2fdf5a0739c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:24.292055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-2c16bdaf-bf01-4e88-a21d-2fdf5a0739c8 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:24.293440 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2c16bdaf-bf01-4e88-a21d-2fdf5a0739c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:24.373034 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307dab77-ce94-4eb4-8986-0d6a3e83f4bd None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:24.416865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 15/31] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:25:24.417735 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16bdaf-bf01-4e88-a21d-2fdf5a0739c8 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:24.417987 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b792c-9b2b-4497-8199-488096077ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:24.418713 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b792c-9b2b-4497-8199-488096077ffc None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:24.418998 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b792c-9b2b-4497-8199-488096077ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:24.419269 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b792c-9b2b-4497-8199-488096077ffc None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:24.420041 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b792c-9b2b-4497-8199-488096077ffc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:24.421983 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b792c-9b2b-4497-8199-488096077ffc None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:24.527562 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:24.541939 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16bdaf-bf01-4e88-a21d-2fdf5a0739c8 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:24.570803 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 17/32] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 13:25:24 2022] POST /identity/v3/projects => generated 301 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:25:24.573267 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a5fcf-63cf-4c3f-a917-3e7e91bb41f1 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:24.573749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a5fcf-63cf-4c3f-a917-3e7e91bb41f1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:24.574279 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a5fcf-63cf-4c3f-a917-3e7e91bb41f1 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:24.575928 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 18/33] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:24.577078 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a5fcf-63cf-4c3f-a917-3e7e91bb41f1 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:24.577734 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018f601-cda9-4b12-92fc-54a369426edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:24.578882 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018f601-cda9-4b12-92fc-54a369426edc None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:24.579162 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018f601-cda9-4b12-92fc-54a369426edc None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:24.579438 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018f601-cda9-4b12-92fc-54a369426edc None admin] PATH_INFO: `/v3/users/27881d4c1bda4cb38dd2046d66b10c4e` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:24.581178 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018f601-cda9-4b12-92fc-54a369426edc None admin] RBAC: Authorizing `identity:get_user(user_id=27881d4c1bda4cb38dd2046d66b10c4e)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:24.582718 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018f601-cda9-4b12-92fc-54a369426edc None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:24.584499 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 16/34] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:24 2022] GET /identity/v3/users/27881d4c1bda4cb38dd2046d66b10c4e => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:24.585916 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632707c-d265-487d-8c24-7a0a353a24ef None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:24.586199 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632707c-d265-487d-8c24-7a0a353a24ef None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:24.586471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632707c-d265-487d-8c24-7a0a353a24ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:24.603990 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-1632707c-d265-487d-8c24-7a0a353a24ef None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:24.605203 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1632707c-d265-487d-8c24-7a0a353a24ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:24.643606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:24.713576 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a5fcf-63cf-4c3f-a917-3e7e91bb41f1 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:24.727422 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 17/35] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:25:24.728382 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632707c-d265-487d-8c24-7a0a353a24ef None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:24.757389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb56ba3-35f7-45fb-912d-176aed66ece7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:24.758514 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb56ba3-35f7-45fb-912d-176aed66ece7 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:24.759118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb56ba3-35f7-45fb-912d-176aed66ece7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:24.759718 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb56ba3-35f7-45fb-912d-176aed66ece7 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:24.760687 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb56ba3-35f7-45fb-912d-176aed66ece7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:24.762596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb56ba3-35f7-45fb-912d-176aed66ece7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:24.783527 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 19/36] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Jun 2 13:25:24 2022] POST /identity/v3/roles => generated 225 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:25:24.785809 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173587a-27ab-480c-8083-17d0008112f2 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:24.786421 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173587a-27ab-480c-8083-17d0008112f2 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:24.787060 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173587a-27ab-480c-8083-17d0008112f2 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:24.788834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 20/37] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:24.790080 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173587a-27ab-480c-8083-17d0008112f2 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:24.832439 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:24.852126 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632707c-d265-487d-8c24-7a0a353a24ef None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:24.891252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b38cff-cbd9-4a27-aaa6-6b5fae4742ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:24.892000 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b38cff-cbd9-4a27-aaa6-6b5fae4742ab None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:24.892278 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b38cff-cbd9-4a27-aaa6-6b5fae4742ab None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:24.892549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b38cff-cbd9-4a27-aaa6-6b5fae4742ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:24.893760 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b38cff-cbd9-4a27-aaa6-6b5fae4742ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:24.895262 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b38cff-cbd9-4a27-aaa6-6b5fae4742ab None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:24.896979 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 18/38] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:25:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:24.898407 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f8b07-b1d3-4c0b-9d53-e83b34558362 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:24.898688 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f8b07-b1d3-4c0b-9d53-e83b34558362 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:24.898958 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f8b07-b1d3-4c0b-9d53-e83b34558362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:24.917143 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-dc6f8b07-b1d3-4c0b-9d53-e83b34558362 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:24.918370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-dc6f8b07-b1d3-4c0b-9d53-e83b34558362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:24.930528 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173587a-27ab-480c-8083-17d0008112f2 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:24.942409 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:24.978595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26170fc4-b7ce-46b9-9820-2a8692ff6340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:24.979539 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26170fc4-b7ce-46b9-9820-2a8692ff6340 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:24.979963 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26170fc4-b7ce-46b9-9820-2a8692ff6340 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:24.980378 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26170fc4-b7ce-46b9-9820-2a8692ff6340 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:24.981429 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26170fc4-b7ce-46b9-9820-2a8692ff6340 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:24.983124 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26170fc4-b7ce-46b9-9820-2a8692ff6340 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:25.000852 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 21/39] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Jun 2 13:25:24 2022] POST /identity/v3/roles => generated 219 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:25:25.002534 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26170fc4-b7ce-46b9-9820-2a8692ff6340 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:25.015362 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 19/40] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:25:25.040358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f8b07-b1d3-4c0b-9d53-e83b34558362 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:25.133247 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26170fc4-b7ce-46b9-9820-2a8692ff6340 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:25.156639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:25.174923 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f8b07-b1d3-4c0b-9d53-e83b34558362 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:25.183501 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26417748-32df-47f2-91b1-714d2a4a2381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:25.184941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26417748-32df-47f2-91b1-714d2a4a2381 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:25.185453 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26417748-32df-47f2-91b1-714d2a4a2381 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:25.185940 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26417748-32df-47f2-91b1-714d2a4a2381 None admin] PATH_INFO: `/v3/domains/default/users/27881d4c1bda4cb38dd2046d66b10c4e/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:25.189564 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26417748-32df-47f2-91b1-714d2a4a2381 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=27881d4c1bda4cb38dd2046d66b10c4e, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:25.191413 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26417748-32df-47f2-91b1-714d2a4a2381 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:25.211628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 22/41] 10.222.0.18 () {58 vars in 1361 bytes} [Thu Jun 2 13:25:25 2022] PUT /identity/v3/domains/default/users/27881d4c1bda4cb38dd2046d66b10c4e/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:25:25.217894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a34fa-bc0d-4389-ab23-852929738117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:25.218707 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a34fa-bc0d-4389-ab23-852929738117 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:25.218990 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a34fa-bc0d-4389-ab23-852929738117 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:25.219263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a34fa-bc0d-4389-ab23-852929738117 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:25.220188 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a34fa-bc0d-4389-ab23-852929738117 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:25.221692 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a34fa-bc0d-4389-ab23-852929738117 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:25.241464 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0751e-349a-4f4d-a13b-f05a8305a436 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:25.241791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0751e-349a-4f4d-a13b-f05a8305a436 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:25.242076 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0751e-349a-4f4d-a13b-f05a8305a436 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:25.244155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 23/42] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:25:25.254121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43623065-ca53-4a72-a13c-c8a29eab9751 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:25.254460 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43623065-ca53-4a72-a13c-c8a29eab9751 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:25.254751 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43623065-ca53-4a72-a13c-c8a29eab9751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:25.274528 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-43623065-ca53-4a72-a13c-c8a29eab9751 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:25.276187 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-43623065-ca53-4a72-a13c-c8a29eab9751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:25.308083 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:25.368050 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 20/43] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Jun 2 13:25:25 2022] POST /identity/v3/roles => generated 223 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:25:25.371121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 24/44] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:25:25.399647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a34fa-bc0d-4389-ab23-852929738117 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:25.521939 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a34fa-bc0d-4389-ab23-852929738117 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:25.559671 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e6e3a-758a-43c9-a779-4dec544d08d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:25.560590 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e6e3a-758a-43c9-a779-4dec544d08d2 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:25.560771 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e6e3a-758a-43c9-a779-4dec544d08d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:25.561012 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e6e3a-758a-43c9-a779-4dec544d08d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:25.562746 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e6e3a-758a-43c9-a779-4dec544d08d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:25.564410 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e6e3a-758a-43c9-a779-4dec544d08d2 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:25.566350 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 21/45] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:25:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:25.572094 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43623065-ca53-4a72-a13c-c8a29eab9751 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:25.683941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43623065-ca53-4a72-a13c-c8a29eab9751 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:25.720265 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577fd044-8031-497e-b8f0-18797ea05886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:25.720936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fd044-8031-497e-b8f0-18797ea05886 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:25.721221 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fd044-8031-497e-b8f0-18797ea05886 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:25.721495 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fd044-8031-497e-b8f0-18797ea05886 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:25.722215 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577fd044-8031-497e-b8f0-18797ea05886 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:25.723719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577fd044-8031-497e-b8f0-18797ea05886 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:25.749926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 25/46] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 13:25:25 2022] POST /identity/v3/projects => generated 312 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:25:27.516721 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acde96-1a62-4fa1-b3ba-729ac6ca05d1 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:27.517268 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acde96-1a62-4fa1-b3ba-729ac6ca05d1 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:27.517268 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acde96-1a62-4fa1-b3ba-729ac6ca05d1 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:27.518643 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 22/47] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:27.524067 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fcbe1-93b3-4495-abca-b4548daadddd None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:27.524480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fcbe1-93b3-4495-abca-b4548daadddd None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:27.524621 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fcbe1-93b3-4495-abca-b4548daadddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:27.542774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-441fcbe1-93b3-4495-abca-b4548daadddd None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:27.543987 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-441fcbe1-93b3-4495-abca-b4548daadddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:27.547093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:27.616188 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 26/48] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:25:27.639477 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acde96-1a62-4fa1-b3ba-729ac6ca05d1 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:27.655594 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:27.749981 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acde96-1a62-4fa1-b3ba-729ac6ca05d1 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:27.785645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79daa6b-c636-4ebe-8d6f-40b7f0089eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:27.786359 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79daa6b-c636-4ebe-8d6f-40b7f0089eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:27.786637 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79daa6b-c636-4ebe-8d6f-40b7f0089eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:27.786939 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79daa6b-c636-4ebe-8d6f-40b7f0089eb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:27.798781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79daa6b-c636-4ebe-8d6f-40b7f0089eb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:27.807370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-a79daa6b-c636-4ebe-8d6f-40b7f0089eb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:25:27.807370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:27.807370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:27.807370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:27.807370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:27.807370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:27.807370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:27.807370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:27.807370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:27.807370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:27.807370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:27.807370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:27.807370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:27.807370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:27.807370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:27.807370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:27.808347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:27.808347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:27.808347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:27.808347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:27.808347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:27.808347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:27.808347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:27.808347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:27.808347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:27.808347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:27.808347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:27.808347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:27.808347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:27.808347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:27.808347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:27.808347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:27.809272 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:27.809272 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:27.809272 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:27.809272 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:27.809272 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:27.809272 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:27.809272 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:27.809272 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:27.809272 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:27.809272 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:27.809272 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:25:27.809272 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:25:27.809272 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 23/49] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:25:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:27.816397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fcbe1-93b3-4495-abca-b4548daadddd None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:27.918377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fcbe1-93b3-4495-abca-b4548daadddd None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:27.953041 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973987fb-3a31-4431-bd59-5caf87f1e5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:27.953725 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973987fb-3a31-4431-bd59-5caf87f1e5ec None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:27.954004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973987fb-3a31-4431-bd59-5caf87f1e5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:27.954281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973987fb-3a31-4431-bd59-5caf87f1e5ec None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:27.955073 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973987fb-3a31-4431-bd59-5caf87f1e5ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:27.955382 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973987fb-3a31-4431-bd59-5caf87f1e5ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:27.956779 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973987fb-3a31-4431-bd59-5caf87f1e5ec None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:27.965225 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 27/50] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:25:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:27.971209 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79daa6b-c636-4ebe-8d6f-40b7f0089eb7 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:28.004682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca91a2-6b61-487f-b7eb-ceb20a7fe8a4 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:28.004921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca91a2-6b61-487f-b7eb-ceb20a7fe8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:28.005211 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca91a2-6b61-487f-b7eb-ceb20a7fe8a4 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:28.006616 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 28/51] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:25:28.011559 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19e450-d193-41dd-bb44-58fae40f4847 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:28.011848 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19e450-d193-41dd-bb44-58fae40f4847 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:28.012128 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19e450-d193-41dd-bb44-58fae40f4847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:28.017394 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:28.030014 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-7e19e450-d193-41dd-bb44-58fae40f4847 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:28.031233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7e19e450-d193-41dd-bb44-58fae40f4847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:28.046926 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:28.078227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79daa6b-c636-4ebe-8d6f-40b7f0089eb7 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:28.097419 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 29/52] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:25:28.112724 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650ed13-2c06-48b5-ab9b-74e8dbe5427d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:28.113611 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650ed13-2c06-48b5-ab9b-74e8dbe5427d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:28.113893 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650ed13-2c06-48b5-ab9b-74e8dbe5427d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:28.114165 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650ed13-2c06-48b5-ab9b-74e8dbe5427d None admin] PATH_INFO: `/v3/users/27881d4c1bda4cb38dd2046d66b10c4e` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:28.115446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650ed13-2c06-48b5-ab9b-74e8dbe5427d None admin] RBAC: Authorizing `identity:get_user(user_id=27881d4c1bda4cb38dd2046d66b10c4e)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:28.116889 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650ed13-2c06-48b5-ab9b-74e8dbe5427d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:28.118760 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 24/53] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:27 2022] GET /identity/v3/users/27881d4c1bda4cb38dd2046d66b10c4e => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:28.120189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19e450-d193-41dd-bb44-58fae40f4847 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:28.124093 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650ed13-2c06-48b5-ab9b-74e8dbe5427d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:28.217869 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19e450-d193-41dd-bb44-58fae40f4847 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:28.223576 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650ed13-2c06-48b5-ab9b-74e8dbe5427d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:28.247431 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:28.254163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61875b1a-2a0f-42ec-8759-fbd5dea974af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:28.255019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61875b1a-2a0f-42ec-8759-fbd5dea974af None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:28.255293 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61875b1a-2a0f-42ec-8759-fbd5dea974af None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:28.255545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61875b1a-2a0f-42ec-8759-fbd5dea974af None admin] PATH_INFO: `/v3/domains/default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:28.256719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61875b1a-2a0f-42ec-8759-fbd5dea974af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:28.257347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574fcb0-d2ad-47e2-b810-762e124dd1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:28.258160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574fcb0-d2ad-47e2-b810-762e124dd1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:28.258245 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61875b1a-2a0f-42ec-8759-fbd5dea974af None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:28.258445 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574fcb0-d2ad-47e2-b810-762e124dd1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:28.258763 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574fcb0-d2ad-47e2-b810-762e124dd1a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:28.259811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 30/54] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:25:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:28.259977 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574fcb0-d2ad-47e2-b810-762e124dd1a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:28.261434 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574fcb0-d2ad-47e2-b810-762e124dd1a3 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:28.263041 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 25/55] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:25:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:28.265447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61875b1a-2a0f-42ec-8759-fbd5dea974af None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:28.268602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574fcb0-d2ad-47e2-b810-762e124dd1a3 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:28.281097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:28.365379 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61875b1a-2a0f-42ec-8759-fbd5dea974af None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:28.371178 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574fcb0-d2ad-47e2-b810-762e124dd1a3 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:28.400671 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174e0d4-e704-421d-abdf-d71e59f986cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:28.401521 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174e0d4-e704-421d-abdf-d71e59f986cd None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:28.401814 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174e0d4-e704-421d-abdf-d71e59f986cd None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:28.402185 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174e0d4-e704-421d-abdf-d71e59f986cd None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:28.403000 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174e0d4-e704-421d-abdf-d71e59f986cd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:28.404945 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174e0d4-e704-421d-abdf-d71e59f986cd None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:28.406729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d0f7a-c4f7-45b8-bf88-ccd3aa705e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:28.407565 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d0f7a-c4f7-45b8-bf88-ccd3aa705e4e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:28.407917 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d0f7a-c4f7-45b8-bf88-ccd3aa705e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:28.408259 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d0f7a-c4f7-45b8-bf88-ccd3aa705e4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:28.409482 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d0f7a-c4f7-45b8-bf88-ccd3aa705e4e None admin] RBAC: Adding query filter params (role.id=6edd584a77084fa78240661ea76cddb5, scope.domain.id=default, user.id=27881d4c1bda4cb38dd2046d66b10c4e) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:28.409930 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d0f7a-c4f7-45b8-bf88-ccd3aa705e4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:28.411768 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d0f7a-c4f7-45b8-bf88-ccd3aa705e4e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:28.426605 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 26/56] 10.222.0.18 () {56 vars in 1322 bytes} [Thu Jun 2 13:25:28 2022] GET /identity/v3/role_assignments?user.id=27881d4c1bda4cb38dd2046d66b10c4e&scope.domain.id=default&role.id=6edd584a77084fa78240661ea76cddb5 => generated 530 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:28.434754 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 31/57] 10.222.0.18 () {60 vars in 1140 bytes} [Thu Jun 2 13:25:28 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:25:30.693604 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630aa47c-dce5-4ff9-b6be-dd6555c7fb24 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:30.694404 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630aa47c-dce5-4ff9-b6be-dd6555c7fb24 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:30.694514 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630aa47c-dce5-4ff9-b6be-dd6555c7fb24 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:30.696725 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 27/58] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:30.703242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5a9a7-9940-4c67-b23f-85e64fc8b61a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:30.703976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5a9a7-9940-4c67-b23f-85e64fc8b61a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:30.704117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5a9a7-9940-4c67-b23f-85e64fc8b61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:30.727497 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-7bc5a9a7-9940-4c67-b23f-85e64fc8b61a None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:30.728671 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7bc5a9a7-9940-4c67-b23f-85e64fc8b61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:30.778413 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:30.801154 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 32/59] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:25:30.825622 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630aa47c-dce5-4ff9-b6be-dd6555c7fb24 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:30.902709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:30.940020 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630aa47c-dce5-4ff9-b6be-dd6555c7fb24 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:30.975813 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8484184-3d93-4a7e-bcaf-734d651d1e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:30.976617 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8484184-3d93-4a7e-bcaf-734d651d1e0e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:30.976901 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8484184-3d93-4a7e-bcaf-734d651d1e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:30.977176 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8484184-3d93-4a7e-bcaf-734d651d1e0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:30.978410 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8484184-3d93-4a7e-bcaf-734d651d1e0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:30.979906 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8484184-3d93-4a7e-bcaf-734d651d1e0e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:30.981497 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 28/60] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:25:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:30.987725 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5a9a7-9940-4c67-b23f-85e64fc8b61a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:31.094276 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5a9a7-9940-4c67-b23f-85e64fc8b61a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:31.136816 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e02fd8-3131-4f28-b6e1-dc109f298d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:31.137879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e02fd8-3131-4f28-b6e1-dc109f298d00 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:31.138336 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e02fd8-3131-4f28-b6e1-dc109f298d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:31.138838 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e02fd8-3131-4f28-b6e1-dc109f298d00 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:31.139852 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e02fd8-3131-4f28-b6e1-dc109f298d00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:31.141321 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e02fd8-3131-4f28-b6e1-dc109f298d00 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:31.169659 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 33/61] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 13:25:30 2022] POST /identity/v3/users => generated 275 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:25:34.550646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3019d1c-9e69-4a71-8659-d1ca8e9121fb None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:34.551173 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3019d1c-9e69-4a71-8659-d1ca8e9121fb None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:34.551246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3019d1c-9e69-4a71-8659-d1ca8e9121fb None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:34.552590 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 29/62] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:25:34.558229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7151973-7480-4fb1-9e6e-67ed67baa97c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:34.558681 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7151973-7480-4fb1-9e6e-67ed67baa97c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:34.558857 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7151973-7480-4fb1-9e6e-67ed67baa97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:34.582728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f7151973-7480-4fb1-9e6e-67ed67baa97c None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:34.583950 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f7151973-7480-4fb1-9e6e-67ed67baa97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:34.627704 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:34.686382 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 34/63] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:25:34.722552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3019d1c-9e69-4a71-8659-d1ca8e9121fb None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:34.760763 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd4bb3-5a45-4cb9-8c84-cb1e7ac6e823 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:34.761111 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd4bb3-5a45-4cb9-8c84-cb1e7ac6e823 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:34.761326 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd4bb3-5a45-4cb9-8c84-cb1e7ac6e823 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:34.762754 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 35/64] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:25:34.768405 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba873c1-2774-4cac-accf-d8a61ae71ccb None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:34.768773 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba873c1-2774-4cac-accf-d8a61ae71ccb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:34.769124 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba873c1-2774-4cac-accf-d8a61ae71ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:34.801134 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-eba873c1-2774-4cac-accf-d8a61ae71ccb None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:34.802380 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-eba873c1-2774-4cac-accf-d8a61ae71ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:34.894975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3019d1c-9e69-4a71-8659-d1ca8e9121fb None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:34.922595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 36/65] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:25:34.922595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0843e-51d9-4855-a0be-68a80813f95f None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:34.922595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0843e-51d9-4855-a0be-68a80813f95f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:34.922595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0843e-51d9-4855-a0be-68a80813f95f None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:34.922595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 37/66] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:34.924764 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ca38b-b9df-491b-aa64-eb0f68179e4c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:34.925045 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ca38b-b9df-491b-aa64-eb0f68179e4c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:34.925315 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ca38b-b9df-491b-aa64-eb0f68179e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:34.942827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-793ca38b-b9df-491b-aa64-eb0f68179e4c None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:34.943999 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-793ca38b-b9df-491b-aa64-eb0f68179e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:34.959808 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9355357-6bda-4032-bff6-e8ca1966251a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:34.960628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9355357-6bda-4032-bff6-e8ca1966251a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:34.961014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9355357-6bda-4032-bff6-e8ca1966251a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:34.961295 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9355357-6bda-4032-bff6-e8ca1966251a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:34.969955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:34.974148 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9355357-6bda-4032-bff6-e8ca1966251a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:34.983009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-d9355357-6bda-4032-bff6-e8ca1966251a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:25:34.983009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:34.983009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:34.983009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:34.983009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:34.983009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:34.983009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:34.983009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:34.983009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:34.983009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:34.983009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:34.983009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:34.983009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:34.983009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:34.983009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:34.983009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:34.984068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:34.984068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:34.984068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:34.984068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:34.984068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:34.984068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:34.984068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:34.984068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:34.984068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:34.984068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:34.984068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:34.984068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:34.984068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:34.984068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:34.984068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:34.984068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:34.984961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:34.984961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:34.984961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:34.984961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:34.984961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:34.984961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:34.984961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:34.984961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:34.984961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:34.984961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:34.984961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:25:34.984961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:25:34.984961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 30/67] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:25:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:34.985584 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9355357-6bda-4032-bff6-e8ca1966251a None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:35.022696 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 38/68] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:25:35.023980 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ca38b-b9df-491b-aa64-eb0f68179e4c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:35.061381 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:35.108112 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9355357-6bda-4032-bff6-e8ca1966251a None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:35.141680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ca38b-b9df-491b-aa64-eb0f68179e4c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:35.143621 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56921ff8-4a8f-4e7c-a412-967b2b7f2b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:35.144455 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56921ff8-4a8f-4e7c-a412-967b2b7f2b9f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:35.144739 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56921ff8-4a8f-4e7c-a412-967b2b7f2b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:35.145012 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56921ff8-4a8f-4e7c-a412-967b2b7f2b9f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:35.156677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56921ff8-4a8f-4e7c-a412-967b2b7f2b9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:35.164639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-56921ff8-4a8f-4e7c-a412-967b2b7f2b9f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:25:35.164639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:35.164639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:35.164639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:35.164639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:35.164639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:35.164639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:35.164639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:35.164639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:35.164639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:35.164639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:35.164639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:35.164639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:35.164639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:35.164639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:35.164639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:35.165463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:35.165463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:35.165463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:35.165463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:35.165463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:35.165463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:35.165463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:35.165463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:35.165463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:35.165463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:35.165463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:35.165463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:35.165463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:35.165463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:35.165463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:35.165463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:35.166209 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:35.166209 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:35.166209 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:35.166209 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:35.166209 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:35.166209 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:35.166209 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:35.166209 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:35.166209 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:35.166209 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:35.166209 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:25:35.166209 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:25:35.166209 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 31/69] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 13:25:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:35.167277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56921ff8-4a8f-4e7c-a412-967b2b7f2b9f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:35.186419 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d534d0b-fe52-4c1e-b499-fc85d6d10123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:35.187797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d534d0b-fe52-4c1e-b499-fc85d6d10123 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:35.188468 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d534d0b-fe52-4c1e-b499-fc85d6d10123 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:35.188847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d534d0b-fe52-4c1e-b499-fc85d6d10123 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:35.190011 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d534d0b-fe52-4c1e-b499-fc85d6d10123 None admin] RBAC: Adding query filter params (name=member) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:35.190473 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d534d0b-fe52-4c1e-b499-fc85d6d10123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:35.192641 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d534d0b-fe52-4c1e-b499-fc85d6d10123 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:35.210589 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 39/70] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:25:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:35.210589 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6d86c-8d54-4550-9275-32e6882b5cfb None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:35.210589 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6d86c-8d54-4550-9275-32e6882b5cfb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:35.210589 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6d86c-8d54-4550-9275-32e6882b5cfb None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:35.211905 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 40/71] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:35.215525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6d86c-8d54-4550-9275-32e6882b5cfb None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:35.241909 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:35.289698 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56921ff8-4a8f-4e7c-a412-967b2b7f2b9f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:35.324460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e127c-e251-4551-887b-f915b02f2eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:35.325286 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e127c-e251-4551-887b-f915b02f2eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:35.325569 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e127c-e251-4551-887b-f915b02f2eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:35.325848 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e127c-e251-4551-887b-f915b02f2eb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:35.327378 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:35.338351 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e127c-e251-4551-887b-f915b02f2eb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:35.338632 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6d86c-8d54-4550-9275-32e6882b5cfb None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:35.346011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-755e127c-e251-4551-887b-f915b02f2eb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:25:35.346011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:35.346011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:35.346011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:35.346011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:35.346011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:35.346011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:35.346011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:35.346011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:35.346011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:35.346011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:35.346011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:35.346011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:35.346011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:35.346011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:35.346011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:35.346918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:35.346918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:35.346918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:35.346918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:35.346918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:35.346918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:35.346918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:35.346918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:35.346918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:35.346918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:35.346918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:35.346918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:35.346918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:35.346918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:35.346918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:35.346918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:35.347788 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:35.347788 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:35.347788 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:35.347788 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:35.347788 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:35.347788 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:35.347788 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:35.347788 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:35.347788 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:35.347788 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:35.347788 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:25:35.347788 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:25:35.347788 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 32/72] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:25:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:35.348487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e127c-e251-4551-887b-f915b02f2eb7 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:35.378788 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacab30c-a1d9-4a88-8f9a-33e67a4babcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:35.379498 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacab30c-a1d9-4a88-8f9a-33e67a4babcc None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:35.379776 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacab30c-a1d9-4a88-8f9a-33e67a4babcc None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:35.380053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacab30c-a1d9-4a88-8f9a-33e67a4babcc None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:35.380799 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacab30c-a1d9-4a88-8f9a-33e67a4babcc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:35.381105 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacab30c-a1d9-4a88-8f9a-33e67a4babcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:35.382546 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacab30c-a1d9-4a88-8f9a-33e67a4babcc None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:35.392142 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 41/73] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:25:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:35.393386 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aaae4b-e753-4b76-a8c3-6fd5ae4e9192 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:35.393671 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aaae4b-e753-4b76-a8c3-6fd5ae4e9192 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:35.393947 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aaae4b-e753-4b76-a8c3-6fd5ae4e9192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:35.410453 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-59aaae4b-e753-4b76-a8c3-6fd5ae4e9192 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:35.411684 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-59aaae4b-e753-4b76-a8c3-6fd5ae4e9192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:35.452287 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e127c-e251-4551-887b-f915b02f2eb7 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:35.472327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:35.479952 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 42/74] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:25:35.480794 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aaae4b-e753-4b76-a8c3-6fd5ae4e9192 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:35.499431 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16684d-fa88-4838-9264-2279c2ab3544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:35.500332 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16684d-fa88-4838-9264-2279c2ab3544 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:35.500760 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16684d-fa88-4838-9264-2279c2ab3544 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:35.501041 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16684d-fa88-4838-9264-2279c2ab3544 None admin] PATH_INFO: `/v3/users/f899f20bb3ec422192ead16d0af584af` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:35.518010 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16684d-fa88-4838-9264-2279c2ab3544 None admin] RBAC: Authorizing `identity:get_user(user_id=f899f20bb3ec422192ead16d0af584af)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:35.519531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16684d-fa88-4838-9264-2279c2ab3544 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:35.521233 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 33/75] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:35 2022] GET /identity/v3/users/f899f20bb3ec422192ead16d0af584af => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:35.522487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a7606-362e-49c2-9526-30c45cc5f942 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:35.522802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a7606-362e-49c2-9526-30c45cc5f942 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:35.523079 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a7606-362e-49c2-9526-30c45cc5f942 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:35.527050 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 34/76] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:35.527050 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a7606-362e-49c2-9526-30c45cc5f942 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:35.571172 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:35.593353 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aaae4b-e753-4b76-a8c3-6fd5ae4e9192 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:35.633821 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a7606-362e-49c2-9526-30c45cc5f942 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:35.634271 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d28b4-5559-4e71-8b6d-f08bc7d2d3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:35.634271 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d28b4-5559-4e71-8b6d-f08bc7d2d3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:35.634271 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d28b4-5559-4e71-8b6d-f08bc7d2d3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:35.634271 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d28b4-5559-4e71-8b6d-f08bc7d2d3a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:35.634613 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d28b4-5559-4e71-8b6d-f08bc7d2d3a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:35.634692 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d28b4-5559-4e71-8b6d-f08bc7d2d3a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:35.636157 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d28b4-5559-4e71-8b6d-f08bc7d2d3a7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:35.645237 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 43/77] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:25:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:35.646064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d28b4-5559-4e71-8b6d-f08bc7d2d3a7 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:35.669558 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5e668-1410-466a-8399-69b1842eab62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:35.670787 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5e668-1410-466a-8399-69b1842eab62 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:35.671065 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5e668-1410-466a-8399-69b1842eab62 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:35.671407 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5e668-1410-466a-8399-69b1842eab62 None admin] PATH_INFO: `/v3/users/f899f20bb3ec422192ead16d0af584af` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:35.672641 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5e668-1410-466a-8399-69b1842eab62 None admin] RBAC: Authorizing `identity:get_user(user_id=f899f20bb3ec422192ead16d0af584af)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:35.674088 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5e668-1410-466a-8399-69b1842eab62 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:35.675743 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 35/78] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:35 2022] GET /identity/v3/users/f899f20bb3ec422192ead16d0af584af => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:35.680462 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5e668-1410-466a-8399-69b1842eab62 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:35.722018 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:35.751643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d28b4-5559-4e71-8b6d-f08bc7d2d3a7 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:35.774062 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5e668-1410-466a-8399-69b1842eab62 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:35.785947 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfe459-cd78-459d-94c6-b08da14ea180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:35.786769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfe459-cd78-459d-94c6-b08da14ea180 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:35.787025 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfe459-cd78-459d-94c6-b08da14ea180 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:35.787296 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfe459-cd78-459d-94c6-b08da14ea180 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:35.788475 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bfe459-cd78-459d-94c6-b08da14ea180 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:35.789926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bfe459-cd78-459d-94c6-b08da14ea180 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:35.791566 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 44/79] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:25:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:35.792684 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e17cc-9649-4266-952d-24fa56e1461f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:35.792966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e17cc-9649-4266-952d-24fa56e1461f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:35.793236 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e17cc-9649-4266-952d-24fa56e1461f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:35.808964 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3b5e17cc-9649-4266-952d-24fa56e1461f None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:35.809498 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e742b-ce8b-44c3-a7ac-d7be09077eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:35.810139 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3b5e17cc-9649-4266-952d-24fa56e1461f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:35.810248 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e742b-ce8b-44c3-a7ac-d7be09077eaa None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:35.810427 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e742b-ce8b-44c3-a7ac-d7be09077eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:35.810731 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e742b-ce8b-44c3-a7ac-d7be09077eaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:35.817375 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:35.878195 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 45/80] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:25:35.879027 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e17cc-9649-4266-952d-24fa56e1461f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:35.879355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e742b-ce8b-44c3-a7ac-d7be09077eaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:35.880829 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e742b-ce8b-44c3-a7ac-d7be09077eaa None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:35.943439 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:35.996166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e17cc-9649-4266-952d-24fa56e1461f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:36.002214 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 36/81] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:25:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:36.003106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e742b-ce8b-44c3-a7ac-d7be09077eaa None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:36.030764 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f13b2-a0ff-4e6d-a6c6-c2e3a6a42ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:36.031656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f13b2-a0ff-4e6d-a6c6-c2e3a6a42ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:36.031932 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f13b2-a0ff-4e6d-a6c6-c2e3a6a42ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:36.032197 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f13b2-a0ff-4e6d-a6c6-c2e3a6a42ec4 None admin] PATH_INFO: `/v3/users/27881d4c1bda4cb38dd2046d66b10c4e` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:36.033397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f13b2-a0ff-4e6d-a6c6-c2e3a6a42ec4 None admin] RBAC: Authorizing `identity:get_user(user_id=27881d4c1bda4cb38dd2046d66b10c4e)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:36.034873 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f13b2-a0ff-4e6d-a6c6-c2e3a6a42ec4 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:36.036487 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 46/82] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:35 2022] GET /identity/v3/users/27881d4c1bda4cb38dd2046d66b10c4e => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:36.037232 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f13b2-a0ff-4e6d-a6c6-c2e3a6a42ec4 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:36.048760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:36.113462 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e742b-ce8b-44c3-a7ac-d7be09077eaa None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:36.135911 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f13b2-a0ff-4e6d-a6c6-c2e3a6a42ec4 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:36.147811 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4de37f-865c-46be-b226-b6052ac61e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:36.148471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4de37f-865c-46be-b226-b6052ac61e10 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:36.148750 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4de37f-865c-46be-b226-b6052ac61e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:36.149021 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4de37f-865c-46be-b226-b6052ac61e10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:36.165353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:36.169381 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b479c52-73d7-4034-aad3-9ad441f1b14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:36.170056 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b479c52-73d7-4034-aad3-9ad441f1b14e None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:36.170337 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b479c52-73d7-4034-aad3-9ad441f1b14e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:36.170640 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b479c52-73d7-4034-aad3-9ad441f1b14e None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:36.171582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b479c52-73d7-4034-aad3-9ad441f1b14e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:36.173151 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b479c52-73d7-4034-aad3-9ad441f1b14e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:36.192461 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 47/83] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 13:25:36 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:25:36.193272 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b479c52-73d7-4034-aad3-9ad441f1b14e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:36.236147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4de37f-865c-46be-b226-b6052ac61e10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:36.237738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4de37f-865c-46be-b226-b6052ac61e10 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:36.277261 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:36.324411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b479c52-73d7-4034-aad3-9ad441f1b14e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:36.372145 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cbaf9-c132-4187-9baf-85001c9d4d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:36.372978 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cbaf9-c132-4187-9baf-85001c9d4d13 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:36.373395 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cbaf9-c132-4187-9baf-85001c9d4d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:36.373746 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cbaf9-c132-4187-9baf-85001c9d4d13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:36.378141 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 37/84] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:25:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:36.379471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4de37f-865c-46be-b226-b6052ac61e10 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:36.388560 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88cbaf9-c132-4187-9baf-85001c9d4d13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:36.397440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-f88cbaf9-c132-4187-9baf-85001c9d4d13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:25:36.397440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:36.397440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:36.397440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:36.397440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:36.397440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:36.397440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:36.397440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:36.397440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:36.397440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:36.397440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:36.397440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:36.397440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:36.397440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:36.397440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:36.397440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:36.398343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:36.398343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:36.398343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:36.398343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:36.398343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:36.398343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:36.398343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:36.398343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:36.398343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:36.398343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:36.398343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:36.398343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:36.398343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:36.398343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:36.398343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:36.398343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:36.399494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:36.399494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:36.399494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:36.399494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:36.399494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:36.399494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:36.399494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:36.399494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:36.399494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:36.399494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:36.399494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:25:36.399494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:25:36.399494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 48/85] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:25:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:36.400435 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cbaf9-c132-4187-9baf-85001c9d4d13 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:36.442622 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:36.513512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4de37f-865c-46be-b226-b6052ac61e10 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:36.528970 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cbaf9-c132-4187-9baf-85001c9d4d13 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:36.552831 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5c32d-6c0d-4d37-8709-e121c1667fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:36.553719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5c32d-6c0d-4d37-8709-e121c1667fec None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:36.554004 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5c32d-6c0d-4d37-8709-e121c1667fec None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:36.554278 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5c32d-6c0d-4d37-8709-e121c1667fec None admin] PATH_INFO: `/v3/projects/ce43efdcbb764869a0f4347b5b29fcca` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:36.556348 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5c32d-6c0d-4d37-8709-e121c1667fec None admin] RBAC: Authorizing `identity:get_project(project_id=ce43efdcbb764869a0f4347b5b29fcca)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:36.558021 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5c32d-6c0d-4d37-8709-e121c1667fec None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:36.560544 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 38/86] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:25:36 2022] GET /identity/v3/projects/ce43efdcbb764869a0f4347b5b29fcca => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:36.561623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5c32d-6c0d-4d37-8709-e121c1667fec None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:36.572486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:36.582418 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafed63-0946-404b-82ff-8d8adea52416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:36.583176 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafed63-0946-404b-82ff-8d8adea52416 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:36.583462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafed63-0946-404b-82ff-8d8adea52416 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:36.583742 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafed63-0946-404b-82ff-8d8adea52416 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:36.682262 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5c32d-6c0d-4d37-8709-e121c1667fec None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:36.684731 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cafed63-0946-404b-82ff-8d8adea52416 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:36.687605 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cafed63-0946-404b-82ff-8d8adea52416 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:36.702340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:36.730734 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f6569-a87c-45d1-a045-5523b138b1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:36.731773 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f6569-a87c-45d1-a045-5523b138b1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:36.732148 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f6569-a87c-45d1-a045-5523b138b1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:36.732963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f6569-a87c-45d1-a045-5523b138b1f3 None admin] PATH_INFO: `/v3/projects/ce43efdcbb764869a0f4347b5b29fcca` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:36.734792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f6569-a87c-45d1-a045-5523b138b1f3 None admin] RBAC: Authorizing `identity:get_project(project_id=ce43efdcbb764869a0f4347b5b29fcca)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:36.736594 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f6569-a87c-45d1-a045-5523b138b1f3 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:36.743845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 39/87] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:25:36 2022] GET /identity/v3/projects/ce43efdcbb764869a0f4347b5b29fcca => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:36.743845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f6569-a87c-45d1-a045-5523b138b1f3 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:36.801907 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 49/88] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:25:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:36.803285 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafed63-0946-404b-82ff-8d8adea52416 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:36.831842 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:36.858564 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f6569-a87c-45d1-a045-5523b138b1f3 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:36.896236 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d522e3-2c2a-4715-b593-a033c2f4d497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:36.896924 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d522e3-2c2a-4715-b593-a033c2f4d497 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:36.897204 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d522e3-2c2a-4715-b593-a033c2f4d497 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:36.897474 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d522e3-2c2a-4715-b593-a033c2f4d497 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:36.898543 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d522e3-2c2a-4715-b593-a033c2f4d497 None admin] RBAC: Adding query filter params (name=member) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:36.898543 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d522e3-2c2a-4715-b593-a033c2f4d497 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:36.899990 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d522e3-2c2a-4715-b593-a033c2f4d497 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:36.917690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 40/89] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:25:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:36.917690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d522e3-2c2a-4715-b593-a033c2f4d497 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:36.936579 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafed63-0946-404b-82ff-8d8adea52416 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:36.963162 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:36.984960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b468b-0a82-48a7-9e6b-8d03ef12a85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:36.986531 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b468b-0a82-48a7-9e6b-8d03ef12a85c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:36.987315 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b468b-0a82-48a7-9e6b-8d03ef12a85c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:36.987788 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b468b-0a82-48a7-9e6b-8d03ef12a85c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:36.989091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b468b-0a82-48a7-9e6b-8d03ef12a85c None admin] RBAC: Adding query filter params (role.id=891bd78dbb334259bdef8495ca3f4132, scope.project.id=ce43efdcbb764869a0f4347b5b29fcca, user.id=f899f20bb3ec422192ead16d0af584af) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:36.990509 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b468b-0a82-48a7-9e6b-8d03ef12a85c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:36.992199 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b468b-0a82-48a7-9e6b-8d03ef12a85c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:37.001223 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 50/90] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:25:36 2022] GET /identity/v3/role_assignments?user.id=f899f20bb3ec422192ead16d0af584af&scope.project.id=ce43efdcbb764869a0f4347b5b29fcca&role.id=891bd78dbb334259bdef8495ca3f4132 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:37.002322 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b468b-0a82-48a7-9e6b-8d03ef12a85c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:37.057452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d522e3-2c2a-4715-b593-a033c2f4d497 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:37.140306 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e652b66-ecd0-48a1-af21-8bc89dfdb67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:37.141385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e652b66-ecd0-48a1-af21-8bc89dfdb67a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:37.141840 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e652b66-ecd0-48a1-af21-8bc89dfdb67a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:37.143860 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e652b66-ecd0-48a1-af21-8bc89dfdb67a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:37.144909 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e652b66-ecd0-48a1-af21-8bc89dfdb67a None admin] RBAC: Adding query filter params (role.id=f63a52fb33144307bba2318551138669, scope.project.id=ce43efdcbb764869a0f4347b5b29fcca, user.id=f899f20bb3ec422192ead16d0af584af) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:37.145473 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e652b66-ecd0-48a1-af21-8bc89dfdb67a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:37.148259 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e652b66-ecd0-48a1-af21-8bc89dfdb67a None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:37.168979 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 41/91] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:25:36 2022] GET /identity/v3/role_assignments?user.id=f899f20bb3ec422192ead16d0af584af&scope.project.id=ce43efdcbb764869a0f4347b5b29fcca&role.id=f63a52fb33144307bba2318551138669 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:37.169791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e652b66-ecd0-48a1-af21-8bc89dfdb67a None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:37.202908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:37.225265 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b468b-0a82-48a7-9e6b-8d03ef12a85c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:37.299469 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd56a7-6409-43ca-b338-5168ad0bd111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:37.300830 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd56a7-6409-43ca-b338-5168ad0bd111 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:37.301285 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd56a7-6409-43ca-b338-5168ad0bd111 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:37.301780 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd56a7-6409-43ca-b338-5168ad0bd111 None admin] PATH_INFO: `/v3/projects/ce43efdcbb764869a0f4347b5b29fcca` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:37.303283 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd56a7-6409-43ca-b338-5168ad0bd111 None admin] RBAC: Authorizing `identity:get_project(project_id=ce43efdcbb764869a0f4347b5b29fcca)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:37.305133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd56a7-6409-43ca-b338-5168ad0bd111 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:37.307169 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 51/92] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:25:37 2022] GET /identity/v3/projects/ce43efdcbb764869a0f4347b5b29fcca => generated 298 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:37.313503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd56a7-6409-43ca-b338-5168ad0bd111 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:37.379059 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e652b66-ecd0-48a1-af21-8bc89dfdb67a None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:37.389067 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:37.444205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee01148-3afa-479d-b446-ca8063f3bb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:37.445119 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee01148-3afa-479d-b446-ca8063f3bb6a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:37.445401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee01148-3afa-479d-b446-ca8063f3bb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:37.445674 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee01148-3afa-479d-b446-ca8063f3bb6a None admin] PATH_INFO: `/v3/users/f899f20bb3ec422192ead16d0af584af` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:37.447651 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee01148-3afa-479d-b446-ca8063f3bb6a None admin] RBAC: Authorizing `identity:get_user(user_id=f899f20bb3ec422192ead16d0af584af)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:37.449122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee01148-3afa-479d-b446-ca8063f3bb6a None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:37.450833 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 42/93] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:37 2022] GET /identity/v3/users/f899f20bb3ec422192ead16d0af584af => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:37.459295 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee01148-3afa-479d-b446-ca8063f3bb6a None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:37.526666 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd56a7-6409-43ca-b338-5168ad0bd111 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:37.565262 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6df493-03e3-4453-bbd7-88b0c9e30427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:37.565888 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6df493-03e3-4453-bbd7-88b0c9e30427 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:37.566168 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6df493-03e3-4453-bbd7-88b0c9e30427 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:37.566438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6df493-03e3-4453-bbd7-88b0c9e30427 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:37.567544 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6df493-03e3-4453-bbd7-88b0c9e30427 None admin] RBAC: Adding query filter params (role.id=6edd584a77084fa78240661ea76cddb5, scope.project.id=ce43efdcbb764869a0f4347b5b29fcca, user.id=27881d4c1bda4cb38dd2046d66b10c4e) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:37.568040 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6df493-03e3-4453-bbd7-88b0c9e30427 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:37.569584 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6df493-03e3-4453-bbd7-88b0c9e30427 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:37.576444 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 52/94] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:25:37 2022] GET /identity/v3/role_assignments?user.id=27881d4c1bda4cb38dd2046d66b10c4e&scope.project.id=ce43efdcbb764869a0f4347b5b29fcca&role.id=6edd584a77084fa78240661ea76cddb5 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:37.613704 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee01148-3afa-479d-b446-ca8063f3bb6a None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:37.651898 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee98d0-dcbf-4cc4-9447-163aa619b8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:37.652567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee98d0-dcbf-4cc4-9447-163aa619b8ca None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:37.652850 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee98d0-dcbf-4cc4-9447-163aa619b8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:37.653126 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee98d0-dcbf-4cc4-9447-163aa619b8ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:37.711070 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:37.728379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee98d0-dcbf-4cc4-9447-163aa619b8ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:37.729945 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee98d0-dcbf-4cc4-9447-163aa619b8ca None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:37.836384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 43/95] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:25:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:37.842159 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6df493-03e3-4453-bbd7-88b0c9e30427 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:37.870014 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:37.958608 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6df493-03e3-4453-bbd7-88b0c9e30427 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:38.002689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ab832-f3bb-43a3-bfe9-49c81b6c99a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:38.003519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ab832-f3bb-43a3-bfe9-49c81b6c99a5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:38.003797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ab832-f3bb-43a3-bfe9-49c81b6c99a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:38.004081 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ab832-f3bb-43a3-bfe9-49c81b6c99a5 None admin] PATH_INFO: `/v3/projects/ef1da5d72c5b4b9abfaefad485f6f01f` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:38.005308 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ab832-f3bb-43a3-bfe9-49c81b6c99a5 None admin] RBAC: Authorizing `identity:get_project(project_id=ef1da5d72c5b4b9abfaefad485f6f01f)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:38.006807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ab832-f3bb-43a3-bfe9-49c81b6c99a5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:38.008698 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 53/96] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:25:37 2022] GET /identity/v3/projects/ef1da5d72c5b4b9abfaefad485f6f01f => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:38.015300 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee98d0-dcbf-4cc4-9447-163aa619b8ca None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:38.114338 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:38.137927 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee98d0-dcbf-4cc4-9447-163aa619b8ca None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:38.174603 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56292602-8f66-46a4-acaa-1bebf2f26b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:38.175674 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56292602-8f66-46a4-acaa-1bebf2f26b99 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:38.176151 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56292602-8f66-46a4-acaa-1bebf2f26b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:38.176615 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56292602-8f66-46a4-acaa-1bebf2f26b99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:38.177643 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56292602-8f66-46a4-acaa-1bebf2f26b99 None admin] RBAC: Adding query filter params (role.id=891bd78dbb334259bdef8495ca3f4132, scope.project.id=ef1da5d72c5b4b9abfaefad485f6f01f, user.id=f899f20bb3ec422192ead16d0af584af) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:38.178164 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56292602-8f66-46a4-acaa-1bebf2f26b99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:38.179843 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56292602-8f66-46a4-acaa-1bebf2f26b99 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:38.186409 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 44/97] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:25:38 2022] GET /identity/v3/role_assignments?user.id=f899f20bb3ec422192ead16d0af584af&scope.project.id=ef1da5d72c5b4b9abfaefad485f6f01f&role.id=891bd78dbb334259bdef8495ca3f4132 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:39.197826 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9831e82-2e01-4679-8258-3c24d32014a9 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:39.198371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9831e82-2e01-4679-8258-3c24d32014a9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:39.198371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9831e82-2e01-4679-8258-3c24d32014a9 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:39.200055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 54/98] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:39.205525 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ffc1e-9929-4364-96d2-82f9a17d43b0 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:39.206366 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ffc1e-9929-4364-96d2-82f9a17d43b0 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:39.206866 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ffc1e-9929-4364-96d2-82f9a17d43b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:39.224593 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-230ffc1e-9929-4364-96d2-82f9a17d43b0 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:39.226443 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-230ffc1e-9929-4364-96d2-82f9a17d43b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:39.295211 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a8037-8949-4925-bcc1-f8b4a7f23c79 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:39.295550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a8037-8949-4925-bcc1-f8b4a7f23c79 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:39.295835 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a8037-8949-4925-bcc1-f8b4a7f23c79 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:39.297559 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 55/99] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:39.304454 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1205cc-214f-4de9-9ab7-3d1c388169d0 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:39.304743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1205cc-214f-4de9-9ab7-3d1c388169d0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:39.305026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1205cc-214f-4de9-9ab7-3d1c388169d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:39.320782 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 45/100] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:25:39.332285 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-5f1205cc-214f-4de9-9ab7-3d1c388169d0 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:39.333785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5f1205cc-214f-4de9-9ab7-3d1c388169d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:39.365483 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ffc1e-9929-4364-96d2-82f9a17d43b0 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:39.452782 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 56/101] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:25:39.480562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1205cc-214f-4de9-9ab7-3d1c388169d0 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:39.513907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:39.514291 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:39.581605 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ffc1e-9929-4364-96d2-82f9a17d43b0 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:39.652861 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e980b8-2f6c-4f73-aaeb-c5f014775caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:39.654594 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e980b8-2f6c-4f73-aaeb-c5f014775caa None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:39.656081 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e980b8-2f6c-4f73-aaeb-c5f014775caa None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:39.657168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e980b8-2f6c-4f73-aaeb-c5f014775caa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:39.659705 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e980b8-2f6c-4f73-aaeb-c5f014775caa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:39.661562 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e980b8-2f6c-4f73-aaeb-c5f014775caa None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:39.665166 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 46/102] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:25:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:39.667235 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1205cc-214f-4de9-9ab7-3d1c388169d0 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:39.669752 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e980b8-2f6c-4f73-aaeb-c5f014775caa None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:39.735603 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5cb60d-824e-4da2-a92b-19822d638178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:39.736807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cb60d-824e-4da2-a92b-19822d638178 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:39.737275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cb60d-824e-4da2-a92b-19822d638178 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:39.737748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cb60d-824e-4da2-a92b-19822d638178 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:39.755867 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5cb60d-824e-4da2-a92b-19822d638178 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:39.763957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-9b5cb60d-824e-4da2-a92b-19822d638178 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:25:39.763957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:39.763957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:39.763957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:39.763957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:39.763957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:39.763957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:39.763957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:39.763957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:39.763957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:39.763957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:39.763957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:39.763957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:39.763957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:39.763957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:39.763957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:39.765103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:39.765103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:39.765103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:39.765103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:39.765103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:39.765103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:39.765103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:39.765103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:39.765103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:39.765103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:39.765103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:39.765103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:39.765103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:39.765103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:39.765103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:39.765103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:39.765852 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:39.765852 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:39.765852 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:39.765852 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:39.765852 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:39.765852 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:39.765852 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:39.765852 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:39.765852 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:39.765852 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:39.765852 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:25:39.765852 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:25:39.768549 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 57/103] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:25:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:25:39.774585 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5cb60d-824e-4da2-a92b-19822d638178 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:39.905305 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e980b8-2f6c-4f73-aaeb-c5f014775caa None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:39.962016 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:40.022454 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779573fe-4b72-4094-9a7b-a4d6957f7b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:40.023084 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779573fe-4b72-4094-9a7b-a4d6957f7b0a None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:40.023367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779573fe-4b72-4094-9a7b-a4d6957f7b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:40.023639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779573fe-4b72-4094-9a7b-a4d6957f7b0a None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:40.024369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779573fe-4b72-4094-9a7b-a4d6957f7b0a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:40.025820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779573fe-4b72-4094-9a7b-a4d6957f7b0a None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:40.052713 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5cb60d-824e-4da2-a92b-19822d638178 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:40.066218 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:40.114678 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 47/104] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 13:25:39 2022] POST /identity/v3/projects => generated 302 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:25:40.173598 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c851ba-fce2-4b02-a741-bdfb799562ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:40.174510 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c851ba-fce2-4b02-a741-bdfb799562ef None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:40.174907 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c851ba-fce2-4b02-a741-bdfb799562ef None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:40.175254 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c851ba-fce2-4b02-a741-bdfb799562ef None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:40.176156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c851ba-fce2-4b02-a741-bdfb799562ef None admin] RBAC: Adding query filter params (name=reader) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:40.176626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c851ba-fce2-4b02-a741-bdfb799562ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:40.178149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c851ba-fce2-4b02-a741-bdfb799562ef None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:40.196690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 58/105] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:25:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:40.203251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779573fe-4b72-4094-9a7b-a4d6957f7b0a None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:40.384959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4196ac-1a20-44c4-87a8-c0a028c67ff1 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:40.385452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4196ac-1a20-44c4-87a8-c0a028c67ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:40.385452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4196ac-1a20-44c4-87a8-c0a028c67ff1 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:40.386304 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779573fe-4b72-4094-9a7b-a4d6957f7b0a None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:40.388844 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 59/106] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:40.394769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb36404-9966-4f07-aaee-a93dbc152cd0 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:40.394769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb36404-9966-4f07-aaee-a93dbc152cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:40.394769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb36404-9966-4f07-aaee-a93dbc152cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:40.457895 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6197a3d-0c08-4a17-a531-35fb79512fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:40.459956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-dcb36404-9966-4f07-aaee-a93dbc152cd0 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:40.462156 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6197a3d-0c08-4a17-a531-35fb79512fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:40.463599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6197a3d-0c08-4a17-a531-35fb79512fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:40.465247 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-dcb36404-9966-4f07-aaee-a93dbc152cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:40.466973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6197a3d-0c08-4a17-a531-35fb79512fd9 None admin] PATH_INFO: `/v3/users/d53cedf959e84c98b4191009b9193c5b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:40.512448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6197a3d-0c08-4a17-a531-35fb79512fd9 None admin] RBAC: Authorizing `identity:get_user(user_id=d53cedf959e84c98b4191009b9193c5b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:40.513950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6197a3d-0c08-4a17-a531-35fb79512fd9 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:40.518624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 48/107] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:40 2022] GET /identity/v3/users/d53cedf959e84c98b4191009b9193c5b => generated 289 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:40.527641 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6197a3d-0c08-4a17-a531-35fb79512fd9 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:40.621405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:40.622684 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 60/108] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:25:40.625373 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc07dd-08c2-4c45-b18d-7ca969040a81 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:40.625665 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc07dd-08c2-4c45-b18d-7ca969040a81 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:40.625940 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc07dd-08c2-4c45-b18d-7ca969040a81 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:40.628101 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 61/109] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:40.633754 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02066e7-876a-47af-8da7-a5e3fddb8f93 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:40.636824 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02066e7-876a-47af-8da7-a5e3fddb8f93 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:40.636824 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02066e7-876a-47af-8da7-a5e3fddb8f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:40.675697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e02066e7-876a-47af-8da7-a5e3fddb8f93 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:40.677461 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e02066e7-876a-47af-8da7-a5e3fddb8f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:40.690781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6197a3d-0c08-4a17-a531-35fb79512fd9 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:40.734389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782be5cc-8ea5-4598-a926-97eb1ff9789f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:40.735501 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782be5cc-8ea5-4598-a926-97eb1ff9789f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:40.736087 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782be5cc-8ea5-4598-a926-97eb1ff9789f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:40.736520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782be5cc-8ea5-4598-a926-97eb1ff9789f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:40.814616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782be5cc-8ea5-4598-a926-97eb1ff9789f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:40.816382 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782be5cc-8ea5-4598-a926-97eb1ff9789f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:40.870462 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:40.876853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 62/110] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:25:40.877841 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02066e7-876a-47af-8da7-a5e3fddb8f93 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:40.899048 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:40.932457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 49/111] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:25:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:40.933647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782be5cc-8ea5-4598-a926-97eb1ff9789f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:41.059906 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782be5cc-8ea5-4598-a926-97eb1ff9789f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:41.098378 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae7e02-0217-4303-a62f-77c304d1a2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:41.099613 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae7e02-0217-4303-a62f-77c304d1a2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:41.100042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae7e02-0217-4303-a62f-77c304d1a2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:41.100482 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae7e02-0217-4303-a62f-77c304d1a2a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:41.112199 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae7e02-0217-4303-a62f-77c304d1a2a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:41.120246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-3aae7e02-0217-4303-a62f-77c304d1a2a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:25:41.120246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:41.120246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:41.120246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:41.120246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:41.120246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:41.120246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:41.120246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:41.120246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:41.120246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:41.120246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:41.120246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:41.120246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:41.120246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:41.120246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:41.120246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:41.121327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:41.121327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:41.121327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:41.121327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:41.121327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:41.121327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:41.121327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:41.121327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:41.121327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:41.121327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:41.121327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:41.121327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:41.121327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:41.121327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:41.121327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:41.121327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:41.122318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:41.122318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:41.122318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:41.122318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:41.122318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:41.122318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:41.122318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:41.122318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:41.122318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:41.122318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:41.122318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:25:41.122318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:25:41.125147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 50/112] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:25:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:41.126175 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae7e02-0217-4303-a62f-77c304d1a2a3 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:41.138045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:41.166972 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02066e7-876a-47af-8da7-a5e3fddb8f93 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:41.239914 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae7e02-0217-4303-a62f-77c304d1a2a3 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:41.251970 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ef3a2-0a11-4cae-846b-86314c6d2d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:41.253090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ef3a2-0a11-4cae-846b-86314c6d2d6b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:41.253090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ef3a2-0a11-4cae-846b-86314c6d2d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:41.253369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ef3a2-0a11-4cae-846b-86314c6d2d6b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:41.275811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ef3a2-0a11-4cae-846b-86314c6d2d6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:41.279505 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5dd4b0-efa8-4c25-a237-bf9e29ebc7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:41.280810 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dd4b0-efa8-4c25-a237-bf9e29ebc7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:41.281246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dd4b0-efa8-4c25-a237-bf9e29ebc7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:41.281701 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dd4b0-efa8-4c25-a237-bf9e29ebc7b6 None admin] PATH_INFO: `/v3/projects/ce43efdcbb764869a0f4347b5b29fcca` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:41.283105 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5dd4b0-efa8-4c25-a237-bf9e29ebc7b6 None admin] RBAC: Authorizing `identity:get_project(project_id=ce43efdcbb764869a0f4347b5b29fcca)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:41.284736 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5dd4b0-efa8-4c25-a237-bf9e29ebc7b6 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:41.286953 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 51/113] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:25:41 2022] GET /identity/v3/projects/ce43efdcbb764869a0f4347b5b29fcca => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:41.287953 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5dd4b0-efa8-4c25-a237-bf9e29ebc7b6 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:41.292833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-330ef3a2-0a11-4cae-846b-86314c6d2d6b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:25:41.292833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:41.292833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:41.292833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:41.292833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:41.292833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:41.292833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:41.292833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:41.292833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:41.292833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:41.292833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:41.292833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:41.292833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:41.292833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:41.292833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:41.292833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:41.293889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:41.293889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:41.293889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:41.293889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:41.293889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:41.293889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:41.293889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:41.293889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:41.293889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:41.293889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:41.293889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:41.293889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:41.293889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:41.293889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:41.293889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:41.293889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:41.294941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:41.294941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:41.294941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:41.294941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:41.294941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:41.294941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:41.294941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:41.294941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:41.294941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:41.294941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:41.294941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:25:41.294941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:25:41.294941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 63/114] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 13:25:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:41.303846 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ef3a2-0a11-4cae-846b-86314c6d2d6b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:41.389478 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:41.406926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:41.419553 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5dd4b0-efa8-4c25-a237-bf9e29ebc7b6 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:41.459393 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd30b7-c8f7-4d63-9af2-634175fa6de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:41.460078 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd30b7-c8f7-4d63-9af2-634175fa6de4 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:41.460357 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd30b7-c8f7-4d63-9af2-634175fa6de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:41.460629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd30b7-c8f7-4d63-9af2-634175fa6de4 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:41.460847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ef3a2-0a11-4cae-846b-86314c6d2d6b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:41.461383 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd30b7-c8f7-4d63-9af2-634175fa6de4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:41.461687 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd30b7-c8f7-4d63-9af2-634175fa6de4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:41.463328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd30b7-c8f7-4d63-9af2-634175fa6de4 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:41.475109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 52/115] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:25:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:41.480900 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd30b7-c8f7-4d63-9af2-634175fa6de4 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:41.496814 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b761f7-9628-4174-9460-ecf973982697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:41.497504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b761f7-9628-4174-9460-ecf973982697 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:41.497786 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b761f7-9628-4174-9460-ecf973982697 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:41.498057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b761f7-9628-4174-9460-ecf973982697 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:41.498925 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b761f7-9628-4174-9460-ecf973982697 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:41.499222 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b761f7-9628-4174-9460-ecf973982697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:41.500621 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b761f7-9628-4174-9460-ecf973982697 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:41.509084 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 64/116] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:25:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:25:41.510185 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c60d6-29ca-41f8-860a-c37a0d581a89 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:41.510471 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c60d6-29ca-41f8-860a-c37a0d581a89 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:41.510830 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c60d6-29ca-41f8-860a-c37a0d581a89 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:41.512433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 65/117] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:41.513130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c60d6-29ca-41f8-860a-c37a0d581a89 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:41.591693 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd30b7-c8f7-4d63-9af2-634175fa6de4 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:41.629658 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c60d6-29ca-41f8-860a-c37a0d581a89 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:41.634327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81f243-1f41-4269-aeb2-e3af44477852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:41.635311 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81f243-1f41-4269-aeb2-e3af44477852 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:41.635788 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81f243-1f41-4269-aeb2-e3af44477852 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:41.636252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81f243-1f41-4269-aeb2-e3af44477852 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:41.637401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81f243-1f41-4269-aeb2-e3af44477852 None admin] RBAC: Adding query filter params (role.id=e3afb7f30d8240539b9d7139c5ade987, scope.project.id=ce43efdcbb764869a0f4347b5b29fcca, user.id=d53cedf959e84c98b4191009b9193c5b) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:41.637917 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81f243-1f41-4269-aeb2-e3af44477852 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:41.639805 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81f243-1f41-4269-aeb2-e3af44477852 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:41.646538 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 53/118] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:25:41 2022] GET /identity/v3/role_assignments?user.id=d53cedf959e84c98b4191009b9193c5b&scope.project.id=ce43efdcbb764869a0f4347b5b29fcca&role.id=e3afb7f30d8240539b9d7139c5ade987 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:41.647584 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81f243-1f41-4269-aeb2-e3af44477852 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:41.658556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:41.665319 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:41.693132 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb3429-2702-4aff-8f47-e6dd4258801f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:41.694009 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb3429-2702-4aff-8f47-e6dd4258801f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:41.694286 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb3429-2702-4aff-8f47-e6dd4258801f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:41.694629 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb3429-2702-4aff-8f47-e6dd4258801f None admin] PATH_INFO: `/v3/users/f899f20bb3ec422192ead16d0af584af` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:41.699530 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb3429-2702-4aff-8f47-e6dd4258801f None admin] RBAC: Authorizing `identity:get_user(user_id=f899f20bb3ec422192ead16d0af584af)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:41.701508 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb3429-2702-4aff-8f47-e6dd4258801f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:41.703317 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 66/119] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:41 2022] GET /identity/v3/users/f899f20bb3ec422192ead16d0af584af => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:41.708610 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4e21b-92a5-4cea-ace6-4b9016ca9805 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:41.708610 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4e21b-92a5-4cea-ace6-4b9016ca9805 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:41.708610 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4e21b-92a5-4cea-ace6-4b9016ca9805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:41.751773 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-99e4e21b-92a5-4cea-ace6-4b9016ca9805 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:41.753024 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-99e4e21b-92a5-4cea-ace6-4b9016ca9805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:41.778286 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81f243-1f41-4269-aeb2-e3af44477852 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:41.818787 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a885d2-8331-49cc-bb08-b2491b52def5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:41.820197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a885d2-8331-49cc-bb08-b2491b52def5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:41.820714 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a885d2-8331-49cc-bb08-b2491b52def5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:41.821179 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a885d2-8331-49cc-bb08-b2491b52def5 None admin] PATH_INFO: `/v3/users/f899f20bb3ec422192ead16d0af584af` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:41.822770 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a885d2-8331-49cc-bb08-b2491b52def5 None admin] RBAC: Authorizing `identity:get_user(user_id=f899f20bb3ec422192ead16d0af584af)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:41.824475 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a885d2-8331-49cc-bb08-b2491b52def5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:41.826416 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 54/120] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:41 2022] GET /identity/v3/users/f899f20bb3ec422192ead16d0af584af => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:41.827489 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a885d2-8331-49cc-bb08-b2491b52def5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:41.905591 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:41.935657 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 67/121] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:25:41.936843 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4e21b-92a5-4cea-ace6-4b9016ca9805 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:41.941650 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a885d2-8331-49cc-bb08-b2491b52def5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:41.980762 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a5f36-b314-4850-bccf-c936f1de46c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:41.982002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a5f36-b314-4850-bccf-c936f1de46c2 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:41.982474 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a5f36-b314-4850-bccf-c936f1de46c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:41.983009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a5f36-b314-4850-bccf-c936f1de46c2 None admin] PATH_INFO: `/v3/projects/ce43efdcbb764869a0f4347b5b29fcca` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:41.984617 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a5f36-b314-4850-bccf-c936f1de46c2 None admin] RBAC: Authorizing `identity:get_project(project_id=ce43efdcbb764869a0f4347b5b29fcca)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:41.986370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a5f36-b314-4850-bccf-c936f1de46c2 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:41.988512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 55/122] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:25:41 2022] GET /identity/v3/projects/ce43efdcbb764869a0f4347b5b29fcca => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:41.994487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564be615-5216-4049-953d-1ab905bfbf0e None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:41.995079 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564be615-5216-4049-953d-1ab905bfbf0e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:41.995581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564be615-5216-4049-953d-1ab905bfbf0e None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:41.997113 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 56/123] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:41.998070 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564be615-5216-4049-953d-1ab905bfbf0e None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:42.062598 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4e21b-92a5-4cea-ace6-4b9016ca9805 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:42.093142 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:42.108340 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36616fdc-6d1c-4925-b4eb-4ec235a5f2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:42.109053 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564be615-5216-4049-953d-1ab905bfbf0e None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:42.109416 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36616fdc-6d1c-4925-b4eb-4ec235a5f2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:42.109698 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36616fdc-6d1c-4925-b4eb-4ec235a5f2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:42.109986 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36616fdc-6d1c-4925-b4eb-4ec235a5f2f2 None admin] PATH_INFO: `/v3/projects/ce43efdcbb764869a0f4347b5b29fcca` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:42.111241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36616fdc-6d1c-4925-b4eb-4ec235a5f2f2 None admin] RBAC: Authorizing `identity:get_project(project_id=ce43efdcbb764869a0f4347b5b29fcca)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:42.113765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36616fdc-6d1c-4925-b4eb-4ec235a5f2f2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:42.115526 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 68/124] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:25:41 2022] GET /identity/v3/projects/ce43efdcbb764869a0f4347b5b29fcca => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:42.116280 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36616fdc-6d1c-4925-b4eb-4ec235a5f2f2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:42.150045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47006f-b057-474e-aa78-8bb619159603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:42.151323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47006f-b057-474e-aa78-8bb619159603 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:42.151843 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47006f-b057-474e-aa78-8bb619159603 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:42.152379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47006f-b057-474e-aa78-8bb619159603 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:42.164683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47006f-b057-474e-aa78-8bb619159603 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:42.173132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-4e47006f-b057-474e-aa78-8bb619159603 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:25:42.173132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:42.173132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:42.173132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:42.173132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:42.173132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:42.173132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:42.173132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:42.173132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:42.173132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:42.173132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:42.173132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:42.173132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:42.173132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:42.173132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:42.173132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:42.173963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:42.173963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:42.173963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:42.173963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:42.173963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:42.173963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:42.173963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:42.173963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:42.173963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:42.173963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:42.173963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:42.173963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:42.173963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:42.173963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:42.173963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:42.173963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:42.174768 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:42.174768 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:42.174768 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:42.174768 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:42.174768 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:42.174768 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:42.174768 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:42.174768 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:42.174768 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:42.174768 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:42.174768 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:25:42.174768 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:25:42.177715 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 57/125] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:25:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:42.182883 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:42.184227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0208f-646e-47ee-a2b6-2eb685a152fc None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:42.184734 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0208f-646e-47ee-a2b6-2eb685a152fc None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:42.185654 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0208f-646e-47ee-a2b6-2eb685a152fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:42.209350 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-58a0208f-646e-47ee-a2b6-2eb685a152fc None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:42.211588 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-58a0208f-646e-47ee-a2b6-2eb685a152fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:42.235976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36616fdc-6d1c-4925-b4eb-4ec235a5f2f2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:42.278287 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbf555-feed-4760-8715-dd9bcb3e7d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:42.279660 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbf555-feed-4760-8715-dd9bcb3e7d7c None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:42.279974 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbf555-feed-4760-8715-dd9bcb3e7d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:42.280253 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbf555-feed-4760-8715-dd9bcb3e7d7c None admin] PATH_INFO: `/v3/projects/ce43efdcbb764869a0f4347b5b29fcca/users/f899f20bb3ec422192ead16d0af584af/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:42.282771 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbf555-feed-4760-8715-dd9bcb3e7d7c None admin] RBAC: Authorizing `identity:create_grant(project_id=ce43efdcbb764869a0f4347b5b29fcca, user_id=f899f20bb3ec422192ead16d0af584af, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:42.284552 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbf555-feed-4760-8715-dd9bcb3e7d7c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:42.299817 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 58/126] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:25:42.301083 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0208f-646e-47ee-a2b6-2eb685a152fc None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:42.306657 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 69/127] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 13:25:42 2022] PUT /identity/v3/projects/ce43efdcbb764869a0f4347b5b29fcca/users/f899f20bb3ec422192ead16d0af584af/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:25:42.308900 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbf555-feed-4760-8715-dd9bcb3e7d7c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:42.427411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:42.506343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbf555-feed-4760-8715-dd9bcb3e7d7c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:42.550817 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac174d-fc19-4560-9831-49347014409d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:42.551970 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac174d-fc19-4560-9831-49347014409d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:42.552314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac174d-fc19-4560-9831-49347014409d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:42.552603 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac174d-fc19-4560-9831-49347014409d None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:42.553377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac174d-fc19-4560-9831-49347014409d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:42.553682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac174d-fc19-4560-9831-49347014409d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:42.555263 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac174d-fc19-4560-9831-49347014409d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:42.566133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 70/128] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:25:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:42.566856 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac174d-fc19-4560-9831-49347014409d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:42.591780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0208f-646e-47ee-a2b6-2eb685a152fc None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:42.636180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:42.645581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ccf2a-1c8c-4734-9d52-294e65aa0d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:42.646539 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ccf2a-1c8c-4734-9d52-294e65aa0d13 None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:42.646854 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ccf2a-1c8c-4734-9d52-294e65aa0d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:42.647127 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ccf2a-1c8c-4734-9d52-294e65aa0d13 None admin] PATH_INFO: `/v3/projects/ce43efdcbb764869a0f4347b5b29fcca/users/f899f20bb3ec422192ead16d0af584af/roles/f63a52fb33144307bba2318551138669` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:42.649440 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ccf2a-1c8c-4734-9d52-294e65aa0d13 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce43efdcbb764869a0f4347b5b29fcca, user_id=f899f20bb3ec422192ead16d0af584af, role_id=f63a52fb33144307bba2318551138669)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:42.651799 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ccf2a-1c8c-4734-9d52-294e65aa0d13 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:42.676843 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 59/129] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 13:25:42 2022] PUT /identity/v3/projects/ce43efdcbb764869a0f4347b5b29fcca/users/f899f20bb3ec422192ead16d0af584af/roles/f63a52fb33144307bba2318551138669 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:25:42.677760 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ccf2a-1c8c-4734-9d52-294e65aa0d13 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:42.689851 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac174d-fc19-4560-9831-49347014409d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:42.703733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:42.726539 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f8aaa-c92f-4ad6-aeb2-c7fa5423161f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:42.727516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f8aaa-c92f-4ad6-aeb2-c7fa5423161f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:42.727912 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f8aaa-c92f-4ad6-aeb2-c7fa5423161f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:42.728259 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f8aaa-c92f-4ad6-aeb2-c7fa5423161f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:42.740872 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f8aaa-c92f-4ad6-aeb2-c7fa5423161f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:42.749384 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-bd1f8aaa-c92f-4ad6-aeb2-c7fa5423161f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:25:42.749384 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:42.749384 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:42.749384 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:42.749384 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:42.749384 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:42.749384 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:42.749384 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:42.749384 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:42.749384 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:42.749384 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:42.749384 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:42.749384 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:42.749384 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:42.749384 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:42.749384 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:42.750323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:42.750323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:42.750323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:42.750323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:42.750323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:42.750323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:42.750323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:42.750323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:42.750323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:42.750323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:42.750323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:42.750323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:42.750323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:42.750323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:42.750323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:42.750323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:42.751162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:42.751162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:42.751162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:42.751162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:42.751162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:42.751162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:42.751162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:42.751162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:42.751162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:42.751162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:42.751162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:25:42.751162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:25:42.751162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 71/130] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:25:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:42.760165 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f8aaa-c92f-4ad6-aeb2-c7fa5423161f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:42.917977 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ccf2a-1c8c-4734-9d52-294e65aa0d13 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:42.926411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f8aaa-c92f-4ad6-aeb2-c7fa5423161f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:42.997186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3095d12-4a09-4480-b1d0-142cc5aa9320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:42.997895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3095d12-4a09-4480-b1d0-142cc5aa9320 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:42.998174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3095d12-4a09-4480-b1d0-142cc5aa9320 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:42.998450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3095d12-4a09-4480-b1d0-142cc5aa9320 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:42.999420 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3095d12-4a09-4480-b1d0-142cc5aa9320 None admin] RBAC: Adding query filter params (name=member) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:42.999727 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3095d12-4a09-4480-b1d0-142cc5aa9320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:43.001156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3095d12-4a09-4480-b1d0-142cc5aa9320 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:43.011467 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3ba86-44d8-4150-99bd-3871f20bda9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:43.012303 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3ba86-44d8-4150-99bd-3871f20bda9c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:43.012578 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3ba86-44d8-4150-99bd-3871f20bda9c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:43.012849 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3ba86-44d8-4150-99bd-3871f20bda9c None admin] PATH_INFO: `/v3/users/27881d4c1bda4cb38dd2046d66b10c4e` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:43.014124 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3ba86-44d8-4150-99bd-3871f20bda9c None admin] RBAC: Authorizing `identity:get_user(user_id=27881d4c1bda4cb38dd2046d66b10c4e)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:43.014844 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 72/131] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:25:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:43.015792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3ba86-44d8-4150-99bd-3871f20bda9c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:43.017446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 60/132] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:42 2022] GET /identity/v3/users/27881d4c1bda4cb38dd2046d66b10c4e => generated 247 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:43.021114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3095d12-4a09-4480-b1d0-142cc5aa9320 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:43.023668 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3ba86-44d8-4150-99bd-3871f20bda9c None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:43.064344 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:43.132540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:43.192871 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3ba86-44d8-4150-99bd-3871f20bda9c None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:43.200493 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3095d12-4a09-4480-b1d0-142cc5aa9320 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:43.230985 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2bd309-fd1d-4797-b0a2-895622a1dc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:43.232264 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bd309-fd1d-4797-b0a2-895622a1dc6f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:43.232737 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bd309-fd1d-4797-b0a2-895622a1dc6f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:43.233341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bd309-fd1d-4797-b0a2-895622a1dc6f None admin] PATH_INFO: `/v3/projects/ce43efdcbb764869a0f4347b5b29fcca` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:43.235039 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2bd309-fd1d-4797-b0a2-895622a1dc6f None admin] RBAC: Authorizing `identity:get_project(project_id=ce43efdcbb764869a0f4347b5b29fcca)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:43.236708 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2bd309-fd1d-4797-b0a2-895622a1dc6f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:43.242954 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 61/133] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:25:43 2022] GET /identity/v3/projects/ce43efdcbb764869a0f4347b5b29fcca => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:25:43.245013 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7328b-c902-4a78-82ad-e72360a22468 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:43.245505 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7328b-c902-4a78-82ad-e72360a22468 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:43.245968 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7328b-c902-4a78-82ad-e72360a22468 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:43.247466 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 62/134] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:43.249449 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7328b-c902-4a78-82ad-e72360a22468 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:43.299422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc9144-c788-4cf2-a46f-c826ad13273d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:43.300254 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc9144-c788-4cf2-a46f-c826ad13273d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:43.300537 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc9144-c788-4cf2-a46f-c826ad13273d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:43.300811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc9144-c788-4cf2-a46f-c826ad13273d None admin] PATH_INFO: `/v3/users/f899f20bb3ec422192ead16d0af584af` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:43.302113 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc9144-c788-4cf2-a46f-c826ad13273d None admin] RBAC: Authorizing `identity:get_user(user_id=f899f20bb3ec422192ead16d0af584af)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:43.303608 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc9144-c788-4cf2-a46f-c826ad13273d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:43.305262 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 73/135] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:43 2022] GET /identity/v3/users/f899f20bb3ec422192ead16d0af584af => generated 275 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:43.307879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e198aef-8529-4895-b590-33516281da60 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:43.308169 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e198aef-8529-4895-b590-33516281da60 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:43.308449 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e198aef-8529-4895-b590-33516281da60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:43.347625 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8e198aef-8529-4895-b590-33516281da60 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:43.348846 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8e198aef-8529-4895-b590-33516281da60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:43.403036 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7328b-c902-4a78-82ad-e72360a22468 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:43.449831 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:43.450834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 74/136] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:25:43.453333 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e198aef-8529-4895-b590-33516281da60 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:43.474735 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee536c5-1d77-49f4-92b2-b8bebe1ca859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:43.475658 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee536c5-1d77-49f4-92b2-b8bebe1ca859 None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:43.475943 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee536c5-1d77-49f4-92b2-b8bebe1ca859 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:43.476221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee536c5-1d77-49f4-92b2-b8bebe1ca859 None admin] PATH_INFO: `/v3/projects/ce43efdcbb764869a0f4347b5b29fcca/users/27881d4c1bda4cb38dd2046d66b10c4e/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:43.479698 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee536c5-1d77-49f4-92b2-b8bebe1ca859 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce43efdcbb764869a0f4347b5b29fcca, user_id=27881d4c1bda4cb38dd2046d66b10c4e, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:43.482083 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee536c5-1d77-49f4-92b2-b8bebe1ca859 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:43.500905 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 63/137] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 13:25:43 2022] PUT /identity/v3/projects/ce43efdcbb764869a0f4347b5b29fcca/users/27881d4c1bda4cb38dd2046d66b10c4e/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:25:43.502106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee536c5-1d77-49f4-92b2-b8bebe1ca859 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:43.530837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:43.689779 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e198aef-8529-4895-b590-33516281da60 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:43.760410 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee536c5-1d77-49f4-92b2-b8bebe1ca859 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:43.781415 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ba3fc-a37a-45d5-9fe5-1f88ca7ec393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:43.782590 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ba3fc-a37a-45d5-9fe5-1f88ca7ec393 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:43.782875 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ba3fc-a37a-45d5-9fe5-1f88ca7ec393 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:43.783158 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ba3fc-a37a-45d5-9fe5-1f88ca7ec393 None admin] PATH_INFO: `/v3/projects/ef1da5d72c5b4b9abfaefad485f6f01f` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:43.790029 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ba3fc-a37a-45d5-9fe5-1f88ca7ec393 None admin] RBAC: Authorizing `identity:get_project(project_id=ef1da5d72c5b4b9abfaefad485f6f01f)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:43.791754 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ba3fc-a37a-45d5-9fe5-1f88ca7ec393 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:43.795578 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 75/138] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:25:43 2022] GET /identity/v3/projects/ef1da5d72c5b4b9abfaefad485f6f01f => generated 312 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:43.800910 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ba3fc-a37a-45d5-9fe5-1f88ca7ec393 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:43.822865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583dd8b2-3b57-4459-b2f8-06a6b4150371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:43.825473 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dd8b2-3b57-4459-b2f8-06a6b4150371 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:43.827981 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dd8b2-3b57-4459-b2f8-06a6b4150371 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:43.828547 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dd8b2-3b57-4459-b2f8-06a6b4150371 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:43.833360 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583dd8b2-3b57-4459-b2f8-06a6b4150371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:43.835263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583dd8b2-3b57-4459-b2f8-06a6b4150371 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:43.842754 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 64/139] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:25:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:43.848107 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583dd8b2-3b57-4459-b2f8-06a6b4150371 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:43.941337 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:44.008618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583dd8b2-3b57-4459-b2f8-06a6b4150371 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:44.045335 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:44.050730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298d426-4f3e-4a7b-98ca-fe3a755e47d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:44.051552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298d426-4f3e-4a7b-98ca-fe3a755e47d5 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:44.051844 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298d426-4f3e-4a7b-98ca-fe3a755e47d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:44.052125 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298d426-4f3e-4a7b-98ca-fe3a755e47d5 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:44.052723 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ba3fc-a37a-45d5-9fe5-1f88ca7ec393 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:44.052832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298d426-4f3e-4a7b-98ca-fe3a755e47d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:44.054463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298d426-4f3e-4a7b-98ca-fe3a755e47d5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:44.086840 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 65/140] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 13:25:43 2022] POST /identity/v3/users => generated 283 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:25:44.132616 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8312205-2491-488e-8a34-b471ac48b6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:44.133582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8312205-2491-488e-8a34-b471ac48b6a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:44.133866 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8312205-2491-488e-8a34-b471ac48b6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:44.134144 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8312205-2491-488e-8a34-b471ac48b6a1 None admin] PATH_INFO: `/v3/projects/ef1da5d72c5b4b9abfaefad485f6f01f/users/f899f20bb3ec422192ead16d0af584af/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:44.140415 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8312205-2491-488e-8a34-b471ac48b6a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef1da5d72c5b4b9abfaefad485f6f01f, user_id=f899f20bb3ec422192ead16d0af584af, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:44.142002 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8312205-2491-488e-8a34-b471ac48b6a1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:44.168872 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 76/141] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 13:25:43 2022] PUT /identity/v3/projects/ef1da5d72c5b4b9abfaefad485f6f01f/users/f899f20bb3ec422192ead16d0af584af/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:25:44.579677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e79edc-4508-46ae-ba8e-915738168502 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:44.580054 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e79edc-4508-46ae-ba8e-915738168502 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:44.580258 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e79edc-4508-46ae-ba8e-915738168502 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:44.581787 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 66/142] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:44.597380 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e062c1-af4c-4f26-802d-e65ff496261e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:44.597940 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e062c1-af4c-4f26-802d-e65ff496261e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:44.597940 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e062c1-af4c-4f26-802d-e65ff496261e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:44.619743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c9e062c1-af4c-4f26-802d-e65ff496261e None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:44.620929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c9e062c1-af4c-4f26-802d-e65ff496261e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:44.697439 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 77/143] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:25:44.722760 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e79edc-4508-46ae-ba8e-915738168502 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:44.863294 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e79edc-4508-46ae-ba8e-915738168502 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:44.873649 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:44.911362 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678875b-b923-41df-9291-eb896562d796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:44.912213 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678875b-b923-41df-9291-eb896562d796 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:44.912501 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678875b-b923-41df-9291-eb896562d796 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:44.912781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678875b-b923-41df-9291-eb896562d796 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:44.924273 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678875b-b923-41df-9291-eb896562d796 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:44.932240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-9678875b-b923-41df-9291-eb896562d796 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:25:44.932240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:44.932240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:44.932240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:44.932240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:44.932240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:44.932240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:44.932240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:44.932240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:44.932240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:44.932240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:44.932240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:44.932240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:44.932240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:44.932240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:44.932240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:44.933163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:44.933163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:44.933163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:44.933163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:44.933163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:44.933163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:44.933163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:44.933163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:44.933163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:44.933163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:44.933163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:44.933163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:44.933163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:44.933163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:44.933163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:44.933163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:44.933915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:44.933915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:44.933915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:44.933915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:44.933915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:44.933915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:44.933915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:44.933915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:44.933915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:44.933915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:44.933915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:25:44.933915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:25:44.933915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 67/144] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:25:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:44.939619 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e062c1-af4c-4f26-802d-e65ff496261e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:45.081461 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:45.098896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e062c1-af4c-4f26-802d-e65ff496261e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:45.141350 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0350d-5edc-4e5f-8db6-fe3d0b7fe8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:45.142382 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0350d-5edc-4e5f-8db6-fe3d0b7fe8ed None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:45.142881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0350d-5edc-4e5f-8db6-fe3d0b7fe8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:45.143351 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0350d-5edc-4e5f-8db6-fe3d0b7fe8ed None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:45.144419 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0350d-5edc-4e5f-8db6-fe3d0b7fe8ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:45.145644 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0350d-5edc-4e5f-8db6-fe3d0b7fe8ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:45.147943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0350d-5edc-4e5f-8db6-fe3d0b7fe8ed None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:45.163540 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 78/145] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:25:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:45.170364 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678875b-b923-41df-9291-eb896562d796 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:45.346319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678875b-b923-41df-9291-eb896562d796 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:45.397959 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c7804-4970-4775-bb96-c9ca7b6ac7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:45.397959 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c7804-4970-4775-bb96-c9ca7b6ac7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:45.398384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c7804-4970-4775-bb96-c9ca7b6ac7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:45.398384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c7804-4970-4775-bb96-c9ca7b6ac7c0 None admin] PATH_INFO: `/v3/users/d53cedf959e84c98b4191009b9193c5b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:45.399649 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c7804-4970-4775-bb96-c9ca7b6ac7c0 None admin] RBAC: Authorizing `identity:get_user(user_id=d53cedf959e84c98b4191009b9193c5b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:45.401122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c7804-4970-4775-bb96-c9ca7b6ac7c0 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:45.403135 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 68/146] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:45 2022] GET /identity/v3/users/d53cedf959e84c98b4191009b9193c5b => generated 289 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:45.409397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0350d-5edc-4e5f-8db6-fe3d0b7fe8ed None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:45.566802 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0350d-5edc-4e5f-8db6-fe3d0b7fe8ed None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:45.607525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330032b-7a9b-454e-91bb-3889d93061a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:45.609191 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330032b-7a9b-454e-91bb-3889d93061a2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:45.609604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330032b-7a9b-454e-91bb-3889d93061a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:45.610051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330032b-7a9b-454e-91bb-3889d93061a2 None admin] PATH_INFO: `/v3/projects/ce43efdcbb764869a0f4347b5b29fcca` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:45.615315 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3330032b-7a9b-454e-91bb-3889d93061a2 None admin] RBAC: Authorizing `identity:get_project(project_id=ce43efdcbb764869a0f4347b5b29fcca)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:45.616955 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3330032b-7a9b-454e-91bb-3889d93061a2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:45.619609 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 79/147] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:25:45 2022] GET /identity/v3/projects/ce43efdcbb764869a0f4347b5b29fcca => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:45.637744 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c7804-4970-4775-bb96-c9ca7b6ac7c0 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:45.688466 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:45.780252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c7804-4970-4775-bb96-c9ca7b6ac7c0 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:45.827512 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a967e78-3f23-4cd9-90dd-76a69187be09 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:45.828292 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a967e78-3f23-4cd9-90dd-76a69187be09 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:45.828762 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a967e78-3f23-4cd9-90dd-76a69187be09 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:45.830455 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 80/148] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:25:45.830564 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dbbe2-9a4f-4865-8a2a-fd911578ba2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:45.834893 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dbbe2-9a4f-4865-8a2a-fd911578ba2d None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:45.834893 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dbbe2-9a4f-4865-8a2a-fd911578ba2d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:45.834893 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dbbe2-9a4f-4865-8a2a-fd911578ba2d None admin] PATH_INFO: `/v3/projects/ce43efdcbb764869a0f4347b5b29fcca/users/d53cedf959e84c98b4191009b9193c5b/roles/e3afb7f30d8240539b9d7139c5ade987` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:45.835082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0dbbe2-9a4f-4865-8a2a-fd911578ba2d None admin] RBAC: Authorizing `identity:create_grant(project_id=ce43efdcbb764869a0f4347b5b29fcca, user_id=d53cedf959e84c98b4191009b9193c5b, role_id=e3afb7f30d8240539b9d7139c5ade987)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:45.836544 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0dbbe2-9a4f-4865-8a2a-fd911578ba2d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:45.836946 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c26c0-a308-482e-aa2a-571384bd6fc4 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:45.837412 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c26c0-a308-482e-aa2a-571384bd6fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:45.837926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c26c0-a308-482e-aa2a-571384bd6fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:45.865312 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-512c26c0-a308-482e-aa2a-571384bd6fc4 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:45.867037 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-512c26c0-a308-482e-aa2a-571384bd6fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:45.874671 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 69/149] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 13:25:45 2022] PUT /identity/v3/projects/ce43efdcbb764869a0f4347b5b29fcca/users/d53cedf959e84c98b4191009b9193c5b/roles/e3afb7f30d8240539b9d7139c5ade987 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:25:45.893390 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:45.959209 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 81/150] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:25:46.015422 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dbbe2-9a4f-4865-8a2a-fd911578ba2d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:46.068793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4d43b-0f6c-48fa-a8eb-01785dd507c1 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:46.069461 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4d43b-0f6c-48fa-a8eb-01785dd507c1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:46.070036 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4d43b-0f6c-48fa-a8eb-01785dd507c1 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:46.072019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 82/151] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:46.082690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d6720-9c8d-4be4-81a3-ed68c4717b31 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:46.083419 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d6720-9c8d-4be4-81a3-ed68c4717b31 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:46.083926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d6720-9c8d-4be4-81a3-ed68c4717b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:46.127839 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b27d6720-9c8d-4be4-81a3-ed68c4717b31 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:46.129066 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b27d6720-9c8d-4be4-81a3-ed68c4717b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:46.174957 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:46.185667 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dbbe2-9a4f-4865-8a2a-fd911578ba2d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:46.256353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41bbb1-10e7-4f95-beaa-a32de0a7976a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:46.257216 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41bbb1-10e7-4f95-beaa-a32de0a7976a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:46.257495 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41bbb1-10e7-4f95-beaa-a32de0a7976a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:46.257767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41bbb1-10e7-4f95-beaa-a32de0a7976a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:46.284803 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41bbb1-10e7-4f95-beaa-a32de0a7976a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:46.292792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-ee41bbb1-10e7-4f95-beaa-a32de0a7976a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:25:46.292792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:46.292792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:46.292792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:46.292792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:46.292792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:46.292792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:46.292792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:46.292792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:46.292792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:46.292792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:46.292792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:46.292792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:46.292792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:46.292792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:46.292792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:46.293683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:46.293683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:46.293683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:46.293683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:46.293683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:46.293683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:46.293683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:46.293683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:46.293683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:46.293683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:46.293683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:46.293683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:46.293683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:46.293683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:46.293683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:46.293683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:46.294427 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:46.294427 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:46.294427 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:46.294427 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:46.294427 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:46.294427 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:46.294427 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:46.294427 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:46.294427 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:46.294427 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:46.294427 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:25:46.294427 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:25:46.294427 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 70/152] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:25:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:46.303638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41bbb1-10e7-4f95-beaa-a32de0a7976a None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:46.345418 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 83/153] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:25:46.417018 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d6720-9c8d-4be4-81a3-ed68c4717b31 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:46.477878 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41bbb1-10e7-4f95-beaa-a32de0a7976a None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:46.569892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:46.571344 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b914a44-4194-4f2e-9f75-6aba50fcb5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:46.572056 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b914a44-4194-4f2e-9f75-6aba50fcb5eb None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:46.572338 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b914a44-4194-4f2e-9f75-6aba50fcb5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:46.572611 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b914a44-4194-4f2e-9f75-6aba50fcb5eb None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:46.574901 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b914a44-4194-4f2e-9f75-6aba50fcb5eb None admin] RBAC: Adding query filter params (name=member) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:46.574901 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b914a44-4194-4f2e-9f75-6aba50fcb5eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:46.575121 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b914a44-4194-4f2e-9f75-6aba50fcb5eb None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:46.589897 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 71/154] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:25:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:46.601226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b914a44-4194-4f2e-9f75-6aba50fcb5eb None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:46.612586 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d6720-9c8d-4be4-81a3-ed68c4717b31 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:46.651776 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:46.696602 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d2df2-33ec-4c6c-b308-0426b56964aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:46.697804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d2df2-33ec-4c6c-b308-0426b56964aa None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:46.698298 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d2df2-33ec-4c6c-b308-0426b56964aa None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:46.698802 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d2df2-33ec-4c6c-b308-0426b56964aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:46.726091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d2df2-33ec-4c6c-b308-0426b56964aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:46.739065 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-530d2df2-33ec-4c6c-b308-0426b56964aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:25:46.739065 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:46.739065 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:46.739065 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:46.739065 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:46.739065 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:46.739065 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:46.739065 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:46.739065 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:46.739065 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:46.739065 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:46.739065 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:46.739065 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:46.739065 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:46.739065 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:46.739065 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:46.739967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:46.739967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:46.739967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:46.739967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:46.739967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:46.739967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:46.739967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:46.739967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:46.739967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:46.739967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:46.739967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:46.739967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:46.739967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:46.739967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:46.739967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:46.739967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:46.740926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:46.740926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:46.740926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:46.740926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:46.740926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:46.740926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:46.740926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:46.740926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:46.740926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:46.740926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:46.740926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:25:46.740926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:25:46.743528 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 84/155] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 13:25:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:46.750689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d2df2-33ec-4c6c-b308-0426b56964aa None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:46.868301 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b914a44-4194-4f2e-9f75-6aba50fcb5eb None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:46.932179 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11172c5-ec5e-4d02-9324-a9f83ab3d1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:46.933074 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11172c5-ec5e-4d02-9324-a9f83ab3d1dc None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:46.933348 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11172c5-ec5e-4d02-9324-a9f83ab3d1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:46.933617 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11172c5-ec5e-4d02-9324-a9f83ab3d1dc None admin] PATH_INFO: `/v3/users/f899f20bb3ec422192ead16d0af584af` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:46.935620 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11172c5-ec5e-4d02-9324-a9f83ab3d1dc None admin] RBAC: Authorizing `identity:get_user(user_id=f899f20bb3ec422192ead16d0af584af)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:46.937199 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11172c5-ec5e-4d02-9324-a9f83ab3d1dc None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:46.939892 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 72/156] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:46 2022] GET /identity/v3/users/f899f20bb3ec422192ead16d0af584af => generated 275 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:25:46.942021 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d2df2-33ec-4c6c-b308-0426b56964aa None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:46.949831 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11172c5-ec5e-4d02-9324-a9f83ab3d1dc None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:47.006920 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5dfef2-c23d-434f-8585-317c69975172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:47.007920 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5dfef2-c23d-434f-8585-317c69975172 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:47.008346 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5dfef2-c23d-434f-8585-317c69975172 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:47.008749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5dfef2-c23d-434f-8585-317c69975172 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:47.009636 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5dfef2-c23d-434f-8585-317c69975172 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:47.010073 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5dfef2-c23d-434f-8585-317c69975172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:47.011613 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5dfef2-c23d-434f-8585-317c69975172 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:47.020868 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 85/157] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:25:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:47.026960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5dfef2-c23d-434f-8585-317c69975172 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:47.034908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:47.110930 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:47.124298 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11172c5-ec5e-4d02-9324-a9f83ab3d1dc None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:47.176280 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd9ae6-c5a7-4285-8d5b-72d3727b2103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:47.176961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd9ae6-c5a7-4285-8d5b-72d3727b2103 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:47.177244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd9ae6-c5a7-4285-8d5b-72d3727b2103 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:47.177521 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd9ae6-c5a7-4285-8d5b-72d3727b2103 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:47.268756 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5dfef2-c23d-434f-8585-317c69975172 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:47.280144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd9ae6-c5a7-4285-8d5b-72d3727b2103 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:47.281723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd9ae6-c5a7-4285-8d5b-72d3727b2103 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:47.358719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fd3dd-6f1a-4a5d-bfcf-fb23c85c0702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:47.359618 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fd3dd-6f1a-4a5d-bfcf-fb23c85c0702 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:47.359899 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fd3dd-6f1a-4a5d-bfcf-fb23c85c0702 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:47.360176 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fd3dd-6f1a-4a5d-bfcf-fb23c85c0702 None admin] PATH_INFO: `/v3/users/f899f20bb3ec422192ead16d0af584af` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:47.361389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5fd3dd-6f1a-4a5d-bfcf-fb23c85c0702 None admin] RBAC: Authorizing `identity:get_user(user_id=f899f20bb3ec422192ead16d0af584af)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:47.364243 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5fd3dd-6f1a-4a5d-bfcf-fb23c85c0702 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:47.366207 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 86/158] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:47 2022] GET /identity/v3/users/f899f20bb3ec422192ead16d0af584af => generated 275 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:47.371402 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fd3dd-6f1a-4a5d-bfcf-fb23c85c0702 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:47.410987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:47.437046 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 73/159] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:25:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:47.445680 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd9ae6-c5a7-4285-8d5b-72d3727b2103 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:47.562961 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:47.578242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fd3dd-6f1a-4a5d-bfcf-fb23c85c0702 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:47.614506 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c1d89-06b0-4e4c-bc76-b27d66060388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:47.615174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c1d89-06b0-4e4c-bc76-b27d66060388 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:47.615462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c1d89-06b0-4e4c-bc76-b27d66060388 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:47.615740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c1d89-06b0-4e4c-bc76-b27d66060388 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:47.696756 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd9ae6-c5a7-4285-8d5b-72d3727b2103 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:47.697725 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c1d89-06b0-4e4c-bc76-b27d66060388 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:47.699399 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c1d89-06b0-4e4c-bc76-b27d66060388 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:47.787409 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2160905-2d9d-4d49-91a9-c16c7df76a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:47.788329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2160905-2d9d-4d49-91a9-c16c7df76a64 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:47.788610 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2160905-2d9d-4d49-91a9-c16c7df76a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:47.788885 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2160905-2d9d-4d49-91a9-c16c7df76a64 None admin] PATH_INFO: `/v3/projects/ce43efdcbb764869a0f4347b5b29fcca` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:47.790196 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2160905-2d9d-4d49-91a9-c16c7df76a64 None admin] RBAC: Authorizing `identity:get_project(project_id=ce43efdcbb764869a0f4347b5b29fcca)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:47.791712 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2160905-2d9d-4d49-91a9-c16c7df76a64 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:47.793454 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 74/160] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:25:47 2022] GET /identity/v3/projects/ce43efdcbb764869a0f4347b5b29fcca => generated 298 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:47.799561 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2160905-2d9d-4d49-91a9-c16c7df76a64 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:47.874938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:47.937733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 87/161] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:25:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:47.948969 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:47.949554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c1d89-06b0-4e4c-bc76-b27d66060388 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:48.081002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2160905-2d9d-4d49-91a9-c16c7df76a64 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:48.159866 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b179e0-d62d-41f4-b13f-8c41d97a0101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:48.160821 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b179e0-d62d-41f4-b13f-8c41d97a0101 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:48.161310 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b179e0-d62d-41f4-b13f-8c41d97a0101 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:48.161731 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b179e0-d62d-41f4-b13f-8c41d97a0101 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:48.162747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b179e0-d62d-41f4-b13f-8c41d97a0101 None admin] RBAC: Adding query filter params (role.id=891bd78dbb334259bdef8495ca3f4132, scope.project.id=ce43efdcbb764869a0f4347b5b29fcca, user.id=f899f20bb3ec422192ead16d0af584af) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:48.163203 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b179e0-d62d-41f4-b13f-8c41d97a0101 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:48.164792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b179e0-d62d-41f4-b13f-8c41d97a0101 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:48.166801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c1d89-06b0-4e4c-bc76-b27d66060388 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:48.175868 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 75/162] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:25:47 2022] GET /identity/v3/role_assignments?user.id=f899f20bb3ec422192ead16d0af584af&scope.project.id=ce43efdcbb764869a0f4347b5b29fcca&role.id=891bd78dbb334259bdef8495ca3f4132 => generated 608 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:48.182881 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58339293-286d-4cef-9d99-a3aa682bbadc None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:48.183586 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58339293-286d-4cef-9d99-a3aa682bbadc None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:48.184065 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58339293-286d-4cef-9d99-a3aa682bbadc None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:48.185816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 76/163] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:48.198813 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad1e68-5d72-43cd-8122-90fc8a9cef3b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:48.199494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad1e68-5d72-43cd-8122-90fc8a9cef3b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:48.199993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad1e68-5d72-43cd-8122-90fc8a9cef3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:48.234920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-73ad1e68-5d72-43cd-8122-90fc8a9cef3b None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:48.236549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-73ad1e68-5d72-43cd-8122-90fc8a9cef3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:48.281288 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6777d0e-1b0d-4ad5-8c7f-e6254e041dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:48.282194 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6777d0e-1b0d-4ad5-8c7f-e6254e041dde None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:48.282472 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6777d0e-1b0d-4ad5-8c7f-e6254e041dde None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:48.282767 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6777d0e-1b0d-4ad5-8c7f-e6254e041dde None admin] PATH_INFO: `/v3/projects/ce43efdcbb764869a0f4347b5b29fcca` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:48.286847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6777d0e-1b0d-4ad5-8c7f-e6254e041dde None admin] RBAC: Authorizing `identity:get_project(project_id=ce43efdcbb764869a0f4347b5b29fcca)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:48.288570 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6777d0e-1b0d-4ad5-8c7f-e6254e041dde None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:48.290500 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 88/164] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:25:47 2022] GET /identity/v3/projects/ce43efdcbb764869a0f4347b5b29fcca => generated 298 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:25:48.298813 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6777d0e-1b0d-4ad5-8c7f-e6254e041dde None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:48.377355 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:48.409274 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 77/165] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:25:48.469791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad1e68-5d72-43cd-8122-90fc8a9cef3b None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:48.488841 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6777d0e-1b0d-4ad5-8c7f-e6254e041dde None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:48.575420 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10121529-fd11-4f65-9186-fbd276be732c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:48.576409 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10121529-fd11-4f65-9186-fbd276be732c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:48.577016 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10121529-fd11-4f65-9186-fbd276be732c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:48.577445 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10121529-fd11-4f65-9186-fbd276be732c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:48.578450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10121529-fd11-4f65-9186-fbd276be732c None admin] RBAC: Adding query filter params (role.id=f63a52fb33144307bba2318551138669, scope.project.id=ce43efdcbb764869a0f4347b5b29fcca, user.id=f899f20bb3ec422192ead16d0af584af) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:48.578929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10121529-fd11-4f65-9186-fbd276be732c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:48.580563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10121529-fd11-4f65-9186-fbd276be732c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:48.582941 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:48.588951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 89/166] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:25:48 2022] GET /identity/v3/role_assignments?user.id=f899f20bb3ec422192ead16d0af584af&scope.project.id=ce43efdcbb764869a0f4347b5b29fcca&role.id=f63a52fb33144307bba2318551138669 => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:48.590914 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41cf43-bfee-4f34-9217-f1d887684fdb None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:48.591382 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41cf43-bfee-4f34-9217-f1d887684fdb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:48.591829 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41cf43-bfee-4f34-9217-f1d887684fdb None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:48.595743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 90/167] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:48.602132 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f3b78-aacd-4896-bbb9-14b1d6fa3f02 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:48.602724 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f3b78-aacd-4896-bbb9-14b1d6fa3f02 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:48.603194 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f3b78-aacd-4896-bbb9-14b1d6fa3f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:48.651800 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-411f3b78-aacd-4896-bbb9-14b1d6fa3f02 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:48.653774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-411f3b78-aacd-4896-bbb9-14b1d6fa3f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:48.715033 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad1e68-5d72-43cd-8122-90fc8a9cef3b None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:48.798590 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278329e-47a5-4b92-b130-6129ec246122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:48.799454 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278329e-47a5-4b92-b130-6129ec246122 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:48.799806 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278329e-47a5-4b92-b130-6129ec246122 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:48.800154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278329e-47a5-4b92-b130-6129ec246122 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:48.812479 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 91/168] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:25:48.827811 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278329e-47a5-4b92-b130-6129ec246122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:48.835777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-f278329e-47a5-4b92-b130-6129ec246122 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:25:48.835777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:48.835777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:48.835777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:48.835777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:48.835777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:48.835777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:48.835777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:48.835777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:48.835777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:48.835777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:48.835777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:48.835777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:48.835777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:48.835777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:48.835777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:48.836824 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:48.836824 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:48.836824 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:48.836824 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:48.836824 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:48.836824 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:48.836824 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:48.836824 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:48.836824 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:48.836824 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:48.836824 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:48.836824 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:48.836824 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:48.836824 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:48.836824 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:48.836824 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:48.837609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:48.837609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:48.837609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:48.837609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:48.837609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:48.837609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:48.837609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:48.837609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:48.837609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:48.837609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:48.837609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:25:48.837609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:25:48.837609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 78/169] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:25:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:25:48.843246 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f3b78-aacd-4896-bbb9-14b1d6fa3f02 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:48.855089 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278329e-47a5-4b92-b130-6129ec246122 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:48.926990 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:49.040436 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f3b78-aacd-4896-bbb9-14b1d6fa3f02 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:49.056814 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278329e-47a5-4b92-b130-6129ec246122 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:49.076919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:49.096356 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b796a-ad84-4af6-ad60-4b78ee88bf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:49.097048 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b796a-ad84-4af6-ad60-4b78ee88bf48 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:49.097325 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b796a-ad84-4af6-ad60-4b78ee88bf48 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:49.097592 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b796a-ad84-4af6-ad60-4b78ee88bf48 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:49.098349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b796a-ad84-4af6-ad60-4b78ee88bf48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:49.098675 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b796a-ad84-4af6-ad60-4b78ee88bf48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:49.100050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b796a-ad84-4af6-ad60-4b78ee88bf48 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:49.115917 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 92/170] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:25:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:49.120845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d72058-a677-4b9b-812b-8d320a418fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:49.121518 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b796a-ad84-4af6-ad60-4b78ee88bf48 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:49.121747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d72058-a677-4b9b-812b-8d320a418fcc None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:49.122033 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d72058-a677-4b9b-812b-8d320a418fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:49.122382 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d72058-a677-4b9b-812b-8d320a418fcc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:49.139022 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d72058-a677-4b9b-812b-8d320a418fcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:49.159607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-c7d72058-a677-4b9b-812b-8d320a418fcc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:25:49.159607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:49.159607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:49.159607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:49.159607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:49.159607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:49.159607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:49.159607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:49.159607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:49.159607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:49.159607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:49.159607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:49.159607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:49.159607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:49.159607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:49.159607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:49.160816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:49.160816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:49.160816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:49.160816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:49.160816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:49.160816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:49.160816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:49.160816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:49.160816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:49.160816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:49.160816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:49.160816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:49.160816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:49.160816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:49.160816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:49.160816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:49.161778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:49.161778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:49.161778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:49.161778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:49.161778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:49.161778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:49.161778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:49.161778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:49.161778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:49.161778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:49.161778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:25:49.161778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:25:49.164056 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 79/171] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:25:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:25:49.169870 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d72058-a677-4b9b-812b-8d320a418fcc None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:49.260230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:49.268140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b796a-ad84-4af6-ad60-4b78ee88bf48 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:49.330352 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dbff4-beda-438f-a72a-bf0869c6cadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:49.331196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dbff4-beda-438f-a72a-bf0869c6cadd None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:49.331475 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dbff4-beda-438f-a72a-bf0869c6cadd None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:49.331739 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dbff4-beda-438f-a72a-bf0869c6cadd None admin] PATH_INFO: `/v3/users/27881d4c1bda4cb38dd2046d66b10c4e` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:49.333073 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0dbff4-beda-438f-a72a-bf0869c6cadd None admin] RBAC: Authorizing `identity:get_user(user_id=27881d4c1bda4cb38dd2046d66b10c4e)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:49.334522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0dbff4-beda-438f-a72a-bf0869c6cadd None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:49.336477 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 93/172] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:49 2022] GET /identity/v3/users/27881d4c1bda4cb38dd2046d66b10c4e => generated 247 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:49.341570 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dbff4-beda-438f-a72a-bf0869c6cadd None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:49.367493 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d72058-a677-4b9b-812b-8d320a418fcc None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:49.448319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d352c-1bdb-488c-9b0e-427c3cae77ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:49.449007 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d352c-1bdb-488c-9b0e-427c3cae77ac None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:49.449385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d352c-1bdb-488c-9b0e-427c3cae77ac None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:49.449653 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d352c-1bdb-488c-9b0e-427c3cae77ac None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:49.450410 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d352c-1bdb-488c-9b0e-427c3cae77ac None admin] RBAC: Adding query filter params (name=member) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:49.450832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d352c-1bdb-488c-9b0e-427c3cae77ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:49.452299 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d352c-1bdb-488c-9b0e-427c3cae77ac None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:49.473532 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 80/173] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:25:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:49.478807 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d352c-1bdb-488c-9b0e-427c3cae77ac None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:49.484861 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dbff4-beda-438f-a72a-bf0869c6cadd None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:49.530803 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b61963-dd98-425f-a3af-111a015ca991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:49.531468 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b61963-dd98-425f-a3af-111a015ca991 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:49.531744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b61963-dd98-425f-a3af-111a015ca991 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:49.532014 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b61963-dd98-425f-a3af-111a015ca991 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:49.538064 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:49.563459 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:49.602370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b61963-dd98-425f-a3af-111a015ca991 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:49.603820 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b61963-dd98-425f-a3af-111a015ca991 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:49.615207 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d352c-1bdb-488c-9b0e-427c3cae77ac None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:49.652755 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7001c2-3bd3-4466-ad76-a551f041e660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:49.654541 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7001c2-3bd3-4466-ad76-a551f041e660 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:49.655100 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7001c2-3bd3-4466-ad76-a551f041e660 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:49.655587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7001c2-3bd3-4466-ad76-a551f041e660 None admin] PATH_INFO: `/v3/users/f899f20bb3ec422192ead16d0af584af` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:49.657181 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7001c2-3bd3-4466-ad76-a551f041e660 None admin] RBAC: Authorizing `identity:get_user(user_id=f899f20bb3ec422192ead16d0af584af)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:49.658937 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7001c2-3bd3-4466-ad76-a551f041e660 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:49.665917 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 81/174] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:49 2022] GET /identity/v3/users/f899f20bb3ec422192ead16d0af584af => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:25:49.667621 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb676fdd-7496-4011-a565-de16fd7de7fd None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:49.668106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb676fdd-7496-4011-a565-de16fd7de7fd None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:49.668611 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb676fdd-7496-4011-a565-de16fd7de7fd None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:49.670231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 82/175] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:49.671736 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d11dd-f608-408d-bd2d-8fb39fee83fc None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:49.672272 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d11dd-f608-408d-bd2d-8fb39fee83fc None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:49.672752 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d11dd-f608-408d-bd2d-8fb39fee83fc None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:49.674368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 83/176] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:49.679327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d11dd-f608-408d-bd2d-8fb39fee83fc None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:49.707161 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 94/177] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:25:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:49.712200 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e07e0-ed45-47fe-a0cc-f15b316f75f3 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:49.712200 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e07e0-ed45-47fe-a0cc-f15b316f75f3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:49.712200 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e07e0-ed45-47fe-a0cc-f15b316f75f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:49.725596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-824e07e0-ed45-47fe-a0cc-f15b316f75f3 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:49.727273 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-824e07e0-ed45-47fe-a0cc-f15b316f75f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:49.786035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:49.796484 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:49.796798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 95/178] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:25:49.798431 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e26421-080b-4e8c-8f8c-74329f24e66e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:49.799038 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e26421-080b-4e8c-8f8c-74329f24e66e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:49.799844 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e26421-080b-4e8c-8f8c-74329f24e66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:49.804461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d11dd-f608-408d-bd2d-8fb39fee83fc None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:49.816351 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a6e26421-080b-4e8c-8f8c-74329f24e66e None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:49.817881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a6e26421-080b-4e8c-8f8c-74329f24e66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:49.842730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13e3c8-fb29-4888-9737-f69cd941c3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:49.843920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13e3c8-fb29-4888-9737-f69cd941c3dc None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:49.844407 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13e3c8-fb29-4888-9737-f69cd941c3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:49.844918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13e3c8-fb29-4888-9737-f69cd941c3dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:49.891364 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 96/179] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:25:49.898730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e26421-080b-4e8c-8f8c-74329f24e66e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:49.949177 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac13e3c8-fb29-4888-9737-f69cd941c3dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:49.951157 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac13e3c8-fb29-4888-9737-f69cd941c3dc None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:49.999318 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e26421-080b-4e8c-8f8c-74329f24e66e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:50.023075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:50.036895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31d61d-1569-408a-b761-246dc23b4393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:50.038092 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31d61d-1569-408a-b761-246dc23b4393 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:50.038588 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31d61d-1569-408a-b761-246dc23b4393 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:50.039053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31d61d-1569-408a-b761-246dc23b4393 None admin] PATH_INFO: `/v3/projects/ce43efdcbb764869a0f4347b5b29fcca` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:50.040566 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31d61d-1569-408a-b761-246dc23b4393 None admin] RBAC: Authorizing `identity:get_project(project_id=ce43efdcbb764869a0f4347b5b29fcca)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:50.042337 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31d61d-1569-408a-b761-246dc23b4393 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:50.044379 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 97/180] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:25:49 2022] GET /identity/v3/projects/ce43efdcbb764869a0f4347b5b29fcca => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:50.050206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31d61d-1569-408a-b761-246dc23b4393 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:50.064356 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:50.075562 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 84/181] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:25:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:50.076764 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13e3c8-fb29-4888-9737-f69cd941c3dc None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:50.170458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31d61d-1569-408a-b761-246dc23b4393 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:50.192455 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13e3c8-fb29-4888-9737-f69cd941c3dc None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:50.212445 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6511e1-a686-42d3-bf2d-a61ebb40492d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:50.213257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6511e1-a686-42d3-bf2d-a61ebb40492d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:50.213534 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6511e1-a686-42d3-bf2d-a61ebb40492d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:50.213808 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6511e1-a686-42d3-bf2d-a61ebb40492d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:50.224318 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6511e1-a686-42d3-bf2d-a61ebb40492d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:50.228368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db368d24-0a1e-4753-9b1b-1f8468af7cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:50.229198 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db368d24-0a1e-4753-9b1b-1f8468af7cda None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:50.229480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db368d24-0a1e-4753-9b1b-1f8468af7cda None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:50.229751 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db368d24-0a1e-4753-9b1b-1f8468af7cda None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:50.232104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-ee6511e1-a686-42d3-bf2d-a61ebb40492d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:25:50.232104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:50.232104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:50.232104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:50.232104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:50.232104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:50.232104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:50.232104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:50.232104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:50.232104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:50.232104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:50.232104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:50.232104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:50.232104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:50.232104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:50.232104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:50.233055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:50.233055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:50.233055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:50.233055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:50.233055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:50.233055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:50.233055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:50.233055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:50.233055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:50.233055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:50.233055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:50.233055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:50.233055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:50.233055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:50.233055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:50.233055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:50.233832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:50.233832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:50.233832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:50.233832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:50.233832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:50.233832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:50.233832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:50.233832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:50.233832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:50.233832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:50.233832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:25:50.233832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:25:50.233832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 98/182] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:25:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:50.234472 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6511e1-a686-42d3-bf2d-a61ebb40492d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:50.243306 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db368d24-0a1e-4753-9b1b-1f8468af7cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:50.251711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-db368d24-0a1e-4753-9b1b-1f8468af7cda None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:25:50.251711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:50.251711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:50.251711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:50.251711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:50.251711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:50.251711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:50.251711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:50.251711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:50.251711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:50.251711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:50.251711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:50.251711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:50.251711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:50.251711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:50.251711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:50.252595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:50.252595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:50.252595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:50.252595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:50.252595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:50.252595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:50.252595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:50.252595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:50.252595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:50.252595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:50.252595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:50.252595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:50.252595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:50.252595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:50.252595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:50.252595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:50.253358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:50.253358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:50.253358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:50.253358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:50.253358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:50.253358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:50.253358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:50.253358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:50.253358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:50.253358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:50.253358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:25:50.253358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:25:50.253358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 85/183] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 13:25:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:50.254032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db368d24-0a1e-4753-9b1b-1f8468af7cda None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:50.290146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:50.318555 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:50.339827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6511e1-a686-42d3-bf2d-a61ebb40492d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:50.359864 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db368d24-0a1e-4753-9b1b-1f8468af7cda None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:50.375214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e694f08-4547-4c34-aab6-40d084ee93cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:50.375871 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e694f08-4547-4c34-aab6-40d084ee93cc None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:50.376135 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e694f08-4547-4c34-aab6-40d084ee93cc None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:50.376404 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e694f08-4547-4c34-aab6-40d084ee93cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:50.377220 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e694f08-4547-4c34-aab6-40d084ee93cc None admin] RBAC: Adding query filter params (role.id=6edd584a77084fa78240661ea76cddb5, scope.project.id=ce43efdcbb764869a0f4347b5b29fcca, user.id=27881d4c1bda4cb38dd2046d66b10c4e) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:50.377545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e694f08-4547-4c34-aab6-40d084ee93cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:50.379044 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e694f08-4547-4c34-aab6-40d084ee93cc None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:50.384829 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 99/184] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:25:50 2022] GET /identity/v3/role_assignments?user.id=27881d4c1bda4cb38dd2046d66b10c4e&scope.project.id=ce43efdcbb764869a0f4347b5b29fcca&role.id=6edd584a77084fa78240661ea76cddb5 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:50.386015 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0770c5-a2c4-4279-9ed7-739478485284 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:50.386295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0770c5-a2c4-4279-9ed7-739478485284 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:50.386588 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0770c5-a2c4-4279-9ed7-739478485284 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:50.387792 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 100/185] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:50.388476 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0770c5-a2c4-4279-9ed7-739478485284 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:50.394794 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34315928-ca84-42c9-b9a1-92fa510d086d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:50.396019 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34315928-ca84-42c9-b9a1-92fa510d086d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:50.396477 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34315928-ca84-42c9-b9a1-92fa510d086d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:50.397007 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34315928-ca84-42c9-b9a1-92fa510d086d None admin] PATH_INFO: `/v3/projects/ef1da5d72c5b4b9abfaefad485f6f01f` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:50.398508 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34315928-ca84-42c9-b9a1-92fa510d086d None admin] RBAC: Authorizing `identity:get_project(project_id=ef1da5d72c5b4b9abfaefad485f6f01f)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:50.400659 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34315928-ca84-42c9-b9a1-92fa510d086d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:50.402723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 86/186] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:25:50 2022] GET /identity/v3/projects/ef1da5d72c5b4b9abfaefad485f6f01f => generated 312 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:50.403541 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34315928-ca84-42c9-b9a1-92fa510d086d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:50.514886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0770c5-a2c4-4279-9ed7-739478485284 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:50.518147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34315928-ca84-42c9-b9a1-92fa510d086d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:50.530015 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:50.549810 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:50.557077 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c52994-afe6-4a5d-8937-f7b1b4ffab0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:50.557776 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c52994-afe6-4a5d-8937-f7b1b4ffab0e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:50.558052 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c52994-afe6-4a5d-8937-f7b1b4ffab0e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:50.558317 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c52994-afe6-4a5d-8937-f7b1b4ffab0e None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:50.559125 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c52994-afe6-4a5d-8937-f7b1b4ffab0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:50.559434 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c52994-afe6-4a5d-8937-f7b1b4ffab0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:50.560570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8aea41-5a44-40ed-bb24-a697c831fa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:50.560970 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c52994-afe6-4a5d-8937-f7b1b4ffab0e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:50.562039 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8aea41-5a44-40ed-bb24-a697c831fa01 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:50.562333 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8aea41-5a44-40ed-bb24-a697c831fa01 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:50.562908 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8aea41-5a44-40ed-bb24-a697c831fa01 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:50.564124 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8aea41-5a44-40ed-bb24-a697c831fa01 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:50.564445 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8aea41-5a44-40ed-bb24-a697c831fa01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:50.565875 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8aea41-5a44-40ed-bb24-a697c831fa01 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:50.571319 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 101/187] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:25:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:50.571319 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468dd39-756a-4de7-b7ee-bf279891ddf9 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:50.571319 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468dd39-756a-4de7-b7ee-bf279891ddf9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:50.571319 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468dd39-756a-4de7-b7ee-bf279891ddf9 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:50.571319 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 102/188] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:50.571319 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbd358-0602-4c9d-938e-677907b760f9 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:50.571319 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbd358-0602-4c9d-938e-677907b760f9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:50.581684 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbd358-0602-4c9d-938e-677907b760f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:50.584860 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 87/189] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:25:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:50.585781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8aea41-5a44-40ed-bb24-a697c831fa01 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:50.602770 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4fbbd358-0602-4c9d-938e-677907b760f9 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:50.603948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4fbbd358-0602-4c9d-938e-677907b760f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:50.691543 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 103/190] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:25:50.693084 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749be5d-0e14-4bf6-8005-f104c0515cde None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:50.693364 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749be5d-0e14-4bf6-8005-f104c0515cde None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:50.693625 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749be5d-0e14-4bf6-8005-f104c0515cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:50.705696 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8aea41-5a44-40ed-bb24-a697c831fa01 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:50.717542 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e749be5d-0e14-4bf6-8005-f104c0515cde None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:50.718777 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e749be5d-0e14-4bf6-8005-f104c0515cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:50.740159 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba877d42-ca74-4e3d-be96-2c947c193ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:50.740825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba877d42-ca74-4e3d-be96-2c947c193ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:50.741106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba877d42-ca74-4e3d-be96-2c947c193ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:50.741382 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba877d42-ca74-4e3d-be96-2c947c193ba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:50.742230 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba877d42-ca74-4e3d-be96-2c947c193ba4 None admin] RBAC: Adding query filter params (role.id=891bd78dbb334259bdef8495ca3f4132, scope.project.id=ef1da5d72c5b4b9abfaefad485f6f01f, user.id=f899f20bb3ec422192ead16d0af584af) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:50.742540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba877d42-ca74-4e3d-be96-2c947c193ba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:50.744004 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba877d42-ca74-4e3d-be96-2c947c193ba4 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:50.749833 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 88/191] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:25:50 2022] GET /identity/v3/role_assignments?user.id=f899f20bb3ec422192ead16d0af584af&scope.project.id=ef1da5d72c5b4b9abfaefad485f6f01f&role.id=891bd78dbb334259bdef8495ca3f4132 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:50.750642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba877d42-ca74-4e3d-be96-2c947c193ba4 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:50.799019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 104/192] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:25:50.799019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749be5d-0e14-4bf6-8005-f104c0515cde None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:50.826245 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:50.839065 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:50.882146 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba877d42-ca74-4e3d-be96-2c947c193ba4 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:50.918790 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749be5d-0e14-4bf6-8005-f104c0515cde None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:50.934430 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf695c06-091d-4b1d-a039-c0a0d5b0a6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:50.935391 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf695c06-091d-4b1d-a039-c0a0d5b0a6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:50.935671 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf695c06-091d-4b1d-a039-c0a0d5b0a6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:50.936002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf695c06-091d-4b1d-a039-c0a0d5b0a6a3 None admin] PATH_INFO: `/v3/users/bd585605d2964b9bbbd7b4f741fecdbc` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:50.955853 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf695c06-091d-4b1d-a039-c0a0d5b0a6a3 None admin] RBAC: Authorizing `identity:get_user(user_id=bd585605d2964b9bbbd7b4f741fecdbc)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:50.957351 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf695c06-091d-4b1d-a039-c0a0d5b0a6a3 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:50.965902 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 89/193] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:50 2022] GET /identity/v3/users/bd585605d2964b9bbbd7b4f741fecdbc => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:50.965902 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf695c06-091d-4b1d-a039-c0a0d5b0a6a3 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:50.979224 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56cd4e-4c95-432a-b148-a5267bd99c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:50.980235 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56cd4e-4c95-432a-b148-a5267bd99c75 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:50.980533 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56cd4e-4c95-432a-b148-a5267bd99c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:50.980799 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56cd4e-4c95-432a-b148-a5267bd99c75 None admin] PATH_INFO: `/v3/users/bd585605d2964b9bbbd7b4f741fecdbc` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:50.981998 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56cd4e-4c95-432a-b148-a5267bd99c75 None admin] RBAC: Authorizing `identity:get_user(user_id=bd585605d2964b9bbbd7b4f741fecdbc)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:50.983823 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56cd4e-4c95-432a-b148-a5267bd99c75 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:50.985692 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 105/194] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:50 2022] GET /identity/v3/users/bd585605d2964b9bbbd7b4f741fecdbc => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:50.986462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56cd4e-4c95-432a-b148-a5267bd99c75 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:51.077191 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf695c06-091d-4b1d-a039-c0a0d5b0a6a3 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:51.087868 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:51.094364 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56cd4e-4c95-432a-b148-a5267bd99c75 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:51.096661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:51.111970 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9de88-0400-49ad-9f3a-6f18d064082b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:51.112779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9de88-0400-49ad-9f3a-6f18d064082b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:51.113060 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9de88-0400-49ad-9f3a-6f18d064082b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:51.113330 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9de88-0400-49ad-9f3a-6f18d064082b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:51.114492 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9de88-0400-49ad-9f3a-6f18d064082b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:51.115969 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9de88-0400-49ad-9f3a-6f18d064082b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:51.117587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 90/195] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:25:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:51.122268 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9de88-0400-49ad-9f3a-6f18d064082b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:51.128675 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051fb45-a341-457a-b96d-7cda19245baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:51.129581 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051fb45-a341-457a-b96d-7cda19245baa None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:51.129862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051fb45-a341-457a-b96d-7cda19245baa None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:51.130131 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051fb45-a341-457a-b96d-7cda19245baa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:51.140295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051fb45-a341-457a-b96d-7cda19245baa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:51.147923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-c051fb45-a341-457a-b96d-7cda19245baa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:25:51.147923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:51.147923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:51.147923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:51.147923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:51.147923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:51.147923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:51.147923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:51.147923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:51.147923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:51.147923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:51.147923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:51.147923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:51.147923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:51.147923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:51.147923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:51.148881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:51.148881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:51.148881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:51.148881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:51.148881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:51.148881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:51.148881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:51.148881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:51.148881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:51.148881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:51.148881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:51.148881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:51.148881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:51.148881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:51.148881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:51.148881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:51.149674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:51.149674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:51.149674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:51.149674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:51.149674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:51.149674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:51.149674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:51.149674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:51.149674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:51.149674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:51.149674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:25:51.149674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:25:51.149674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 106/196] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:25:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:51.151459 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051fb45-a341-457a-b96d-7cda19245baa None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:51.223018 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9de88-0400-49ad-9f3a-6f18d064082b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:51.248126 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051fb45-a341-457a-b96d-7cda19245baa None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:51.255987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98f086-0dbe-4647-b02e-3a035bba63db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:51.256623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98f086-0dbe-4647-b02e-3a035bba63db None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:51.256907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98f086-0dbe-4647-b02e-3a035bba63db None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:51.257178 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98f086-0dbe-4647-b02e-3a035bba63db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:51.282476 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02715915-2204-409f-94c2-8ed3df6e2307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:51.283172 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02715915-2204-409f-94c2-8ed3df6e2307 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:51.283454 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02715915-2204-409f-94c2-8ed3df6e2307 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:51.283727 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02715915-2204-409f-94c2-8ed3df6e2307 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:51.306422 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:51.319263 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:51.334779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98f086-0dbe-4647-b02e-3a035bba63db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:51.336193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98f086-0dbe-4647-b02e-3a035bba63db None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:51.356597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02715915-2204-409f-94c2-8ed3df6e2307 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:51.358112 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02715915-2204-409f-94c2-8ed3df6e2307 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:51.435283 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 91/197] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:25:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:51.439611 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98f086-0dbe-4647-b02e-3a035bba63db None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:51.459239 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 107/198] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:25:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:51.459239 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02715915-2204-409f-94c2-8ed3df6e2307 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:51.517670 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:51.520121 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:51.542930 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98f086-0dbe-4647-b02e-3a035bba63db None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:51.556258 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02715915-2204-409f-94c2-8ed3df6e2307 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:51.578009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4923a7a-94e7-4556-8627-043a890e9049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:51.578798 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4923a7a-94e7-4556-8627-043a890e9049 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:51.579083 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4923a7a-94e7-4556-8627-043a890e9049 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:51.579355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4923a7a-94e7-4556-8627-043a890e9049 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:51.580051 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4923a7a-94e7-4556-8627-043a890e9049 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:51.581494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4923a7a-94e7-4556-8627-043a890e9049 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:51.588681 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a56e8a-62af-4ab8-a095-c2522af840b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:51.589293 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a56e8a-62af-4ab8-a095-c2522af840b9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:51.589571 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a56e8a-62af-4ab8-a095-c2522af840b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:51.589834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a56e8a-62af-4ab8-a095-c2522af840b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:51.590683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a56e8a-62af-4ab8-a095-c2522af840b9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:51.591158 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a56e8a-62af-4ab8-a095-c2522af840b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:51.592625 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a56e8a-62af-4ab8-a095-c2522af840b9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:51.601193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 92/199] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 13:25:51 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:25:51.602053 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4923a7a-94e7-4556-8627-043a890e9049 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:51.602818 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 108/200] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:25:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:51.603597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a56e8a-62af-4ab8-a095-c2522af840b9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:51.729821 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4923a7a-94e7-4556-8627-043a890e9049 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:51.743933 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a56e8a-62af-4ab8-a095-c2522af840b9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:51.767924 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8bd59-c837-4932-a1ee-869c0319824d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:51.768822 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8bd59-c837-4932-a1ee-869c0319824d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:51.769099 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8bd59-c837-4932-a1ee-869c0319824d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:51.769374 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8bd59-c837-4932-a1ee-869c0319824d None admin] PATH_INFO: `/v3/projects/6f065dd8bbe74892af29e05cef5a6d11` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:51.770654 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8bd59-c837-4932-a1ee-869c0319824d None admin] RBAC: Authorizing `identity:get_project(project_id=6f065dd8bbe74892af29e05cef5a6d11)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:51.772144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8bd59-c837-4932-a1ee-869c0319824d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:51.773938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 93/201] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:25:51 2022] GET /identity/v3/projects/6f065dd8bbe74892af29e05cef5a6d11 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:51.774770 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8bd59-c837-4932-a1ee-869c0319824d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:51.775265 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:51.778121 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:51.785469 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f57adf-9522-4b30-91f6-1533b5734db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:51.786369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f57adf-9522-4b30-91f6-1533b5734db0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:51.786954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f57adf-9522-4b30-91f6-1533b5734db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:51.786954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f57adf-9522-4b30-91f6-1533b5734db0 None admin] PATH_INFO: `/v3/projects/6f065dd8bbe74892af29e05cef5a6d11` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:51.788436 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f57adf-9522-4b30-91f6-1533b5734db0 None admin] RBAC: Authorizing `identity:get_project(project_id=6f065dd8bbe74892af29e05cef5a6d11)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:51.790070 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f57adf-9522-4b30-91f6-1533b5734db0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:51.791881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 109/202] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:25:51 2022] GET /identity/v3/projects/6f065dd8bbe74892af29e05cef5a6d11 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:51.792842 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f57adf-9522-4b30-91f6-1533b5734db0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:51.905385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8bd59-c837-4932-a1ee-869c0319824d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:51.918361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f57adf-9522-4b30-91f6-1533b5734db0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:51.951430 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa5b8f-c65a-4c00-9502-67b127ada7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:51.952544 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa5b8f-c65a-4c00-9502-67b127ada7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:51.952909 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa5b8f-c65a-4c00-9502-67b127ada7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:51.953186 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa5b8f-c65a-4c00-9502-67b127ada7e0 None admin] PATH_INFO: `/v3/users/d53cedf959e84c98b4191009b9193c5b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:51.954854 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa5b8f-c65a-4c00-9502-67b127ada7e0 None admin] RBAC: Authorizing `identity:get_user(user_id=d53cedf959e84c98b4191009b9193c5b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:51.956756 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa5b8f-c65a-4c00-9502-67b127ada7e0 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:51.958864 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 94/203] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:51 2022] GET /identity/v3/users/d53cedf959e84c98b4191009b9193c5b => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:51.959645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa5b8f-c65a-4c00-9502-67b127ada7e0 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:51.965145 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0da3e-24c1-4ce9-96b0-ab6540e5ec74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:51.965813 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0da3e-24c1-4ce9-96b0-ab6540e5ec74 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:51.966150 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0da3e-24c1-4ce9-96b0-ab6540e5ec74 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:51.966425 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0da3e-24c1-4ce9-96b0-ab6540e5ec74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:51.967929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0da3e-24c1-4ce9-96b0-ab6540e5ec74 None admin] RBAC: Adding query filter params (role.id=6edd584a77084fa78240661ea76cddb5, scope.project.id=6f065dd8bbe74892af29e05cef5a6d11, user.id=bd585605d2964b9bbbd7b4f741fecdbc) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:51.967929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0da3e-24c1-4ce9-96b0-ab6540e5ec74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:51.969106 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0da3e-24c1-4ce9-96b0-ab6540e5ec74 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:51.975901 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 110/204] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:25:51 2022] GET /identity/v3/role_assignments?user.id=bd585605d2964b9bbbd7b4f741fecdbc&scope.project.id=6f065dd8bbe74892af29e05cef5a6d11&role.id=6edd584a77084fa78240661ea76cddb5 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:51.976740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0da3e-24c1-4ce9-96b0-ab6540e5ec74 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:52.064915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:52.077315 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:52.126356 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa5b8f-c65a-4c00-9502-67b127ada7e0 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:52.187772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ba218-4205-4a57-8c8c-43a34c61221c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:52.188459 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ba218-4205-4a57-8c8c-43a34c61221c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:52.188738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ba218-4205-4a57-8c8c-43a34c61221c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:52.189012 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ba218-4205-4a57-8c8c-43a34c61221c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:52.189864 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ba218-4205-4a57-8c8c-43a34c61221c None admin] RBAC: Adding query filter params (role.id=f63a52fb33144307bba2318551138669, scope.project.id=6f065dd8bbe74892af29e05cef5a6d11, user.id=bd585605d2964b9bbbd7b4f741fecdbc) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:52.190418 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ba218-4205-4a57-8c8c-43a34c61221c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:52.192934 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ba218-4205-4a57-8c8c-43a34c61221c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:52.198048 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0da3e-24c1-4ce9-96b0-ab6540e5ec74 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:52.207486 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 95/205] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:25:51 2022] GET /identity/v3/role_assignments?user.id=bd585605d2964b9bbbd7b4f741fecdbc&scope.project.id=6f065dd8bbe74892af29e05cef5a6d11&role.id=f63a52fb33144307bba2318551138669 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:52.258999 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5397bc-a581-4247-9bdb-f354550ecebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:52.260052 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5397bc-a581-4247-9bdb-f354550ecebb None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:52.260521 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5397bc-a581-4247-9bdb-f354550ecebb None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:52.260981 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5397bc-a581-4247-9bdb-f354550ecebb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:52.358651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5397bc-a581-4247-9bdb-f354550ecebb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:52.360166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5397bc-a581-4247-9bdb-f354550ecebb None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:52.439232 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:52.484923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 111/206] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:25:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:52.490550 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ba218-4205-4a57-8c8c-43a34c61221c None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:52.609472 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ba218-4205-4a57-8c8c-43a34c61221c None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:52.660392 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9bdc4d-f57d-4f1e-9c5f-3dbc143b104a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:52.661323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bdc4d-f57d-4f1e-9c5f-3dbc143b104a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:52.661663 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bdc4d-f57d-4f1e-9c5f-3dbc143b104a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:52.661945 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bdc4d-f57d-4f1e-9c5f-3dbc143b104a None admin] PATH_INFO: `/v3/projects/ce43efdcbb764869a0f4347b5b29fcca` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:52.663173 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9bdc4d-f57d-4f1e-9c5f-3dbc143b104a None admin] RBAC: Authorizing `identity:get_project(project_id=ce43efdcbb764869a0f4347b5b29fcca)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:52.664631 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9bdc4d-f57d-4f1e-9c5f-3dbc143b104a None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:52.666357 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 96/207] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:25:52 2022] GET /identity/v3/projects/ce43efdcbb764869a0f4347b5b29fcca => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:52.672456 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5397bc-a581-4247-9bdb-f354550ecebb None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:52.805448 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5397bc-a581-4247-9bdb-f354550ecebb None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:52.858014 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcb441-8704-4c0d-b3c3-1a2d4070c24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:52.858714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcb441-8704-4c0d-b3c3-1a2d4070c24d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:52.858993 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcb441-8704-4c0d-b3c3-1a2d4070c24d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:52.859266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcb441-8704-4c0d-b3c3-1a2d4070c24d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:52.860117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcb441-8704-4c0d-b3c3-1a2d4070c24d None admin] RBAC: Adding query filter params (role.id=e3afb7f30d8240539b9d7139c5ade987, scope.project.id=ce43efdcbb764869a0f4347b5b29fcca, user.id=d53cedf959e84c98b4191009b9193c5b) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:52.860426 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcb441-8704-4c0d-b3c3-1a2d4070c24d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:52.861943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcb441-8704-4c0d-b3c3-1a2d4070c24d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:52.871035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 112/208] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:25:52 2022] GET /identity/v3/role_assignments?user.id=d53cedf959e84c98b4191009b9193c5b&scope.project.id=ce43efdcbb764869a0f4347b5b29fcca&role.id=e3afb7f30d8240539b9d7139c5ade987 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:54.168113 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a97ab2-0b8f-439c-9397-a38f277367bd None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:54.168634 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a97ab2-0b8f-439c-9397-a38f277367bd None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:54.168634 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a97ab2-0b8f-439c-9397-a38f277367bd None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:54.170410 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 97/209] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:54.176038 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f9581-e2d3-41ca-bfeb-06cffa7df64a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:54.176466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f9581-e2d3-41ca-bfeb-06cffa7df64a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:54.176655 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f9581-e2d3-41ca-bfeb-06cffa7df64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:54.194196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b83f9581-e2d3-41ca-bfeb-06cffa7df64a None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:54.195408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b83f9581-e2d3-41ca-bfeb-06cffa7df64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:54.213108 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:54.265369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 113/210] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:25:54.288901 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a97ab2-0b8f-439c-9397-a38f277367bd None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:54.291878 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:54.334227 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff65e0b-3c0f-4a83-ac7f-dccdced4ddb5 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:54.334596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff65e0b-3c0f-4a83-ac7f-dccdced4ddb5 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:54.334792 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff65e0b-3c0f-4a83-ac7f-dccdced4ddb5 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:54.336440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 114/211] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:54.341407 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552a628-b06e-4ba7-a619-bf7d3f242b17 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:54.341679 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552a628-b06e-4ba7-a619-bf7d3f242b17 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:54.341952 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552a628-b06e-4ba7-a619-bf7d3f242b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:54.364516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6552a628-b06e-4ba7-a619-bf7d3f242b17 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:54.366354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6552a628-b06e-4ba7-a619-bf7d3f242b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:54.412239 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a97ab2-0b8f-439c-9397-a38f277367bd None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:54.448153 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d2830-8a0b-4a8f-b9a1-fce220b9dbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:54.449327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d2830-8a0b-4a8f-b9a1-fce220b9dbc9 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:54.449807 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d2830-8a0b-4a8f-b9a1-fce220b9dbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:54.450273 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d2830-8a0b-4a8f-b9a1-fce220b9dbc9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:54.454078 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 115/212] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:25:54.464887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d2830-8a0b-4a8f-b9a1-fce220b9dbc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:54.475293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-942d2830-8a0b-4a8f-b9a1-fce220b9dbc9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:25:54.475293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:54.475293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:54.475293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:54.475293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:54.475293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:54.475293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:54.475293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:54.475293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:54.475293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:54.475293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:54.475293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:54.475293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:54.475293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:54.475293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:54.475293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:54.476166 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:54.476166 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:54.476166 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:54.476166 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:54.476166 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:54.476166 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:54.476166 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:54.476166 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:54.476166 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:54.476166 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:54.476166 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:54.476166 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:54.476166 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:54.476166 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:54.476166 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:54.476166 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:54.476952 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:54.476952 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:54.476952 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:54.476952 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:54.476952 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:54.476952 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:54.476952 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:54.476952 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:54.476952 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:54.476952 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:54.476952 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:25:54.476952 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:25:54.478196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552a628-b06e-4ba7-a619-bf7d3f242b17 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:54.479617 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 98/213] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:25:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:54.488373 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d2830-8a0b-4a8f-b9a1-fce220b9dbc9 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:54.565636 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:54.567517 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:54.584300 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552a628-b06e-4ba7-a619-bf7d3f242b17 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:54.603150 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d2830-8a0b-4a8f-b9a1-fce220b9dbc9 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:54.618830 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff11129-aebd-40d9-974e-6601fe8cc50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:54.619644 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff11129-aebd-40d9-974e-6601fe8cc50f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:54.619920 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff11129-aebd-40d9-974e-6601fe8cc50f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:54.620186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff11129-aebd-40d9-974e-6601fe8cc50f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:54.621365 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff11129-aebd-40d9-974e-6601fe8cc50f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:54.622880 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff11129-aebd-40d9-974e-6601fe8cc50f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:54.629357 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 116/214] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:25:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:54.631370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff11129-aebd-40d9-974e-6601fe8cc50f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:54.650315 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38099bb-e22c-469c-94f0-81b994399365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:54.651517 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38099bb-e22c-469c-94f0-81b994399365 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:54.652026 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38099bb-e22c-469c-94f0-81b994399365 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:54.652512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38099bb-e22c-469c-94f0-81b994399365 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:54.653542 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38099bb-e22c-469c-94f0-81b994399365 None admin] RBAC: Adding query filter params (name=member) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:54.654453 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38099bb-e22c-469c-94f0-81b994399365 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:54.656321 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38099bb-e22c-469c-94f0-81b994399365 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:54.665781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 99/215] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:25:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:25:54.672133 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38099bb-e22c-469c-94f0-81b994399365 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:54.750429 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff11129-aebd-40d9-974e-6601fe8cc50f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:54.785017 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750af17-55da-4dff-ab41-f48b8eae9a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:54.785698 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750af17-55da-4dff-ab41-f48b8eae9a99 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:54.785981 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750af17-55da-4dff-ab41-f48b8eae9a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:54.786260 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750af17-55da-4dff-ab41-f48b8eae9a99 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:54.786801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38099bb-e22c-469c-94f0-81b994399365 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:54.787019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7750af17-55da-4dff-ab41-f48b8eae9a99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:54.788471 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7750af17-55da-4dff-ab41-f48b8eae9a99 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:54.809743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 117/216] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 13:25:54 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:25:54.812023 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:54.816765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3536c93-199c-4282-a3fb-f457fc671cfc None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:54.817141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3536c93-199c-4282-a3fb-f457fc671cfc None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:54.817417 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3536c93-199c-4282-a3fb-f457fc671cfc None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:54.819056 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 118/217] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:54.820329 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05567f-5ff8-4460-9834-eb11502f5fb1 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:54.820615 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05567f-5ff8-4460-9834-eb11502f5fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:54.820887 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05567f-5ff8-4460-9834-eb11502f5fb1 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:54.822437 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 119/218] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:54.828070 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cab94-b2b1-490b-a9a8-aab6f3694a80 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:54.828428 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cab94-b2b1-490b-a9a8-aab6f3694a80 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:54.828630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cab94-b2b1-490b-a9a8-aab6f3694a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:54.830319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecde9bd-bd97-4dad-a255-d119ffde06a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:54.831275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecde9bd-bd97-4dad-a255-d119ffde06a3 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:54.831581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecde9bd-bd97-4dad-a255-d119ffde06a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:54.831828 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecde9bd-bd97-4dad-a255-d119ffde06a3 None admin] PATH_INFO: `/v3/users/b7fda80c065341f9b2199ce5aa986159` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:54.841974 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:54.848285 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6b8cab94-b2b1-490b-a9a8-aab6f3694a80 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:54.849688 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6b8cab94-b2b1-490b-a9a8-aab6f3694a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:54.849960 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecde9bd-bd97-4dad-a255-d119ffde06a3 None admin] RBAC: Authorizing `identity:get_user(user_id=b7fda80c065341f9b2199ce5aa986159)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:54.851655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecde9bd-bd97-4dad-a255-d119ffde06a3 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:54.859572 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 100/219] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:54 2022] GET /identity/v3/users/b7fda80c065341f9b2199ce5aa986159 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:25:54.859572 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9a230-7860-451b-8bd1-3a3245ab50ec None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:54.859572 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9a230-7860-451b-8bd1-3a3245ab50ec None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:54.859572 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9a230-7860-451b-8bd1-3a3245ab50ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:54.877433 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-1fe9a230-7860-451b-8bd1-3a3245ab50ec None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:54.878691 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1fe9a230-7860-451b-8bd1-3a3245ab50ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:54.930867 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 120/220] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:25:54.935598 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8cab94-b2b1-490b-a9a8-aab6f3694a80 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:54.969345 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 101/221] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:25:54.978800 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9a230-7860-451b-8bd1-3a3245ab50ec None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:55.072007 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8cab94-b2b1-490b-a9a8-aab6f3694a80 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:55.086990 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9a230-7860-451b-8bd1-3a3245ab50ec None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:55.102916 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:55.121945 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cef51-c389-4032-9299-6db3685e6180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:55.122751 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cef51-c389-4032-9299-6db3685e6180 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:55.123031 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cef51-c389-4032-9299-6db3685e6180 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:55.123351 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cef51-c389-4032-9299-6db3685e6180 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:55.130095 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fae00-e713-4fbc-8bdd-ec30f8b9d432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:55.130958 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fae00-e713-4fbc-8bdd-ec30f8b9d432 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:55.131231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fae00-e713-4fbc-8bdd-ec30f8b9d432 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:55.131525 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fae00-e713-4fbc-8bdd-ec30f8b9d432 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:55.133579 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:55.144932 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353fae00-e713-4fbc-8bdd-ec30f8b9d432 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:55.154221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-353fae00-e713-4fbc-8bdd-ec30f8b9d432 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:25:55.154221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:55.154221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:55.154221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:55.154221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:55.154221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:55.154221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:55.154221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:55.154221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:55.154221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:55.154221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:55.154221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:55.154221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:55.154221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:55.154221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:55.154221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:55.155211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:55.155211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:55.155211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:55.155211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:55.155211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:55.155211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:55.155211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:55.155211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:55.155211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:55.155211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:55.155211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:55.155211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:55.155211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:55.155211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:55.155211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:55.155211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:55.156103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:55.156103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:55.156103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:55.156103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:55.156103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:55.156103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:55.156103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:55.156103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:55.156103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:55.156103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:55.156103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:25:55.156103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:25:55.156103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 102/222] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 13:25:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:55.156774 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fae00-e713-4fbc-8bdd-ec30f8b9d432 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:55.201887 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876cef51-c389-4032-9299-6db3685e6180 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:55.203529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876cef51-c389-4032-9299-6db3685e6180 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:55.288485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fae00-e713-4fbc-8bdd-ec30f8b9d432 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:55.309514 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 121/223] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:25:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:55.310518 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cef51-c389-4032-9299-6db3685e6180 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:55.336795 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa602a-48b5-499b-b85f-753d18ea74a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:55.338087 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa602a-48b5-499b-b85f-753d18ea74a5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:55.338979 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa602a-48b5-499b-b85f-753d18ea74a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:55.339392 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa602a-48b5-499b-b85f-753d18ea74a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:55.349381 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:55.354877 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa602a-48b5-499b-b85f-753d18ea74a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:55.365626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-2faa602a-48b5-499b-b85f-753d18ea74a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:25:55.365626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:55.365626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:55.365626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:55.365626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:55.365626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:55.365626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:55.365626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:55.365626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:55.365626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:55.365626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:55.365626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:55.365626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:55.365626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:55.365626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:55.365626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:55.366531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:55.366531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:55.366531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:55.366531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:55.366531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:55.366531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:55.366531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:55.366531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:55.366531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:55.366531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:55.366531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:55.366531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:55.366531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:55.366531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:55.366531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:55.366531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:55.367376 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:55.367376 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:55.367376 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:55.367376 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:55.367376 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:55.367376 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:55.367376 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:55.367376 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:55.367376 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:55.367376 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:55.367376 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:25:55.367376 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:25:55.368986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 103/224] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:25:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:55.368986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa602a-48b5-499b-b85f-753d18ea74a5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:55.415970 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:55.437087 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cef51-c389-4032-9299-6db3685e6180 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:55.472609 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9a236-33d8-4f1d-925d-8072ce047cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:55.473302 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9a236-33d8-4f1d-925d-8072ce047cdc None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:55.473578 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9a236-33d8-4f1d-925d-8072ce047cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:55.473845 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9a236-33d8-4f1d-925d-8072ce047cdc None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:55.475167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9a236-33d8-4f1d-925d-8072ce047cdc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:55.475534 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9a236-33d8-4f1d-925d-8072ce047cdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:55.476970 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9a236-33d8-4f1d-925d-8072ce047cdc None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:55.490913 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 122/225] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:25:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:55.490913 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9a236-33d8-4f1d-925d-8072ce047cdc None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:55.509438 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa602a-48b5-499b-b85f-753d18ea74a5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:55.549569 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0c68e-2887-4424-a2bb-8e1f70a3de37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:55.551219 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0c68e-2887-4424-a2bb-8e1f70a3de37 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:55.551886 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0c68e-2887-4424-a2bb-8e1f70a3de37 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:55.552317 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0c68e-2887-4424-a2bb-8e1f70a3de37 None admin] PATH_INFO: `/v3/projects/6f065dd8bbe74892af29e05cef5a6d11` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:55.553780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0c68e-2887-4424-a2bb-8e1f70a3de37 None admin] RBAC: Authorizing `identity:get_project(project_id=6f065dd8bbe74892af29e05cef5a6d11)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:55.555911 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0c68e-2887-4424-a2bb-8e1f70a3de37 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:55.558489 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 104/226] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:25:55 2022] GET /identity/v3/projects/6f065dd8bbe74892af29e05cef5a6d11 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:55.559708 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0c68e-2887-4424-a2bb-8e1f70a3de37 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:55.598917 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:55.603680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9a236-33d8-4f1d-925d-8072ce047cdc None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:55.643374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0d762-ae8a-44a9-819d-67defc450d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:55.644171 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0d762-ae8a-44a9-819d-67defc450d21 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:55.644658 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0d762-ae8a-44a9-819d-67defc450d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:55.645017 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0d762-ae8a-44a9-819d-67defc450d21 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:55.645928 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0d762-ae8a-44a9-819d-67defc450d21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:55.647997 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0d762-ae8a-44a9-819d-67defc450d21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:55.649486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0d762-ae8a-44a9-819d-67defc450d21 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:55.664067 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 123/227] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:25:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:55.665214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0d762-ae8a-44a9-819d-67defc450d21 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:55.679224 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:55.683172 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0c68e-2887-4424-a2bb-8e1f70a3de37 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:55.732165 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449b442-b6d0-4d76-b3f3-1d6467a5620d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:55.734268 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449b442-b6d0-4d76-b3f3-1d6467a5620d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:55.734924 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449b442-b6d0-4d76-b3f3-1d6467a5620d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:55.735432 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449b442-b6d0-4d76-b3f3-1d6467a5620d None admin] PATH_INFO: `/v3/users/bd585605d2964b9bbbd7b4f741fecdbc` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:55.737406 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449b442-b6d0-4d76-b3f3-1d6467a5620d None admin] RBAC: Authorizing `identity:get_user(user_id=bd585605d2964b9bbbd7b4f741fecdbc)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:55.739513 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449b442-b6d0-4d76-b3f3-1d6467a5620d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:55.746715 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 105/228] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:55 2022] GET /identity/v3/users/bd585605d2964b9bbbd7b4f741fecdbc => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:55.748548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449b442-b6d0-4d76-b3f3-1d6467a5620d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:55.786336 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0d762-ae8a-44a9-819d-67defc450d21 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:55.822181 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32018286-9994-4a75-8403-30b23a8da6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:55.823068 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32018286-9994-4a75-8403-30b23a8da6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:55.823445 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32018286-9994-4a75-8403-30b23a8da6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:55.823817 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32018286-9994-4a75-8403-30b23a8da6a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:55.824753 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32018286-9994-4a75-8403-30b23a8da6a7 None admin] RBAC: Adding query filter params (role.id=891bd78dbb334259bdef8495ca3f4132, scope.project.id=6f065dd8bbe74892af29e05cef5a6d11, user.id=b7fda80c065341f9b2199ce5aa986159) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:55.825179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32018286-9994-4a75-8403-30b23a8da6a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:55.826934 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32018286-9994-4a75-8403-30b23a8da6a7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:55.833173 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 124/229] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:25:55 2022] GET /identity/v3/role_assignments?user.id=b7fda80c065341f9b2199ce5aa986159&scope.project.id=6f065dd8bbe74892af29e05cef5a6d11&role.id=891bd78dbb334259bdef8495ca3f4132 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:55.834101 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32018286-9994-4a75-8403-30b23a8da6a7 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:55.866727 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:55.873761 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449b442-b6d0-4d76-b3f3-1d6467a5620d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:55.956101 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846e262-6139-49d0-bf88-42100c7ee199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:55.957859 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846e262-6139-49d0-bf88-42100c7ee199 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:55.958251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846e262-6139-49d0-bf88-42100c7ee199 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:55.958534 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846e262-6139-49d0-bf88-42100c7ee199 None admin] PATH_INFO: `/v3/users/bd585605d2964b9bbbd7b4f741fecdbc` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:55.959955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846e262-6139-49d0-bf88-42100c7ee199 None admin] RBAC: Authorizing `identity:get_user(user_id=bd585605d2964b9bbbd7b4f741fecdbc)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:55.961427 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846e262-6139-49d0-bf88-42100c7ee199 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:55.963554 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 106/230] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:55 2022] GET /identity/v3/users/bd585605d2964b9bbbd7b4f741fecdbc => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:55.970509 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846e262-6139-49d0-bf88-42100c7ee199 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:56.020147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:56.036888 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32018286-9994-4a75-8403-30b23a8da6a7 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:56.098257 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846e262-6139-49d0-bf88-42100c7ee199 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:56.117220 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac98c38-bb41-47f5-970f-211c0aad85cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:56.118043 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac98c38-bb41-47f5-970f-211c0aad85cb None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:56.118330 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac98c38-bb41-47f5-970f-211c0aad85cb None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:56.118626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac98c38-bb41-47f5-970f-211c0aad85cb None admin] PATH_INFO: `/v3/projects/6f065dd8bbe74892af29e05cef5a6d11` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:56.119952 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac98c38-bb41-47f5-970f-211c0aad85cb None admin] RBAC: Authorizing `identity:get_project(project_id=6f065dd8bbe74892af29e05cef5a6d11)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:56.121455 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac98c38-bb41-47f5-970f-211c0aad85cb None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:56.123904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 125/231] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:25:55 2022] GET /identity/v3/projects/6f065dd8bbe74892af29e05cef5a6d11 => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:56.135775 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac98c38-bb41-47f5-970f-211c0aad85cb None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:56.142607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac663a-b8bc-43cd-b190-b0e8020d8a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:56.143514 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac663a-b8bc-43cd-b190-b0e8020d8a27 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:56.143797 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac663a-b8bc-43cd-b190-b0e8020d8a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:56.144074 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac663a-b8bc-43cd-b190-b0e8020d8a27 None admin] PATH_INFO: `/v3/projects/6f065dd8bbe74892af29e05cef5a6d11` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:56.145275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac663a-b8bc-43cd-b190-b0e8020d8a27 None admin] RBAC: Authorizing `identity:get_project(project_id=6f065dd8bbe74892af29e05cef5a6d11)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:56.146772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac663a-b8bc-43cd-b190-b0e8020d8a27 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:56.148693 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 107/232] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:25:55 2022] GET /identity/v3/projects/6f065dd8bbe74892af29e05cef5a6d11 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:56.155037 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac663a-b8bc-43cd-b190-b0e8020d8a27 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:56.293344 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac663a-b8bc-43cd-b190-b0e8020d8a27 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:56.298159 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:56.302268 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:56.309441 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac98c38-bb41-47f5-970f-211c0aad85cb None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:56.348775 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b77dc6-8069-435a-8d2d-6d8519f33ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:56.349687 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b77dc6-8069-435a-8d2d-6d8519f33ff1 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:56.349967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b77dc6-8069-435a-8d2d-6d8519f33ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:56.350245 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b77dc6-8069-435a-8d2d-6d8519f33ff1 None admin] PATH_INFO: `/v3/projects/6f065dd8bbe74892af29e05cef5a6d11/users/bd585605d2964b9bbbd7b4f741fecdbc/roles/f63a52fb33144307bba2318551138669` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:56.352787 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b77dc6-8069-435a-8d2d-6d8519f33ff1 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f065dd8bbe74892af29e05cef5a6d11, user_id=bd585605d2964b9bbbd7b4f741fecdbc, role_id=f63a52fb33144307bba2318551138669)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:56.354511 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b77dc6-8069-435a-8d2d-6d8519f33ff1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:56.376472 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b12a5-58fe-4495-b69a-b73fc02e7cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:56.379452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b12a5-58fe-4495-b69a-b73fc02e7cf2 None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:56.380299 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b12a5-58fe-4495-b69a-b73fc02e7cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:56.380588 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b12a5-58fe-4495-b69a-b73fc02e7cf2 None admin] PATH_INFO: `/v3/projects/6f065dd8bbe74892af29e05cef5a6d11/users/bd585605d2964b9bbbd7b4f741fecdbc/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:56.385718 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b12a5-58fe-4495-b69a-b73fc02e7cf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f065dd8bbe74892af29e05cef5a6d11, user_id=bd585605d2964b9bbbd7b4f741fecdbc, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:56.386370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 126/233] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 13:25:56 2022] PUT /identity/v3/projects/6f065dd8bbe74892af29e05cef5a6d11/users/bd585605d2964b9bbbd7b4f741fecdbc/roles/f63a52fb33144307bba2318551138669 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:25:56.387495 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b12a5-58fe-4495-b69a-b73fc02e7cf2 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:56.406142 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 108/234] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 13:25:56 2022] PUT /identity/v3/projects/6f065dd8bbe74892af29e05cef5a6d11/users/bd585605d2964b9bbbd7b4f741fecdbc/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:25:57.381295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa7a06-cbbb-4a0a-914e-681befb6b668 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:57.381855 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa7a06-cbbb-4a0a-914e-681befb6b668 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:57.381855 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa7a06-cbbb-4a0a-914e-681befb6b668 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:57.383513 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 127/235] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:57.388744 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7231796-0aff-4755-a519-65890af1b40b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:57.389302 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7231796-0aff-4755-a519-65890af1b40b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:57.389833 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7231796-0aff-4755-a519-65890af1b40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:57.408151 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-c7231796-0aff-4755-a519-65890af1b40b None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:57.409348 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c7231796-0aff-4755-a519-65890af1b40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:57.496340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 109/236] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:25:57.532418 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa7a06-cbbb-4a0a-914e-681befb6b668 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:57.556264 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1aa43-a496-42b0-827e-7548b5a68c81 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:57.556598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1aa43-a496-42b0-827e-7548b5a68c81 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:57.556816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1aa43-a496-42b0-827e-7548b5a68c81 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:57.558213 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 110/237] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:57.566909 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83cdd9-141d-4f37-8ce3-46c5a0fa191a None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:57.567194 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83cdd9-141d-4f37-8ce3-46c5a0fa191a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:57.567468 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83cdd9-141d-4f37-8ce3-46c5a0fa191a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:57.595957 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-fb83cdd9-141d-4f37-8ce3-46c5a0fa191a None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:57.597315 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-fb83cdd9-141d-4f37-8ce3-46c5a0fa191a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:57.683970 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa7a06-cbbb-4a0a-914e-681befb6b668 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:57.703857 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 111/238] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:25:57.732065 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83cdd9-141d-4f37-8ce3-46c5a0fa191a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:57.753652 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58f1d8-6ad6-45a1-b464-6190ed5164fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:57.755942 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58f1d8-6ad6-45a1-b464-6190ed5164fe None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:57.756451 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58f1d8-6ad6-45a1-b464-6190ed5164fe None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:57.757768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58f1d8-6ad6-45a1-b464-6190ed5164fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:57.779300 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:57.781286 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58f1d8-6ad6-45a1-b464-6190ed5164fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:57.801563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-bf58f1d8-6ad6-45a1-b464-6190ed5164fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:25:57.801563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:57.801563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:57.801563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:57.801563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:57.801563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:57.801563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:57.801563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:57.801563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:57.801563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:57.801563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:57.801563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:57.801563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:57.801563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:57.801563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:57.801563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:57.802507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:57.802507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:57.802507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:57.802507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:57.802507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:57.802507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:57.802507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:57.802507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:57.802507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:57.802507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:57.802507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:57.802507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:57.802507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:57.802507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:57.802507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:57.802507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:57.803339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:57.803339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:57.803339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:57.803339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:57.803339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:57.803339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:57.803339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:57.803339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:57.803339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:57.803339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:57.803339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:25:57.803339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:25:57.805217 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 128/239] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:25:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:57.810299 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58f1d8-6ad6-45a1-b464-6190ed5164fe None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:57.848395 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:57.885617 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83cdd9-141d-4f37-8ce3-46c5a0fa191a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:57.959453 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175b807-dff5-41a8-a7f4-b52ceff2988e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:57.960202 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175b807-dff5-41a8-a7f4-b52ceff2988e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:57.960481 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175b807-dff5-41a8-a7f4-b52ceff2988e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:57.960751 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175b807-dff5-41a8-a7f4-b52ceff2988e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:57.965049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175b807-dff5-41a8-a7f4-b52ceff2988e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:57.966508 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175b807-dff5-41a8-a7f4-b52ceff2988e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:57.968437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 112/240] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:25:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:25:57.997742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175b807-dff5-41a8-a7f4-b52ceff2988e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:58.025584 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58f1d8-6ad6-45a1-b464-6190ed5164fe None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:58.066172 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df9afc-080b-4824-bd79-7c1de5646a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:58.067420 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df9afc-080b-4824-bd79-7c1de5646a5b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:58.068872 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df9afc-080b-4824-bd79-7c1de5646a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:58.070047 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df9afc-080b-4824-bd79-7c1de5646a5b None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:58.071292 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df9afc-080b-4824-bd79-7c1de5646a5b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:58.073970 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df9afc-080b-4824-bd79-7c1de5646a5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:58.075755 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df9afc-080b-4824-bd79-7c1de5646a5b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:58.090517 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 129/241] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:25:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:58.100970 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df9afc-080b-4824-bd79-7c1de5646a5b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:58.204066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:58.220899 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175b807-dff5-41a8-a7f4-b52ceff2988e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:58.254127 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:58.291529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41b5e9-40cf-4017-937c-10df2691c649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:58.293737 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41b5e9-40cf-4017-937c-10df2691c649 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:58.295464 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41b5e9-40cf-4017-937c-10df2691c649 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:58.296034 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41b5e9-40cf-4017-937c-10df2691c649 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:58.297016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41b5e9-40cf-4017-937c-10df2691c649 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:58.300574 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41b5e9-40cf-4017-937c-10df2691c649 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:58.312778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df9afc-080b-4824-bd79-7c1de5646a5b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:58.349969 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 113/242] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 13:25:57 2022] POST /identity/v3/users => generated 293 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:25:58.366275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0d0f0-0966-4d87-8d47-1e561694d016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:58.367205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0d0f0-0966-4d87-8d47-1e561694d016 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:58.367489 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0d0f0-0966-4d87-8d47-1e561694d016 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:58.367758 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0d0f0-0966-4d87-8d47-1e561694d016 None admin] PATH_INFO: `/v3/users/db99697ddb6c4459bd6c21f30e96daf8` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:58.391518 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0d0f0-0966-4d87-8d47-1e561694d016 None admin] RBAC: Authorizing `identity:get_user(user_id=db99697ddb6c4459bd6c21f30e96daf8)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:58.393023 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0d0f0-0966-4d87-8d47-1e561694d016 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:58.395315 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 130/243] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:58 2022] GET /identity/v3/users/db99697ddb6c4459bd6c21f30e96daf8 => generated 297 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:58.400970 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41b5e9-40cf-4017-937c-10df2691c649 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:58.558889 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41b5e9-40cf-4017-937c-10df2691c649 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:58.566674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018240f-9440-4064-bbe8-e7193ba6cfb8 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:58.566954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018240f-9440-4064-bbe8-e7193ba6cfb8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:58.567450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018240f-9440-4064-bbe8-e7193ba6cfb8 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:58.570442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 131/244] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:58.575113 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ca16f-70a0-4071-8fa9-e095f77566ef None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:58.575674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ca16f-70a0-4071-8fa9-e095f77566ef None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:58.576141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ca16f-70a0-4071-8fa9-e095f77566ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:58.598634 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-332ca16f-70a0-4071-8fa9-e095f77566ef None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:58.598634 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-332ca16f-70a0-4071-8fa9-e095f77566ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:58.621801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc37e1b-eb9a-40e5-84c4-c24501ec5849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:58.622482 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc37e1b-eb9a-40e5-84c4-c24501ec5849 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:58.622789 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc37e1b-eb9a-40e5-84c4-c24501ec5849 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:58.623061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc37e1b-eb9a-40e5-84c4-c24501ec5849 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:58.664485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:58.728858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 132/245] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:25:58.750935 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc37e1b-eb9a-40e5-84c4-c24501ec5849 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:58.752861 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc37e1b-eb9a-40e5-84c4-c24501ec5849 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:58.757982 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ca16f-70a0-4071-8fa9-e095f77566ef None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:58.837736 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:58.868754 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 114/246] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:25:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:25:58.875130 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc37e1b-eb9a-40e5-84c4-c24501ec5849 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:58.888498 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ca16f-70a0-4071-8fa9-e095f77566ef None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:58.927822 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:58.939709 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffe6f2-af65-4475-b3e9-c5884c5880eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:58.940886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffe6f2-af65-4475-b3e9-c5884c5880eb None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:58.941377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffe6f2-af65-4475-b3e9-c5884c5880eb None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:58.941833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffe6f2-af65-4475-b3e9-c5884c5880eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:58.954486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffe6f2-af65-4475-b3e9-c5884c5880eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:58.962916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-0fffe6f2-af65-4475-b3e9-c5884c5880eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:25:58.962916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:58.962916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:58.962916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:58.962916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:58.962916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:58.962916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:58.962916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:58.962916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:58.962916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:58.962916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:58.962916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:58.962916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:58.962916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:58.962916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:58.962916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:58.963801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:58.963801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:58.963801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:58.963801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:58.963801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:58.963801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:58.963801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:58.963801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:58.963801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:58.963801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:58.963801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:58.963801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:58.963801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:58.963801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:58.963801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:58.963801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:58.964562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:58.964562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:58.964562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:58.964562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:58.964562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:58.964562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:58.964562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:58.964562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:58.964562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:58.964562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:58.964562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:25:58.964562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:25:58.967146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 133/247] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:25:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:58.973373 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffe6f2-af65-4475-b3e9-c5884c5880eb None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:59.004236 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc37e1b-eb9a-40e5-84c4-c24501ec5849 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:59.057611 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04871aba-0126-419a-a110-46fe245d8789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:59.058845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04871aba-0126-419a-a110-46fe245d8789 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:59.059319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04871aba-0126-419a-a110-46fe245d8789 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:59.059768 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04871aba-0126-419a-a110-46fe245d8789 None admin] PATH_INFO: `/v3/projects/6f065dd8bbe74892af29e05cef5a6d11` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:59.062300 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04871aba-0126-419a-a110-46fe245d8789 None admin] RBAC: Authorizing `identity:get_project(project_id=6f065dd8bbe74892af29e05cef5a6d11)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:59.063911 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04871aba-0126-419a-a110-46fe245d8789 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:59.065755 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 115/248] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:25:58 2022] GET /identity/v3/projects/6f065dd8bbe74892af29e05cef5a6d11 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:25:59.071754 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04871aba-0126-419a-a110-46fe245d8789 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:59.108043 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffe6f2-af65-4475-b3e9-c5884c5880eb None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:59.139106 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:59.157302 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69459f-6d4e-4795-a90c-b28ebda48df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:59.158278 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69459f-6d4e-4795-a90c-b28ebda48df9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:59.158558 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69459f-6d4e-4795-a90c-b28ebda48df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:59.158943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69459f-6d4e-4795-a90c-b28ebda48df9 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:59.160853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69459f-6d4e-4795-a90c-b28ebda48df9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:59.161167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69459f-6d4e-4795-a90c-b28ebda48df9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:59.162565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69459f-6d4e-4795-a90c-b28ebda48df9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:59.174651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 134/249] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:25:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:25:59.180036 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0b9ee-206c-4949-bb59-733347cebf5e None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:59.180317 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0b9ee-206c-4949-bb59-733347cebf5e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:59.180587 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0b9ee-206c-4949-bb59-733347cebf5e None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:59.182031 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 135/250] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:59.183682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0b9ee-206c-4949-bb59-733347cebf5e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:59.203891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04871aba-0126-419a-a110-46fe245d8789 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:59.223426 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:59.244995 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a651d-d83d-4b53-a5e4-695bd8162bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:59.245605 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a651d-d83d-4b53-a5e4-695bd8162bdc None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:59.245974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a651d-d83d-4b53-a5e4-695bd8162bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:59.246248 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a651d-d83d-4b53-a5e4-695bd8162bdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:59.248044 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a651d-d83d-4b53-a5e4-695bd8162bdc None admin] RBAC: Adding query filter params (role.id=e3afb7f30d8240539b9d7139c5ade987, scope.project.id=6f065dd8bbe74892af29e05cef5a6d11, user.id=db99697ddb6c4459bd6c21f30e96daf8) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:59.248413 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a651d-d83d-4b53-a5e4-695bd8162bdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:59.250152 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a651d-d83d-4b53-a5e4-695bd8162bdc None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:59.256418 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 116/251] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:25:59 2022] GET /identity/v3/role_assignments?user.id=db99697ddb6c4459bd6c21f30e96daf8&scope.project.id=6f065dd8bbe74892af29e05cef5a6d11&role.id=e3afb7f30d8240539b9d7139c5ade987 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:25:59.259827 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5a447-f299-4cc0-a42d-b1013fcb1b5a None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:59.259827 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5a447-f299-4cc0-a42d-b1013fcb1b5a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:59.259827 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5a447-f299-4cc0-a42d-b1013fcb1b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:59.280501 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-05f5a447-f299-4cc0-a42d-b1013fcb1b5a None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:59.284770 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-05f5a447-f299-4cc0-a42d-b1013fcb1b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:59.390417 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0b9ee-206c-4949-bb59-733347cebf5e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:59.403542 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 117/252] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:25:59.407145 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdf86c-0bfe-4a3d-917f-28b201be2a0b None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:59.407639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdf86c-0bfe-4a3d-917f-28b201be2a0b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:59.408108 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdf86c-0bfe-4a3d-917f-28b201be2a0b None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:59.409617 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 118/253] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:59.420277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf06cc-e13f-4349-b023-63cb599165a7 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:59.423016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf06cc-e13f-4349-b023-63cb599165a7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:59.423297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf06cc-e13f-4349-b023-63cb599165a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:59.455179 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-5ddf06cc-e13f-4349-b023-63cb599165a7 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:59.457997 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5ddf06cc-e13f-4349-b023-63cb599165a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:59.467308 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4391774-a171-4a16-9cd6-eb809c9020d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:59.468234 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4391774-a171-4a16-9cd6-eb809c9020d4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:59.468514 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4391774-a171-4a16-9cd6-eb809c9020d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:59.468783 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4391774-a171-4a16-9cd6-eb809c9020d4 None admin] PATH_INFO: `/v3/users/b7fda80c065341f9b2199ce5aa986159` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:59.472856 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4391774-a171-4a16-9cd6-eb809c9020d4 None admin] RBAC: Authorizing `identity:get_user(user_id=b7fda80c065341f9b2199ce5aa986159)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:59.475142 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4391774-a171-4a16-9cd6-eb809c9020d4 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:59.478458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 136/254] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:59 2022] GET /identity/v3/users/b7fda80c065341f9b2199ce5aa986159 => generated 297 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:59.481305 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4391774-a171-4a16-9cd6-eb809c9020d4 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:59.581631 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:59.585340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 119/255] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:25:59.586524 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf06cc-e13f-4349-b023-63cb599165a7 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:59.665314 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:59.669090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4391774-a171-4a16-9cd6-eb809c9020d4 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:59.735769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e76a0-c44d-48dd-a902-c7b8209bb71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:59.737115 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e76a0-c44d-48dd-a902-c7b8209bb71e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:59.737680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e76a0-c44d-48dd-a902-c7b8209bb71e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:59.738143 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e76a0-c44d-48dd-a902-c7b8209bb71e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:59.753332 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf06cc-e13f-4349-b023-63cb599165a7 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:59.760566 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e76a0-c44d-48dd-a902-c7b8209bb71e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:59.777324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-d92e76a0-c44d-48dd-a902-c7b8209bb71e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:25:59.777324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:59.777324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:59.777324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:59.777324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:59.777324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:59.777324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:59.777324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:59.777324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:59.777324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:59.777324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:59.777324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:59.777324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:59.777324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:59.777324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:59.777324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:59.778466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:59.778466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:59.778466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:59.778466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:59.778466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:59.778466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:59.778466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:59.778466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:59.778466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:59.778466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:59.778466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:59.778466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:59.778466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:59.778466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:59.778466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:59.778466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:59.779858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:59.779858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:59.779858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:59.779858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:59.779858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:59.779858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:59.779858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:59.779858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:59.779858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:59.779858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:59.779858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:25:59.779858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:25:59.782147 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 137/256] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 13:25:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:59.784650 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e76a0-c44d-48dd-a902-c7b8209bb71e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:59.827460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe859e-b4b4-41e2-9e13-5d1604df9d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:59.828631 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe859e-b4b4-41e2-9e13-5d1604df9d93 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:59.829104 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe859e-b4b4-41e2-9e13-5d1604df9d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:59.829511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe859e-b4b4-41e2-9e13-5d1604df9d93 None admin] PATH_INFO: `/v3/projects/6f065dd8bbe74892af29e05cef5a6d11` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:59.832124 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe859e-b4b4-41e2-9e13-5d1604df9d93 None admin] RBAC: Authorizing `identity:get_project(project_id=6f065dd8bbe74892af29e05cef5a6d11)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:59.834443 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe859e-b4b4-41e2-9e13-5d1604df9d93 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:59.836344 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 120/257] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:25:59 2022] GET /identity/v3/projects/6f065dd8bbe74892af29e05cef5a6d11 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:59.837917 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe859e-b4b4-41e2-9e13-5d1604df9d93 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:59.968471 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e76a0-c44d-48dd-a902-c7b8209bb71e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:59.988016 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:59.990711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe859e-b4b4-41e2-9e13-5d1604df9d93 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:00.002074 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:00.040028 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80bae3-d921-45b2-b9e2-a72c3840da2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:00.041905 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80bae3-d921-45b2-b9e2-a72c3840da2f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:00.042739 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47dcb4-f04a-4d8e-b809-73001f8928a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:00.043174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80bae3-d921-45b2-b9e2-a72c3840da2f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:00.043979 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47dcb4-f04a-4d8e-b809-73001f8928a6 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:00.044421 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80bae3-d921-45b2-b9e2-a72c3840da2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:00.045378 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47dcb4-f04a-4d8e-b809-73001f8928a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:00.045993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47dcb4-f04a-4d8e-b809-73001f8928a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:00.051488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47dcb4-f04a-4d8e-b809-73001f8928a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:00.051848 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47dcb4-f04a-4d8e-b809-73001f8928a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:00.053296 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47dcb4-f04a-4d8e-b809-73001f8928a6 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:00.057095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80bae3-d921-45b2-b9e2-a72c3840da2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:00.065096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-1c80bae3-d921-45b2-b9e2-a72c3840da2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:26:00.065096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:00.065096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:00.065096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:00.065096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:00.065096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:00.065096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:00.065096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:00.065096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:00.065096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:00.065096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:00.065096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:00.065096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:00.065096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:00.065096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:00.065096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:00.066196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:00.066196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:00.066196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:00.066196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:00.066196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:00.066196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:00.066196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:00.066196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:00.066196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:00.066196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:00.066196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:00.066196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:00.066196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:00.066196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:00.066196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:00.066196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:00.067105 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:00.067105 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:00.067105 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:00.067105 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:00.067105 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:00.067105 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:00.067105 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:00.067105 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:00.067105 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:00.067105 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:00.067105 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:26:00.067105 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:00.069046 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 138/259] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:25:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:00.069240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 121/259] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:25:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:00.070084 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80bae3-d921-45b2-b9e2-a72c3840da2f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:00.078367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47dcb4-f04a-4d8e-b809-73001f8928a6 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:00.244776 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47dcb4-f04a-4d8e-b809-73001f8928a6 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:00.250615 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80bae3-d921-45b2-b9e2-a72c3840da2f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:00.285184 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf757d01-9cbc-4003-bae1-ad41b29cabd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:00.286461 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf757d01-9cbc-4003-bae1-ad41b29cabd1 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:00.286932 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf757d01-9cbc-4003-bae1-ad41b29cabd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:00.287393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf757d01-9cbc-4003-bae1-ad41b29cabd1 None admin] PATH_INFO: `/v3/projects/6f065dd8bbe74892af29e05cef5a6d11/users/b7fda80c065341f9b2199ce5aa986159/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:00.289563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf757d01-9cbc-4003-bae1-ad41b29cabd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f065dd8bbe74892af29e05cef5a6d11, user_id=b7fda80c065341f9b2199ce5aa986159, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:00.291254 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf757d01-9cbc-4003-bae1-ad41b29cabd1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:00.310134 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 139/260] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 13:26:00 2022] PUT /identity/v3/projects/6f065dd8bbe74892af29e05cef5a6d11/users/b7fda80c065341f9b2199ce5aa986159/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:26:00.311525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf757d01-9cbc-4003-bae1-ad41b29cabd1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:00.321895 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c2bea-14b8-4ffe-b815-4c37237bca1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:00.322844 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c2bea-14b8-4ffe-b815-4c37237bca1f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:00.323132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c2bea-14b8-4ffe-b815-4c37237bca1f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:00.323408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c2bea-14b8-4ffe-b815-4c37237bca1f None admin] PATH_INFO: `/v3/users/bd585605d2964b9bbbd7b4f741fecdbc` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:00.324968 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c2bea-14b8-4ffe-b815-4c37237bca1f None admin] RBAC: Authorizing `identity:get_user(user_id=bd585605d2964b9bbbd7b4f741fecdbc)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:00.326616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c2bea-14b8-4ffe-b815-4c37237bca1f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:00.332587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 122/261] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:26:00 2022] GET /identity/v3/users/bd585605d2964b9bbbd7b4f741fecdbc => generated 283 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:26:00.333932 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c2bea-14b8-4ffe-b815-4c37237bca1f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:00.350157 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:00.426951 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:00.443069 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf757d01-9cbc-4003-bae1-ad41b29cabd1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:00.486376 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d2680-32df-41a7-8df0-8ceecfb785d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:00.487931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d2680-32df-41a7-8df0-8ceecfb785d5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:00.488629 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d2680-32df-41a7-8df0-8ceecfb785d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:00.489094 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d2680-32df-41a7-8df0-8ceecfb785d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:00.490053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d2680-32df-41a7-8df0-8ceecfb785d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:00.490589 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d2680-32df-41a7-8df0-8ceecfb785d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:00.492909 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d2680-32df-41a7-8df0-8ceecfb785d5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:00.504215 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 140/262] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:00.519135 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d2680-32df-41a7-8df0-8ceecfb785d5 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:00.559881 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c2bea-14b8-4ffe-b815-4c37237bca1f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:00.640352 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb7851-21ca-44c4-8ac7-83a48d2cd41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:00.641024 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb7851-21ca-44c4-8ac7-83a48d2cd41f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:00.641309 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb7851-21ca-44c4-8ac7-83a48d2cd41f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:00.641584 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb7851-21ca-44c4-8ac7-83a48d2cd41f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:00.689029 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:00.700691 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d2680-32df-41a7-8df0-8ceecfb785d5 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:00.763667 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6ca98-ce55-438b-871a-5568892e7688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:00.768319 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6ca98-ce55-438b-871a-5568892e7688 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:00.768319 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6ca98-ce55-438b-871a-5568892e7688 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:00.768506 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb7851-21ca-44c4-8ac7-83a48d2cd41f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:00.768580 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6ca98-ce55-438b-871a-5568892e7688 None admin] PATH_INFO: `/v3/users/bd585605d2964b9bbbd7b4f741fecdbc` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:00.768580 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6ca98-ce55-438b-871a-5568892e7688 None admin] RBAC: Authorizing `identity:get_user(user_id=bd585605d2964b9bbbd7b4f741fecdbc)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:00.768729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb7851-21ca-44c4-8ac7-83a48d2cd41f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:00.768795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6ca98-ce55-438b-871a-5568892e7688 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:00.769741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 141/263] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:26:00 2022] GET /identity/v3/users/bd585605d2964b9bbbd7b4f741fecdbc => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:26:00.775647 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6ca98-ce55-438b-871a-5568892e7688 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:00.824224 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:00.916610 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 123/264] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:26:00.921837 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb7851-21ca-44c4-8ac7-83a48d2cd41f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:00.937538 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6ca98-ce55-438b-871a-5568892e7688 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:00.994005 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352c344-bdf6-49d5-bbed-841ead95d7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:00.994703 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352c344-bdf6-49d5-bbed-841ead95d7da None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:00.994987 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352c344-bdf6-49d5-bbed-841ead95d7da None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:00.995262 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352c344-bdf6-49d5-bbed-841ead95d7da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:01.047851 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb7851-21ca-44c4-8ac7-83a48d2cd41f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:01.056990 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:01.096793 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432887c5-a6b0-4b8c-a981-ca1b7fd310e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:01.098080 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432887c5-a6b0-4b8c-a981-ca1b7fd310e3 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:01.098555 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432887c5-a6b0-4b8c-a981-ca1b7fd310e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:01.099062 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432887c5-a6b0-4b8c-a981-ca1b7fd310e3 None admin] PATH_INFO: `/v3/projects/6f065dd8bbe74892af29e05cef5a6d11` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:01.103354 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432887c5-a6b0-4b8c-a981-ca1b7fd310e3 None admin] RBAC: Authorizing `identity:get_project(project_id=6f065dd8bbe74892af29e05cef5a6d11)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:01.105046 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432887c5-a6b0-4b8c-a981-ca1b7fd310e3 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:01.107020 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 124/265] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:26:00 2022] GET /identity/v3/projects/6f065dd8bbe74892af29e05cef5a6d11 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:01.115645 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352c344-bdf6-49d5-bbed-841ead95d7da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:01.117115 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352c344-bdf6-49d5-bbed-841ead95d7da None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:01.123963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432887c5-a6b0-4b8c-a981-ca1b7fd310e3 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:01.139148 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:01.278962 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432887c5-a6b0-4b8c-a981-ca1b7fd310e3 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:01.308840 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 142/266] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:01.317305 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352c344-bdf6-49d5-bbed-841ead95d7da None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:01.325165 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8ad33-5b27-4171-8142-b94df2844de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:01.326140 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8ad33-5b27-4171-8142-b94df2844de5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:01.326803 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8ad33-5b27-4171-8142-b94df2844de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:01.327287 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8ad33-5b27-4171-8142-b94df2844de5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:01.328373 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8ad33-5b27-4171-8142-b94df2844de5 None admin] RBAC: Adding query filter params (role.id=f63a52fb33144307bba2318551138669, scope.project.id=6f065dd8bbe74892af29e05cef5a6d11, user.id=bd585605d2964b9bbbd7b4f741fecdbc) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:01.328902 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8ad33-5b27-4171-8142-b94df2844de5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:01.330615 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8ad33-5b27-4171-8142-b94df2844de5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:01.342676 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 125/267] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:26:01 2022] GET /identity/v3/role_assignments?user.id=bd585605d2964b9bbbd7b4f741fecdbc&scope.project.id=6f065dd8bbe74892af29e05cef5a6d11&role.id=f63a52fb33144307bba2318551138669 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:01.418378 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:01.467654 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352c344-bdf6-49d5-bbed-841ead95d7da None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:01.522356 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e79e5-0b21-4089-b2b4-3f940c86ddc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:01.523294 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e79e5-0b21-4089-b2b4-3f940c86ddc7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:01.523570 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e79e5-0b21-4089-b2b4-3f940c86ddc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:01.523837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e79e5-0b21-4089-b2b4-3f940c86ddc7 None admin] PATH_INFO: `/v3/projects/6f065dd8bbe74892af29e05cef5a6d11` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:01.531623 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e79e5-0b21-4089-b2b4-3f940c86ddc7 None admin] RBAC: Authorizing `identity:get_project(project_id=6f065dd8bbe74892af29e05cef5a6d11)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:01.533121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e79e5-0b21-4089-b2b4-3f940c86ddc7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:01.535322 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 143/268] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:26:01 2022] GET /identity/v3/projects/6f065dd8bbe74892af29e05cef5a6d11 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:01.541031 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8ad33-5b27-4171-8142-b94df2844de5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:01.675618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:01.717201 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8ad33-5b27-4171-8142-b94df2844de5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:01.764631 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddf1dd-4fda-4c60-a91b-1155b0d4d49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:01.765360 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddf1dd-4fda-4c60-a91b-1155b0d4d49e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:01.765653 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddf1dd-4fda-4c60-a91b-1155b0d4d49e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:01.765929 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddf1dd-4fda-4c60-a91b-1155b0d4d49e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:01.766798 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ddf1dd-4fda-4c60-a91b-1155b0d4d49e None admin] RBAC: Adding query filter params (role.id=6edd584a77084fa78240661ea76cddb5, scope.project.id=6f065dd8bbe74892af29e05cef5a6d11, user.id=bd585605d2964b9bbbd7b4f741fecdbc) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:01.767112 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ddf1dd-4fda-4c60-a91b-1155b0d4d49e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:01.768558 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ddf1dd-4fda-4c60-a91b-1155b0d4d49e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:01.775363 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 126/269] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:26:01 2022] GET /identity/v3/role_assignments?user.id=bd585605d2964b9bbbd7b4f741fecdbc&scope.project.id=6f065dd8bbe74892af29e05cef5a6d11&role.id=6edd584a77084fa78240661ea76cddb5 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:01.908140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6c67c-e73d-43eb-a2f3-13b129be4a6c None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:01.908817 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6c67c-e73d-43eb-a2f3-13b129be4a6c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:01.909291 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6c67c-e73d-43eb-a2f3-13b129be4a6c None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:01.911303 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 144/270] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:01.917572 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762c89f-8b8d-40f0-9679-68d32d2c1b06 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:01.917855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762c89f-8b8d-40f0-9679-68d32d2c1b06 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:01.918143 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762c89f-8b8d-40f0-9679-68d32d2c1b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:01.940268 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-a762c89f-8b8d-40f0-9679-68d32d2c1b06 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:01.941492 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a762c89f-8b8d-40f0-9679-68d32d2c1b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:02.003666 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4921de9-a071-4657-aa4d-f0ef2fdd2b4c None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:02.004277 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4921de9-a071-4657-aa4d-f0ef2fdd2b4c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:02.004741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4921de9-a071-4657-aa4d-f0ef2fdd2b4c None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:02.006327 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 145/271] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:02.011660 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07658b-675d-4c17-8b2f-038f8f62c645 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:02.012224 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07658b-675d-4c17-8b2f-038f8f62c645 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:02.012682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07658b-675d-4c17-8b2f-038f8f62c645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:02.029700 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 127/272] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:02.042974 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ce07658b-675d-4c17-8b2f-038f8f62c645 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:02.044172 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ce07658b-675d-4c17-8b2f-038f8f62c645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:02.062637 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762c89f-8b8d-40f0-9679-68d32d2c1b06 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:02.149137 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 146/273] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:26:02.159091 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:02.187802 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07658b-675d-4c17-8b2f-038f8f62c645 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:02.210601 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762c89f-8b8d-40f0-9679-68d32d2c1b06 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:02.263777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff944d-3cdb-4c15-baaf-a6f5fed1fe13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:02.265027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff944d-3cdb-4c15-baaf-a6f5fed1fe13 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:02.265545 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff944d-3cdb-4c15-baaf-a6f5fed1fe13 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:02.265827 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff944d-3cdb-4c15-baaf-a6f5fed1fe13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:02.272478 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:02.279288 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff944d-3cdb-4c15-baaf-a6f5fed1fe13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:02.289049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-51ff944d-3cdb-4c15-baaf-a6f5fed1fe13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:26:02.289049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:02.289049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:02.289049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:02.289049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:02.289049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:02.289049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:02.289049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:02.289049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:02.289049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:02.289049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:02.289049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:02.289049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:02.289049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:02.289049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:02.289049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:02.290168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:02.290168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:02.290168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:02.290168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:02.290168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:02.290168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:02.290168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:02.290168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:02.290168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:02.290168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:02.290168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:02.290168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:02.290168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:02.290168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:02.290168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:02.290168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:02.291220 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:02.291220 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:02.291220 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:02.291220 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:02.291220 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:02.291220 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:02.291220 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:02.291220 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:02.291220 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:02.291220 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:02.291220 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:26:02.291220 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:02.293464 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 128/274] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:26:02.304705 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff944d-3cdb-4c15-baaf-a6f5fed1fe13 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:02.325422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07658b-675d-4c17-8b2f-038f8f62c645 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:02.366604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14aa772-1820-430c-9619-737fe7a735f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:02.367513 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14aa772-1820-430c-9619-737fe7a735f4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:02.367742 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14aa772-1820-430c-9619-737fe7a735f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:02.368006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14aa772-1820-430c-9619-737fe7a735f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:02.369379 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14aa772-1820-430c-9619-737fe7a735f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:02.370962 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14aa772-1820-430c-9619-737fe7a735f4 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:02.377625 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 147/275] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:26:02.378652 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14aa772-1820-430c-9619-737fe7a735f4 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:02.438440 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff944d-3cdb-4c15-baaf-a6f5fed1fe13 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:02.463366 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:02.475995 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f28e62-a068-452e-9d18-20d9ef544c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:02.476897 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f28e62-a068-452e-9d18-20d9ef544c6e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:02.477319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f28e62-a068-452e-9d18-20d9ef544c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:02.477736 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f28e62-a068-452e-9d18-20d9ef544c6e None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:02.478663 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f28e62-a068-452e-9d18-20d9ef544c6e None admin] RBAC: Adding query filter params (name=member) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:02.478972 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f28e62-a068-452e-9d18-20d9ef544c6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:02.480331 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f28e62-a068-452e-9d18-20d9ef544c6e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:02.485501 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14aa772-1820-430c-9619-737fe7a735f4 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:02.489410 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 129/276] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:26:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:02.494973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03642515-e026-4bf6-b833-ce428918aeec None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:02.495251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03642515-e026-4bf6-b833-ce428918aeec None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:02.495526 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03642515-e026-4bf6-b833-ce428918aeec None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:02.496792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 130/277] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:02.497484 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03642515-e026-4bf6-b833-ce428918aeec None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:02.516603 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:02.524823 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624d3bc-2651-4c6e-a9e7-49296bee4629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:02.525589 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624d3bc-2651-4c6e-a9e7-49296bee4629 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:02.525876 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624d3bc-2651-4c6e-a9e7-49296bee4629 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:02.526151 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624d3bc-2651-4c6e-a9e7-49296bee4629 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:02.526893 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624d3bc-2651-4c6e-a9e7-49296bee4629 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:02.528332 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624d3bc-2651-4c6e-a9e7-49296bee4629 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:02.558353 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 148/278] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 13:26:02 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:26:02.558353 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524f6b4-93b9-4cf1-8736-25543af6d4a8 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:02.558353 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524f6b4-93b9-4cf1-8736-25543af6d4a8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:02.558353 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524f6b4-93b9-4cf1-8736-25543af6d4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:02.572868 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2524f6b4-93b9-4cf1-8736-25543af6d4a8 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:02.574125 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2524f6b4-93b9-4cf1-8736-25543af6d4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:02.625229 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03642515-e026-4bf6-b833-ce428918aeec None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:02.657221 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 149/279] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:02.664949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb3f4d-65ca-4ab0-8fcd-49a383e26880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:02.665945 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb3f4d-65ca-4ab0-8fcd-49a383e26880 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:02.666290 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb3f4d-65ca-4ab0-8fcd-49a383e26880 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:02.666661 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb3f4d-65ca-4ab0-8fcd-49a383e26880 None admin] PATH_INFO: `/v3/users/7642e115ee3641e0b6e150dc261d1233` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:02.680821 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524f6b4-93b9-4cf1-8736-25543af6d4a8 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:02.682858 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb3f4d-65ca-4ab0-8fcd-49a383e26880 None admin] RBAC: Authorizing `identity:get_user(user_id=7642e115ee3641e0b6e150dc261d1233)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:02.684502 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb3f4d-65ca-4ab0-8fcd-49a383e26880 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:02.686609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 131/280] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:26:02 2022] GET /identity/v3/users/7642e115ee3641e0b6e150dc261d1233 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:02.692754 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb3f4d-65ca-4ab0-8fcd-49a383e26880 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:02.745385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:02.792146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524f6b4-93b9-4cf1-8736-25543af6d4a8 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:02.808830 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb3f4d-65ca-4ab0-8fcd-49a383e26880 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:02.814697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:02.851623 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0575d78-03e0-4b1e-bccc-d35394ed82c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:02.852450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0575d78-03e0-4b1e-bccc-d35394ed82c2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:02.852722 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0575d78-03e0-4b1e-bccc-d35394ed82c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:02.852989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0575d78-03e0-4b1e-bccc-d35394ed82c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:02.857933 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b74eb-d678-4fbd-bcac-ceee151acb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:02.858921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b74eb-d678-4fbd-bcac-ceee151acb43 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:02.859398 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b74eb-d678-4fbd-bcac-ceee151acb43 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:02.859863 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b74eb-d678-4fbd-bcac-ceee151acb43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:02.860889 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b74eb-d678-4fbd-bcac-ceee151acb43 None admin] RBAC: Adding query filter params (role.id=891bd78dbb334259bdef8495ca3f4132, user.id=7642e115ee3641e0b6e150dc261d1233, scope.system=all) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:02.861397 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b74eb-d678-4fbd-bcac-ceee151acb43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:02.863049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b74eb-d678-4fbd-bcac-ceee151acb43 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:02.865629 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0575d78-03e0-4b1e-bccc-d35394ed82c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:02.869722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 132/281] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Jun 2 13:26:02 2022] GET /identity/v3/role_assignments?user.id=7642e115ee3641e0b6e150dc261d1233&scope.system=all&role.id=891bd78dbb334259bdef8495ca3f4132 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:26:02.875160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-f0575d78-03e0-4b1e-bccc-d35394ed82c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:26:02.875160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:02.875160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:02.875160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:02.875160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:02.875160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:02.875160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:02.875160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:02.875160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:02.875160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:02.875160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:02.875160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:02.875160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:02.875160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:02.875160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:02.875160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:02.876114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:02.876114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:02.876114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:02.876114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:02.876114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:02.876114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:02.876114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:02.876114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:02.876114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:02.876114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:02.876114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:02.876114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:02.876114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:02.876114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:02.876114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:02.876114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:02.876902 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:02.876902 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:02.876902 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:02.876902 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:02.876902 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:02.876902 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:02.876902 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:02.876902 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:02.876902 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:02.876902 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:02.876902 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:26:02.876902 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:02.876902 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 150/282] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:26:02.883456 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b74eb-d678-4fbd-bcac-ceee151acb43 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:03.010985 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b74eb-d678-4fbd-bcac-ceee151acb43 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:03.021967 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:03.052984 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f981e-1d00-4120-a104-6cf5c87b97bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:03.053692 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f981e-1d00-4120-a104-6cf5c87b97bf None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:03.053972 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f981e-1d00-4120-a104-6cf5c87b97bf None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:03.054242 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f981e-1d00-4120-a104-6cf5c87b97bf None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:03.055098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f981e-1d00-4120-a104-6cf5c87b97bf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:03.055403 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f981e-1d00-4120-a104-6cf5c87b97bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:03.056848 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f981e-1d00-4120-a104-6cf5c87b97bf None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:03.067771 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 133/283] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:26:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:03.074114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0575d78-03e0-4b1e-bccc-d35394ed82c2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:03.183657 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0575d78-03e0-4b1e-bccc-d35394ed82c2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:03.228080 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168916a7-937c-46a1-b993-6a84af779392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:03.229141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168916a7-937c-46a1-b993-6a84af779392 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:03.229418 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168916a7-937c-46a1-b993-6a84af779392 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:03.229680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168916a7-937c-46a1-b993-6a84af779392 None admin] PATH_INFO: `/v3/users/db99697ddb6c4459bd6c21f30e96daf8` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:03.230966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168916a7-937c-46a1-b993-6a84af779392 None admin] RBAC: Authorizing `identity:get_user(user_id=db99697ddb6c4459bd6c21f30e96daf8)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:03.232423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168916a7-937c-46a1-b993-6a84af779392 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:03.234466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 151/284] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:26:03 2022] GET /identity/v3/users/db99697ddb6c4459bd6c21f30e96daf8 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:03.240007 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f981e-1d00-4120-a104-6cf5c87b97bf None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:03.363680 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f981e-1d00-4120-a104-6cf5c87b97bf None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:03.407001 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce5856-1ada-45d8-9605-db9b82093eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:03.407897 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce5856-1ada-45d8-9605-db9b82093eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:03.408171 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce5856-1ada-45d8-9605-db9b82093eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:03.408438 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce5856-1ada-45d8-9605-db9b82093eb2 None admin] PATH_INFO: `/v3/projects/6f065dd8bbe74892af29e05cef5a6d11` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:03.409611 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce5856-1ada-45d8-9605-db9b82093eb2 None admin] RBAC: Authorizing `identity:get_project(project_id=6f065dd8bbe74892af29e05cef5a6d11)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:03.411324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce5856-1ada-45d8-9605-db9b82093eb2 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:03.413088 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 134/285] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:26:03 2022] GET /identity/v3/projects/6f065dd8bbe74892af29e05cef5a6d11 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:03.418971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168916a7-937c-46a1-b993-6a84af779392 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:03.474156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:03.509194 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20c245-59db-44a5-ae88-2ebc8daa9cf4 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:03.509510 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20c245-59db-44a5-ae88-2ebc8daa9cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:03.509735 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20c245-59db-44a5-ae88-2ebc8daa9cf4 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:03.511135 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 135/286] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:26:03.516739 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ea5b3-3e83-4598-9b99-53079cc24a36 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:03.517020 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ea5b3-3e83-4598-9b99-53079cc24a36 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:03.517292 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ea5b3-3e83-4598-9b99-53079cc24a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:03.541883 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168916a7-937c-46a1-b993-6a84af779392 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:03.555036 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-f15ea5b3-3e83-4598-9b99-53079cc24a36 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:03.556307 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f15ea5b3-3e83-4598-9b99-53079cc24a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:03.577770 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df6818-2977-43bc-9988-b4018d944f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:03.578853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df6818-2977-43bc-9988-b4018d944f82 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:03.579129 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df6818-2977-43bc-9988-b4018d944f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:03.579399 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df6818-2977-43bc-9988-b4018d944f82 None admin] PATH_INFO: `/v3/projects/6f065dd8bbe74892af29e05cef5a6d11/users/db99697ddb6c4459bd6c21f30e96daf8/roles/e3afb7f30d8240539b9d7139c5ade987` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:03.581425 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df6818-2977-43bc-9988-b4018d944f82 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f065dd8bbe74892af29e05cef5a6d11, user_id=db99697ddb6c4459bd6c21f30e96daf8, role_id=e3afb7f30d8240539b9d7139c5ade987)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:03.582926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df6818-2977-43bc-9988-b4018d944f82 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:03.601359 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 152/287] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 13:26:03 2022] PUT /identity/v3/projects/6f065dd8bbe74892af29e05cef5a6d11/users/db99697ddb6c4459bd6c21f30e96daf8/roles/e3afb7f30d8240539b9d7139c5ade987 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:26:03.616145 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:03.685110 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 136/288] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:26:03.724203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df6818-2977-43bc-9988-b4018d944f82 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:03.845035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df6818-2977-43bc-9988-b4018d944f82 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:03.846868 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:03.895068 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f94a2-5454-41d3-ac97-afa5e0e469bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:03.895798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f94a2-5454-41d3-ac97-afa5e0e469bd None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:03.896075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f94a2-5454-41d3-ac97-afa5e0e469bd None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:03.896345 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f94a2-5454-41d3-ac97-afa5e0e469bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:03.916077 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f94a2-5454-41d3-ac97-afa5e0e469bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:03.924006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-741f94a2-5454-41d3-ac97-afa5e0e469bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:26:03.924006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:03.924006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:03.924006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:03.924006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:03.924006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:03.924006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:03.924006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:03.924006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:03.924006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:03.924006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:03.924006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:03.924006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:03.924006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:03.924006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:03.924006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:03.924908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:03.924908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:03.924908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:03.924908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:03.924908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:03.924908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:03.924908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:03.924908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:03.924908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:03.924908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:03.924908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:03.924908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:03.924908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:03.924908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:03.924908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:03.924908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:03.926213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:03.926213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:03.926213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:03.926213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:03.926213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:03.926213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:03.926213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:03.926213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:03.926213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:03.926213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:03.926213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:26:03.926213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:03.926213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 153/289] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:03.935611 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ea5b3-3e83-4598-9b99-53079cc24a36 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:04.078504 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ea5b3-3e83-4598-9b99-53079cc24a36 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:04.113728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9473daf-3eb1-4687-8aba-1d17002e3fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:04.114391 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9473daf-3eb1-4687-8aba-1d17002e3fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:04.114713 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9473daf-3eb1-4687-8aba-1d17002e3fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:04.114989 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9473daf-3eb1-4687-8aba-1d17002e3fd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:04.115746 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9473daf-3eb1-4687-8aba-1d17002e3fd1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:04.116047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9473daf-3eb1-4687-8aba-1d17002e3fd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:04.117412 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9473daf-3eb1-4687-8aba-1d17002e3fd1 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:04.126628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 137/290] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:26:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:04.132249 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f94a2-5454-41d3-ac97-afa5e0e469bd None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:04.290150 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f94a2-5454-41d3-ac97-afa5e0e469bd None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:04.336585 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69457e8-c3f1-41f0-99e2-660131b76062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:04.337871 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69457e8-c3f1-41f0-99e2-660131b76062 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:04.338346 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69457e8-c3f1-41f0-99e2-660131b76062 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:04.338837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69457e8-c3f1-41f0-99e2-660131b76062 None admin] PATH_INFO: `/v3/users/b7fda80c065341f9b2199ce5aa986159` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:04.343382 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69457e8-c3f1-41f0-99e2-660131b76062 None admin] RBAC: Authorizing `identity:get_user(user_id=b7fda80c065341f9b2199ce5aa986159)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:04.345144 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69457e8-c3f1-41f0-99e2-660131b76062 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:04.347045 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 154/291] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:26:04 2022] GET /identity/v3/users/b7fda80c065341f9b2199ce5aa986159 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:04.352996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9473daf-3eb1-4687-8aba-1d17002e3fd1 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:04.403315 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:04.485889 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9473daf-3eb1-4687-8aba-1d17002e3fd1 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:04.520600 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d580b7-c09e-44d6-bc07-0d9bbc85b51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:04.521273 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d580b7-c09e-44d6-bc07-0d9bbc85b51e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:04.521560 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d580b7-c09e-44d6-bc07-0d9bbc85b51e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:04.521841 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d580b7-c09e-44d6-bc07-0d9bbc85b51e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:04.592781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d580b7-c09e-44d6-bc07-0d9bbc85b51e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:04.594141 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d580b7-c09e-44d6-bc07-0d9bbc85b51e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:04.624046 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:04.696833 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 138/292] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:04.703214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69457e8-c3f1-41f0-99e2-660131b76062 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:04.763312 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:04.866913 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69457e8-c3f1-41f0-99e2-660131b76062 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:04.916265 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a9ae8-fdee-42e0-b153-dcaf3a4b1b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:04.917150 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a9ae8-fdee-42e0-b153-dcaf3a4b1b29 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:04.917426 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a9ae8-fdee-42e0-b153-dcaf3a4b1b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:04.917699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a9ae8-fdee-42e0-b153-dcaf3a4b1b29 None admin] PATH_INFO: `/v3/projects/6f065dd8bbe74892af29e05cef5a6d11` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:04.923307 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a9ae8-fdee-42e0-b153-dcaf3a4b1b29 None admin] RBAC: Authorizing `identity:get_project(project_id=6f065dd8bbe74892af29e05cef5a6d11)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:04.924766 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a9ae8-fdee-42e0-b153-dcaf3a4b1b29 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:04.926486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 155/293] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:26:04 2022] GET /identity/v3/projects/6f065dd8bbe74892af29e05cef5a6d11 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:04.932582 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d580b7-c09e-44d6-bc07-0d9bbc85b51e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:05.086376 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d580b7-c09e-44d6-bc07-0d9bbc85b51e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:05.119374 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:05.130060 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241065f-85b4-464c-ab7a-d5a37e66346c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:05.130995 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241065f-85b4-464c-ab7a-d5a37e66346c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:05.131418 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241065f-85b4-464c-ab7a-d5a37e66346c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:05.131836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241065f-85b4-464c-ab7a-d5a37e66346c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:05.132817 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241065f-85b4-464c-ab7a-d5a37e66346c None admin] RBAC: Adding query filter params (role.id=891bd78dbb334259bdef8495ca3f4132, scope.project.id=6f065dd8bbe74892af29e05cef5a6d11, user.id=b7fda80c065341f9b2199ce5aa986159) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:05.133293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241065f-85b4-464c-ab7a-d5a37e66346c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:05.134906 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241065f-85b4-464c-ab7a-d5a37e66346c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:05.147897 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 139/294] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:26:04 2022] GET /identity/v3/role_assignments?user.id=b7fda80c065341f9b2199ce5aa986159&scope.project.id=6f065dd8bbe74892af29e05cef5a6d11&role.id=891bd78dbb334259bdef8495ca3f4132 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:05.508687 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbd8c0-11d3-48f0-a1a2-0cf3969b6d66 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:05.509076 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbd8c0-11d3-48f0-a1a2-0cf3969b6d66 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:05.509274 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbd8c0-11d3-48f0-a1a2-0cf3969b6d66 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:05.510953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 156/295] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:05.516537 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446ced3-57c2-4891-ab63-79ee8e171b77 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:05.516833 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446ced3-57c2-4891-ab63-79ee8e171b77 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:05.517098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446ced3-57c2-4891-ab63-79ee8e171b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:05.535435 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-5446ced3-57c2-4891-ab63-79ee8e171b77 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:05.536617 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5446ced3-57c2-4891-ab63-79ee8e171b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:05.545148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050e99d-6e68-4356-bb2e-06b744a56160 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:05.546113 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050e99d-6e68-4356-bb2e-06b744a56160 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:05.546402 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050e99d-6e68-4356-bb2e-06b744a56160 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:05.547831 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 157/296] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:05.553073 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a269d3-e4c3-4cb6-8ba7-9a478ede3d53 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:05.553601 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a269d3-e4c3-4cb6-8ba7-9a478ede3d53 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:05.554071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a269d3-e4c3-4cb6-8ba7-9a478ede3d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:05.578192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-06a269d3-e4c3-4cb6-8ba7-9a478ede3d53 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:05.579831 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-06a269d3-e4c3-4cb6-8ba7-9a478ede3d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:05.618317 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 140/297] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:05.657884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446ced3-57c2-4891-ab63-79ee8e171b77 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:05.700057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 158/298] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:05.726683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a269d3-e4c3-4cb6-8ba7-9a478ede3d53 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:05.760116 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:05.796365 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446ced3-57c2-4891-ab63-79ee8e171b77 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:05.833494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:05.848361 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134ca36-6e5e-4360-91a1-6127de1b69a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:05.849393 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134ca36-6e5e-4360-91a1-6127de1b69a4 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:05.849809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134ca36-6e5e-4360-91a1-6127de1b69a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:05.850252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134ca36-6e5e-4360-91a1-6127de1b69a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:05.851598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134ca36-6e5e-4360-91a1-6127de1b69a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:05.853163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134ca36-6e5e-4360-91a1-6127de1b69a4 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:05.855005 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a269d3-e4c3-4cb6-8ba7-9a478ede3d53 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:05.855395 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 141/299] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:26:05.862657 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134ca36-6e5e-4360-91a1-6127de1b69a4 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:05.900543 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4bae3f-1a0c-47a4-baef-26779df617a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:05.901841 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4bae3f-1a0c-47a4-baef-26779df617a7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:05.902405 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4bae3f-1a0c-47a4-baef-26779df617a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:05.903035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4bae3f-1a0c-47a4-baef-26779df617a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:05.917960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4bae3f-1a0c-47a4-baef-26779df617a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:05.928480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-5c4bae3f-1a0c-47a4-baef-26779df617a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:26:05.928480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:05.928480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:05.928480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:05.928480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:05.928480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:05.928480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:05.928480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:05.928480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:05.928480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:05.928480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:05.928480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:05.928480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:05.928480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:05.928480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:05.928480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:05.929410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:05.929410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:05.929410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:05.929410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:05.929410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:05.929410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:05.929410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:05.929410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:05.929410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:05.929410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:05.929410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:05.929410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:05.929410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:05.929410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:05.929410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:05.929410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:05.930192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:05.930192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:05.930192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:05.930192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:05.930192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:05.930192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:05.930192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:05.930192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:05.930192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:05.930192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:05.930192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:26:05.930192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:05.933182 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 159/300] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:05.939970 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4bae3f-1a0c-47a4-baef-26779df617a7 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:05.993840 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134ca36-6e5e-4360-91a1-6127de1b69a4 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:06.031146 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66c50c-a922-44c6-ada0-0f00ed4121d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:06.031750 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66c50c-a922-44c6-ada0-0f00ed4121d6 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:06.032030 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66c50c-a922-44c6-ada0-0f00ed4121d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:06.032297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66c50c-a922-44c6-ada0-0f00ed4121d6 None admin] PATH_INFO: `/v3/groups` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:06.033397 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66c50c-a922-44c6-ada0-0f00ed4121d6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:06.034867 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66c50c-a922-44c6-ada0-0f00ed4121d6 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:06.046782 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:06.054389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 142/301] 10.222.0.18 () {60 vars in 1134 bytes} [Thu Jun 2 13:26:05 2022] POST /identity/v3/groups => generated 229 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:26:06.062800 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4bae3f-1a0c-47a4-baef-26779df617a7 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:06.062916 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59ab87-4b89-4553-8f90-828c2a3cb17c None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:06.062916 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59ab87-4b89-4553-8f90-828c2a3cb17c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:06.062916 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59ab87-4b89-4553-8f90-828c2a3cb17c None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:06.062916 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 143/302] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:06.069469 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c4315-68bb-425f-9903-91c3278b5f4b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:06.069815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c4315-68bb-425f-9903-91c3278b5f4b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:06.070088 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c4315-68bb-425f-9903-91c3278b5f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:06.089088 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d70c4315-68bb-425f-9903-91c3278b5f4b None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:06.090372 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d70c4315-68bb-425f-9903-91c3278b5f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:06.106750 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234f9cc-039e-4a22-9402-093ee17c0e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:06.107705 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234f9cc-039e-4a22-9402-093ee17c0e61 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:06.107987 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234f9cc-039e-4a22-9402-093ee17c0e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:06.108257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234f9cc-039e-4a22-9402-093ee17c0e61 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:06.109034 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234f9cc-039e-4a22-9402-093ee17c0e61 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:06.109338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234f9cc-039e-4a22-9402-093ee17c0e61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:06.110793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234f9cc-039e-4a22-9402-093ee17c0e61 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:06.125330 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 160/303] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:26:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:26:06.126336 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234f9cc-039e-4a22-9402-093ee17c0e61 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:06.146016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:06.179065 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 144/304] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:26:06.195603 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c4315-68bb-425f-9903-91c3278b5f4b None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:06.238402 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234f9cc-039e-4a22-9402-093ee17c0e61 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:06.275662 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26982301-3c50-477a-9f1d-695f1da293ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:06.276553 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26982301-3c50-477a-9f1d-695f1da293ad None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:06.276823 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26982301-3c50-477a-9f1d-695f1da293ad None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:06.277089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26982301-3c50-477a-9f1d-695f1da293ad None admin] PATH_INFO: `/v3/users/010db7bf2c0e4250bd87959760c9ed75` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:06.292926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26982301-3c50-477a-9f1d-695f1da293ad None admin] RBAC: Authorizing `identity:get_user(user_id=010db7bf2c0e4250bd87959760c9ed75)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:06.294315 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26982301-3c50-477a-9f1d-695f1da293ad None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:06.298663 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 161/305] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:26:06 2022] GET /identity/v3/users/010db7bf2c0e4250bd87959760c9ed75 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:06.302685 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26982301-3c50-477a-9f1d-695f1da293ad None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:06.312729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c4315-68bb-425f-9903-91c3278b5f4b None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:06.317332 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:06.356907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b8dc3-01cd-49ba-b333-406ff2730aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:06.358360 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b8dc3-01cd-49ba-b333-406ff2730aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:06.358755 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b8dc3-01cd-49ba-b333-406ff2730aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:06.359028 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b8dc3-01cd-49ba-b333-406ff2730aa9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:06.371079 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b8dc3-01cd-49ba-b333-406ff2730aa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:06.381092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-0a5b8dc3-01cd-49ba-b333-406ff2730aa9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:26:06.381092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:06.381092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:06.381092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:06.381092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:06.381092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:06.381092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:06.381092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:06.381092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:06.381092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:06.381092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:06.381092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:06.381092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:06.381092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:06.381092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:06.381092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:06.381975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:06.381975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:06.381975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:06.381975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:06.381975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:06.381975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:06.381975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:06.381975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:06.381975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:06.381975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:06.381975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:06.381975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:06.381975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:06.381975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:06.381975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:06.381975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:06.382778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:06.382778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:06.382778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:06.382778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:06.382778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:06.382778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:06.382778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:06.382778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:06.382778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:06.382778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:06.382778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:26:06.382778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:06.382778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 145/306] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:06.388259 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b8dc3-01cd-49ba-b333-406ff2730aa9 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:06.435559 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26982301-3c50-477a-9f1d-695f1da293ad None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:06.442401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:06.471928 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611eb812-3397-4bba-9dd5-7e37ad4a4879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:06.472833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611eb812-3397-4bba-9dd5-7e37ad4a4879 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:06.473110 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611eb812-3397-4bba-9dd5-7e37ad4a4879 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:06.473378 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611eb812-3397-4bba-9dd5-7e37ad4a4879 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:06.474206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611eb812-3397-4bba-9dd5-7e37ad4a4879 None admin] RBAC: Adding query filter params (role.id=e3afb7f30d8240539b9d7139c5ade987, user.id=010db7bf2c0e4250bd87959760c9ed75, scope.system=all) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:06.474513 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611eb812-3397-4bba-9dd5-7e37ad4a4879 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:06.475973 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611eb812-3397-4bba-9dd5-7e37ad4a4879 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:06.481394 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 162/307] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Jun 2 13:26:06 2022] GET /identity/v3/role_assignments?user.id=010db7bf2c0e4250bd87959760c9ed75&scope.system=all&role.id=e3afb7f30d8240539b9d7139c5ade987 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:06.490956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6850d29-a44e-4b5e-9587-655adbd1ab1c None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:06.490956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6850d29-a44e-4b5e-9587-655adbd1ab1c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:06.490956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6850d29-a44e-4b5e-9587-655adbd1ab1c None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:06.490956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 163/308] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:06.490956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c49ced-18dd-4fb3-b686-f73c488fcf70 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:06.490956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c49ced-18dd-4fb3-b686-f73c488fcf70 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:06.491301 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c49ced-18dd-4fb3-b686-f73c488fcf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:06.511170 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-93c49ced-18dd-4fb3-b686-f73c488fcf70 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:06.512445 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-93c49ced-18dd-4fb3-b686-f73c488fcf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:06.520577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b8dc3-01cd-49ba-b333-406ff2730aa9 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:06.560632 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4425e-2307-46c6-810b-e97b374741d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:06.561282 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4425e-2307-46c6-810b-e97b374741d5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:06.561865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4425e-2307-46c6-810b-e97b374741d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:06.562167 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4425e-2307-46c6-810b-e97b374741d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:06.562938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4425e-2307-46c6-810b-e97b374741d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:06.563244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4425e-2307-46c6-810b-e97b374741d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:06.564777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4425e-2307-46c6-810b-e97b374741d5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:06.574659 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 146/309] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:26:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:26:06.581042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4425e-2307-46c6-810b-e97b374741d5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:06.598750 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 164/310] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:26:06.627347 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c49ced-18dd-4fb3-b686-f73c488fcf70 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:06.632416 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:06.731536 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4425e-2307-46c6-810b-e97b374741d5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:06.735456 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:06.765746 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c49ced-18dd-4fb3-b686-f73c488fcf70 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:06.769825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5da46-0a5b-4ced-9313-f4726659e723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:06.770755 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5da46-0a5b-4ced-9313-f4726659e723 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:06.771027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5da46-0a5b-4ced-9313-f4726659e723 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:06.771299 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5da46-0a5b-4ced-9313-f4726659e723 None admin] PATH_INFO: `/v3/users/7642e115ee3641e0b6e150dc261d1233` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:06.772524 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5da46-0a5b-4ced-9313-f4726659e723 None admin] RBAC: Authorizing `identity:get_user(user_id=7642e115ee3641e0b6e150dc261d1233)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:06.773992 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5da46-0a5b-4ced-9313-f4726659e723 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:06.775865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 147/311] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:26:06 2022] GET /identity/v3/users/7642e115ee3641e0b6e150dc261d1233 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:26:06.781954 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5da46-0a5b-4ced-9313-f4726659e723 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:06.807735 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bbb20-180f-4951-86f3-de606c7be4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:06.809469 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bbb20-180f-4951-86f3-de606c7be4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:06.809962 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bbb20-180f-4951-86f3-de606c7be4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:06.810860 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bbb20-180f-4951-86f3-de606c7be4f9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:06.822337 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6bbb20-180f-4951-86f3-de606c7be4f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:06.830791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-2d6bbb20-180f-4951-86f3-de606c7be4f9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:26:06.830791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:06.830791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:06.830791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:06.830791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:06.830791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:06.830791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:06.830791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:06.830791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:06.830791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:06.830791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:06.830791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:06.830791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:06.830791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:06.830791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:06.830791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:06.831693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:06.831693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:06.831693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:06.831693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:06.831693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:06.831693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:06.831693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:06.831693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:06.831693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:06.831693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:06.831693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:06.831693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:06.831693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:06.831693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:06.831693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:06.831693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:06.832458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:06.832458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:06.832458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:06.832458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:06.832458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:06.832458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:06.832458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:06.832458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:06.832458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:06.832458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:06.832458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:26:06.832458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:06.835176 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 165/312] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:26:06.840370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bbb20-180f-4951-86f3-de606c7be4f9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:06.887263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5da46-0a5b-4ced-9313-f4726659e723 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:06.910221 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:06.923834 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990ce91-4cab-4972-8744-b9e3c3a52ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:06.924765 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990ce91-4cab-4972-8744-b9e3c3a52ad7 None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:06.925048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990ce91-4cab-4972-8744-b9e3c3a52ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:06.925325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990ce91-4cab-4972-8744-b9e3c3a52ad7 None admin] PATH_INFO: `/v3/system/users/7642e115ee3641e0b6e150dc261d1233/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:06.926864 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990ce91-4cab-4972-8744-b9e3c3a52ad7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7642e115ee3641e0b6e150dc261d1233, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:06.928260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990ce91-4cab-4972-8744-b9e3c3a52ad7 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:06.942644 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 148/313] 10.222.0.18 () {58 vars in 1334 bytes} [Thu Jun 2 13:26:06 2022] PUT /identity/v3/system/users/7642e115ee3641e0b6e150dc261d1233/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:26:06.966462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bbb20-180f-4951-86f3-de606c7be4f9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:07.006533 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d8598-fc85-4f7d-87d6-f86d92b0d603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:07.007638 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d8598-fc85-4f7d-87d6-f86d92b0d603 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:07.008198 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d8598-fc85-4f7d-87d6-f86d92b0d603 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:07.008977 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d8598-fc85-4f7d-87d6-f86d92b0d603 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:07.010166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d8598-fc85-4f7d-87d6-f86d92b0d603 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:07.010699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d8598-fc85-4f7d-87d6-f86d92b0d603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:07.012831 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d8598-fc85-4f7d-87d6-f86d92b0d603 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:07.023480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 166/314] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:26:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:07.031925 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990ce91-4cab-4972-8744-b9e3c3a52ad7 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:07.078097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:07.150613 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990ce91-4cab-4972-8744-b9e3c3a52ad7 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:07.187699 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf1633-7a00-4c85-97e1-68ab8a4d0f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:07.188589 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf1633-7a00-4c85-97e1-68ab8a4d0f96 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:07.188866 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf1633-7a00-4c85-97e1-68ab8a4d0f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:07.189135 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf1633-7a00-4c85-97e1-68ab8a4d0f96 None admin] PATH_INFO: `/v3/users/db99697ddb6c4459bd6c21f30e96daf8` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:07.190320 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf1633-7a00-4c85-97e1-68ab8a4d0f96 None admin] RBAC: Authorizing `identity:get_user(user_id=db99697ddb6c4459bd6c21f30e96daf8)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:07.191793 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf1633-7a00-4c85-97e1-68ab8a4d0f96 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:07.193594 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 149/315] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:26:07 2022] GET /identity/v3/users/db99697ddb6c4459bd6c21f30e96daf8 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:07.199227 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d8598-fc85-4f7d-87d6-f86d92b0d603 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:07.305028 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d8598-fc85-4f7d-87d6-f86d92b0d603 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:07.331366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:07.343273 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b487ae-cd55-4a85-9615-86c4e73ed4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:07.343939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b487ae-cd55-4a85-9615-86c4e73ed4eb None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:07.344215 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b487ae-cd55-4a85-9615-86c4e73ed4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:07.344488 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b487ae-cd55-4a85-9615-86c4e73ed4eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:07.422060 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b487ae-cd55-4a85-9615-86c4e73ed4eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:07.424279 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b487ae-cd55-4a85-9615-86c4e73ed4eb None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:07.530416 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 167/316] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:07.535909 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf1633-7a00-4c85-97e1-68ab8a4d0f96 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:07.642616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf1633-7a00-4c85-97e1-68ab8a4d0f96 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:07.642936 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:07.676492 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b26a58-9ebf-4d43-9677-d5a6cb1692da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:07.677376 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b26a58-9ebf-4d43-9677-d5a6cb1692da None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:07.677656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b26a58-9ebf-4d43-9677-d5a6cb1692da None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:07.677924 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b26a58-9ebf-4d43-9677-d5a6cb1692da None admin] PATH_INFO: `/v3/projects/6f065dd8bbe74892af29e05cef5a6d11` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:07.679107 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b26a58-9ebf-4d43-9677-d5a6cb1692da None admin] RBAC: Authorizing `identity:get_project(project_id=6f065dd8bbe74892af29e05cef5a6d11)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:07.680557 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b26a58-9ebf-4d43-9677-d5a6cb1692da None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:07.682558 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 150/317] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:26:07 2022] GET /identity/v3/projects/6f065dd8bbe74892af29e05cef5a6d11 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:07.691807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b487ae-cd55-4a85-9615-86c4e73ed4eb None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:07.718038 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:07.806611 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b487ae-cd55-4a85-9615-86c4e73ed4eb None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:07.843934 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33d72d-4d3c-4419-8535-9221713d3cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:07.844600 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33d72d-4d3c-4419-8535-9221713d3cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:07.844877 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33d72d-4d3c-4419-8535-9221713d3cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:07.845146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33d72d-4d3c-4419-8535-9221713d3cb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:07.845979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33d72d-4d3c-4419-8535-9221713d3cb6 None admin] RBAC: Adding query filter params (role.id=e3afb7f30d8240539b9d7139c5ade987, scope.project.id=6f065dd8bbe74892af29e05cef5a6d11, user.id=db99697ddb6c4459bd6c21f30e96daf8) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:07.846285 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33d72d-4d3c-4419-8535-9221713d3cb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:07.847749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33d72d-4d3c-4419-8535-9221713d3cb6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:07.854494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 168/318] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:26:07 2022] GET /identity/v3/role_assignments?user.id=db99697ddb6c4459bd6c21f30e96daf8&scope.project.id=6f065dd8bbe74892af29e05cef5a6d11&role.id=e3afb7f30d8240539b9d7139c5ade987 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:08.542429 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aaaf55-db88-43a6-b1a1-1e2fa4f1d78e None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:08.543021 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aaaf55-db88-43a6-b1a1-1e2fa4f1d78e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:08.543021 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aaaf55-db88-43a6-b1a1-1e2fa4f1d78e None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:08.544646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 151/319] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:08.550732 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83147dc8-13b1-40f6-941c-79934e68f4e7 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:08.550969 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83147dc8-13b1-40f6-941c-79934e68f4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:08.551279 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83147dc8-13b1-40f6-941c-79934e68f4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:08.568701 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-83147dc8-13b1-40f6-941c-79934e68f4e7 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:08.569854 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-83147dc8-13b1-40f6-941c-79934e68f4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:08.646600 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 169/320] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:08.669386 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aaaf55-db88-43a6-b1a1-1e2fa4f1d78e None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:08.770641 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aaaf55-db88-43a6-b1a1-1e2fa4f1d78e None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:08.804777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c07a46-99a5-42ac-a521-e031725b946a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:08.805495 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c07a46-99a5-42ac-a521-e031725b946a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:08.805747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c07a46-99a5-42ac-a521-e031725b946a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:08.806038 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c07a46-99a5-42ac-a521-e031725b946a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:08.807237 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c07a46-99a5-42ac-a521-e031725b946a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:08.808671 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c07a46-99a5-42ac-a521-e031725b946a None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:08.810506 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 152/321] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:08.816265 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83147dc8-13b1-40f6-941c-79934e68f4e7 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:08.836232 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:08.858836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d76c8-df61-4a8f-94c2-888f9f99992e None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:08.859157 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d76c8-df61-4a8f-94c2-888f9f99992e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:08.859380 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d76c8-df61-4a8f-94c2-888f9f99992e None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:08.860878 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 153/322] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:08.865973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54565188-295e-4a5f-8054-a56e875b7468 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:08.866253 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54565188-295e-4a5f-8054-a56e875b7468 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:08.866516 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54565188-295e-4a5f-8054-a56e875b7468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:08.883116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-54565188-295e-4a5f-8054-a56e875b7468 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:08.884336 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-54565188-295e-4a5f-8054-a56e875b7468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:08.922582 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:08.923587 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83147dc8-13b1-40f6-941c-79934e68f4e7 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:08.958919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 154/323] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:26:08.965358 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f3fdd-708a-4858-8519-e29326998be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:08.966038 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f3fdd-708a-4858-8519-e29326998be0 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:08.966317 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f3fdd-708a-4858-8519-e29326998be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:08.966681 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f3fdd-708a-4858-8519-e29326998be0 None admin] PATH_INFO: `/v3/groups` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:08.967534 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f3fdd-708a-4858-8519-e29326998be0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:08.968968 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f3fdd-708a-4858-8519-e29326998be0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:08.982613 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54565188-295e-4a5f-8054-a56e875b7468 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:08.984832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 170/324] 10.222.0.18 () {60 vars in 1134 bytes} [Thu Jun 2 13:26:08 2022] POST /identity/v3/groups => generated 226 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:26:09.101322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54565188-295e-4a5f-8054-a56e875b7468 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:09.140849 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1877d3-3212-4b20-8404-42fa06adfa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:09.141683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1877d3-3212-4b20-8404-42fa06adfa60 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:09.141963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1877d3-3212-4b20-8404-42fa06adfa60 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:09.142228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1877d3-3212-4b20-8404-42fa06adfa60 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:09.154547 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1877d3-3212-4b20-8404-42fa06adfa60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:09.162491 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-9d1877d3-3212-4b20-8404-42fa06adfa60 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:26:09.162491 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:09.162491 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:09.162491 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:09.162491 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:09.162491 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:09.162491 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:09.162491 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:09.162491 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:09.162491 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:09.162491 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:09.162491 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:09.162491 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:09.162491 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:09.162491 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:09.162491 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:09.163436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:09.163436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:09.163436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:09.163436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:09.163436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:09.163436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:09.163436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:09.163436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:09.163436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:09.163436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:09.163436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:09.163436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:09.163436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:09.163436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:09.163436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:09.163436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:09.164488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:09.164488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:09.164488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:09.164488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:09.164488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:09.164488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:09.164488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:09.164488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:09.164488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:09.164488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:09.164488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:26:09.164488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:09.164488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 155/325] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:26:09.169615 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f3fdd-708a-4858-8519-e29326998be0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:09.256611 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:09.281036 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f3fdd-708a-4858-8519-e29326998be0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:09.316080 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86afe9-fdc9-4300-9048-48afe37068b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:09.317119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86afe9-fdc9-4300-9048-48afe37068b8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:09.317589 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86afe9-fdc9-4300-9048-48afe37068b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:09.318084 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86afe9-fdc9-4300-9048-48afe37068b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:09.318877 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86afe9-fdc9-4300-9048-48afe37068b8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:09.319177 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86afe9-fdc9-4300-9048-48afe37068b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:09.320565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86afe9-fdc9-4300-9048-48afe37068b8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:09.329796 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 171/326] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:26:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:09.335506 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1877d3-3212-4b20-8404-42fa06adfa60 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:09.368055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:09.377350 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfb96f-7162-48e9-b0df-58809146328d None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:09.377646 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfb96f-7162-48e9-b0df-58809146328d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:09.377910 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfb96f-7162-48e9-b0df-58809146328d None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:09.379563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 172/327] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:09.384734 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba3c1d-d1cf-434c-9ccd-1ab6b9617f4f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:09.384921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba3c1d-d1cf-434c-9ccd-1ab6b9617f4f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:09.385199 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba3c1d-d1cf-434c-9ccd-1ab6b9617f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:09.404429 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-cdba3c1d-d1cf-434c-9ccd-1ab6b9617f4f None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:09.406042 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cdba3c1d-d1cf-434c-9ccd-1ab6b9617f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:09.453418 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1877d3-3212-4b20-8404-42fa06adfa60 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:09.489843 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 173/328] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:26:09.490033 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd152e4-ede2-4965-aa5c-762f32d17634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:09.491032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd152e4-ede2-4965-aa5c-762f32d17634 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:09.491378 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd152e4-ede2-4965-aa5c-762f32d17634 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:09.491709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd152e4-ede2-4965-aa5c-762f32d17634 None admin] PATH_INFO: `/v3/users/010db7bf2c0e4250bd87959760c9ed75` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:09.493015 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd152e4-ede2-4965-aa5c-762f32d17634 None admin] RBAC: Authorizing `identity:get_user(user_id=010db7bf2c0e4250bd87959760c9ed75)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:09.494528 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd152e4-ede2-4965-aa5c-762f32d17634 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:09.496231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 156/329] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:26:09 2022] GET /identity/v3/users/010db7bf2c0e4250bd87959760c9ed75 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:09.502007 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba3c1d-d1cf-434c-9ccd-1ab6b9617f4f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:09.516731 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd152e4-ede2-4965-aa5c-762f32d17634 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:09.581793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:09.614398 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba3c1d-d1cf-434c-9ccd-1ab6b9617f4f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:09.622328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:09.632308 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd152e4-ede2-4965-aa5c-762f32d17634 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:09.654986 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549513a5-d13c-46dc-9ab5-cacd2b7ded69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:09.656010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549513a5-d13c-46dc-9ab5-cacd2b7ded69 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:09.656231 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549513a5-d13c-46dc-9ab5-cacd2b7ded69 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:09.656498 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549513a5-d13c-46dc-9ab5-cacd2b7ded69 None admin] PATH_INFO: `/v3/system/users/010db7bf2c0e4250bd87959760c9ed75/roles/e3afb7f30d8240539b9d7139c5ade987` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:09.658069 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549513a5-d13c-46dc-9ab5-cacd2b7ded69 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=010db7bf2c0e4250bd87959760c9ed75, role_id=e3afb7f30d8240539b9d7139c5ade987)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:09.660108 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549513a5-d13c-46dc-9ab5-cacd2b7ded69 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:09.678595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 174/330] 10.222.0.18 () {58 vars in 1334 bytes} [Thu Jun 2 13:26:09 2022] PUT /identity/v3/system/users/010db7bf2c0e4250bd87959760c9ed75/roles/e3afb7f30d8240539b9d7139c5ade987 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:26:09.684056 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e3365-2c85-4a4c-aa38-45628b595a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:09.685168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e3365-2c85-4a4c-aa38-45628b595a52 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:09.685719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e3365-2c85-4a4c-aa38-45628b595a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:09.686252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e3365-2c85-4a4c-aa38-45628b595a52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:09.701679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e3365-2c85-4a4c-aa38-45628b595a52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:09.710180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-552e3365-2c85-4a4c-aa38-45628b595a52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:26:09.710180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:09.710180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:09.710180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:09.710180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:09.710180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:09.710180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:09.710180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:09.710180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:09.710180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:09.710180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:09.710180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:09.710180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:09.710180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:09.710180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:09.710180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:09.711160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:09.711160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:09.711160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:09.711160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:09.711160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:09.711160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:09.711160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:09.711160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:09.711160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:09.711160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:09.711160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:09.711160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:09.711160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:09.711160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:09.711160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:09.711160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:09.712503 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:09.712503 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:09.712503 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:09.712503 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:09.712503 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:09.712503 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:09.712503 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:09.712503 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:09.712503 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:09.712503 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:09.712503 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:26:09.712503 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:09.712503 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 157/331] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:09.718000 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549513a5-d13c-46dc-9ab5-cacd2b7ded69 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:09.836320 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549513a5-d13c-46dc-9ab5-cacd2b7ded69 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:09.878199 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e158a-2ec5-44d0-9761-f061db6a0cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:09.878860 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e158a-2ec5-44d0-9761-f061db6a0cdc None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:09.879140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e158a-2ec5-44d0-9761-f061db6a0cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:09.879410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e158a-2ec5-44d0-9761-f061db6a0cdc None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:09.880278 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e158a-2ec5-44d0-9761-f061db6a0cdc None admin] RBAC: Adding query filter params (name=member) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:09.880592 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e158a-2ec5-44d0-9761-f061db6a0cdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:09.882069 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e158a-2ec5-44d0-9761-f061db6a0cdc None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:09.883803 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:09.893690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 175/332] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:26:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:09.899984 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e3365-2c85-4a4c-aa38-45628b595a52 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:10.029195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e3365-2c85-4a4c-aa38-45628b595a52 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:10.066800 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa31f1b-8485-495f-9a28-4e55e13a45ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:10.067701 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa31f1b-8485-495f-9a28-4e55e13a45ff None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:10.067980 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa31f1b-8485-495f-9a28-4e55e13a45ff None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:10.068246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa31f1b-8485-495f-9a28-4e55e13a45ff None admin] PATH_INFO: `/v3/users/7642e115ee3641e0b6e150dc261d1233` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:10.069448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa31f1b-8485-495f-9a28-4e55e13a45ff None admin] RBAC: Authorizing `identity:get_user(user_id=7642e115ee3641e0b6e150dc261d1233)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:10.070983 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa31f1b-8485-495f-9a28-4e55e13a45ff None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:10.072927 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 158/333] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:26:09 2022] GET /identity/v3/users/7642e115ee3641e0b6e150dc261d1233 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:10.079006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e158a-2ec5-44d0-9761-f061db6a0cdc None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:10.199277 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e158a-2ec5-44d0-9761-f061db6a0cdc None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:10.244532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94950bce-a214-4aa1-9ea1-781648361bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:10.245551 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94950bce-a214-4aa1-9ea1-781648361bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:10.246019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94950bce-a214-4aa1-9ea1-781648361bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:10.246612 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94950bce-a214-4aa1-9ea1-781648361bc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:10.247641 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94950bce-a214-4aa1-9ea1-781648361bc5 None admin] RBAC: Adding query filter params (role.id=891bd78dbb334259bdef8495ca3f4132, user.id=7642e115ee3641e0b6e150dc261d1233, scope.system=all) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:10.248253 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94950bce-a214-4aa1-9ea1-781648361bc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:10.249874 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94950bce-a214-4aa1-9ea1-781648361bc5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:10.266960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 176/334] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Jun 2 13:26:10 2022] GET /identity/v3/role_assignments?user.id=7642e115ee3641e0b6e150dc261d1233&scope.system=all&role.id=891bd78dbb334259bdef8495ca3f4132 => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:12.147096 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddb60b-e28e-4b19-82b6-dc7948f271e4 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:12.147678 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddb60b-e28e-4b19-82b6-dc7948f271e4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:12.147678 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddb60b-e28e-4b19-82b6-dc7948f271e4 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:12.149299 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 159/335] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:12.155889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383ddf8-7f17-4bc0-bdcf-908b17ec7f85 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:12.156873 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383ddf8-7f17-4bc0-bdcf-908b17ec7f85 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:12.157343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383ddf8-7f17-4bc0-bdcf-908b17ec7f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:12.178997 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0383ddf8-7f17-4bc0-bdcf-908b17ec7f85 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:12.180537 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0383ddf8-7f17-4bc0-bdcf-908b17ec7f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:12.253564 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:12.273861 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 177/336] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:12.315651 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddb60b-e28e-4b19-82b6-dc7948f271e4 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:12.348967 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:12.426020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d39468-9314-4bbc-9158-4802751a4a37 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:12.426771 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d39468-9314-4bbc-9158-4802751a4a37 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:12.427243 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d39468-9314-4bbc-9158-4802751a4a37 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:12.429038 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 178/337] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:12.435291 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22219c1-61a2-4013-834a-40100ce6f067 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:12.435944 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22219c1-61a2-4013-834a-40100ce6f067 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:12.436467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22219c1-61a2-4013-834a-40100ce6f067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:12.439153 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddb60b-e28e-4b19-82b6-dc7948f271e4 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:12.471643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a22219c1-61a2-4013-834a-40100ce6f067 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:12.473187 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a22219c1-61a2-4013-834a-40100ce6f067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:12.485857 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab63fc-a2c3-4547-a198-b6baf25ad074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:12.486747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab63fc-a2c3-4547-a198-b6baf25ad074 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:12.487025 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab63fc-a2c3-4547-a198-b6baf25ad074 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:12.487293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab63fc-a2c3-4547-a198-b6baf25ad074 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:12.514845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab63fc-a2c3-4547-a198-b6baf25ad074 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:12.532549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-74ab63fc-a2c3-4547-a198-b6baf25ad074 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:26:12.532549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:12.532549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:12.532549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:12.532549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:12.532549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:12.532549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:12.532549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:12.532549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:12.532549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:12.532549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:12.532549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:12.532549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:12.532549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:12.532549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:12.532549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:12.533520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:12.533520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:12.533520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:12.533520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:12.533520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:12.533520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:12.533520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:12.533520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:12.533520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:12.533520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:12.533520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:12.533520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:12.533520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:12.533520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:12.533520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:12.533520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:12.534342 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:12.534342 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:12.534342 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:12.534342 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:12.534342 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:12.534342 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:12.534342 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:12.534342 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:12.534342 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:12.534342 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:12.534342 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:26:12.534342 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:12.543956 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 160/338] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 13:26:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:12.551473 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab63fc-a2c3-4547-a198-b6baf25ad074 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:12.640430 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 179/339] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:12.642127 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2442aa0-7c82-4eb4-b211-98e5fdf4aa97 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:12.642641 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2442aa0-7c82-4eb4-b211-98e5fdf4aa97 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:12.643114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2442aa0-7c82-4eb4-b211-98e5fdf4aa97 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:12.645041 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 180/340] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:12.656084 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e168d-ad51-4148-b92a-bf341bfb32a1 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:12.656687 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e168d-ad51-4148-b92a-bf341bfb32a1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:12.657165 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e168d-ad51-4148-b92a-bf341bfb32a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:12.689692 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:12.693929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-342e168d-ad51-4148-b92a-bf341bfb32a1 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:12.695385 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-342e168d-ad51-4148-b92a-bf341bfb32a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:12.717814 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab63fc-a2c3-4547-a198-b6baf25ad074 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:12.783235 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 181/341] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:12.784593 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e168d-ad51-4148-b92a-bf341bfb32a1 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:12.803329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5131c5-9e21-48cc-b243-34da8a9447b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:12.804388 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5131c5-9e21-48cc-b243-34da8a9447b5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:12.804885 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5131c5-9e21-48cc-b243-34da8a9447b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:12.805371 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5131c5-9e21-48cc-b243-34da8a9447b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:12.806328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5131c5-9e21-48cc-b243-34da8a9447b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:12.806868 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5131c5-9e21-48cc-b243-34da8a9447b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:12.808453 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5131c5-9e21-48cc-b243-34da8a9447b5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:12.817786 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 161/342] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:12.823004 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5131c5-9e21-48cc-b243-34da8a9447b5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:12.835361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:12.898824 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e168d-ad51-4148-b92a-bf341bfb32a1 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:12.938761 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f40939-f9cf-4763-a890-2000c2724953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:12.939891 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f40939-f9cf-4763-a890-2000c2724953 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:12.940323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f40939-f9cf-4763-a890-2000c2724953 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:12.940750 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f40939-f9cf-4763-a890-2000c2724953 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:12.959539 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f40939-f9cf-4763-a890-2000c2724953 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:12.967728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-25f40939-f9cf-4763-a890-2000c2724953 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:26:12.967728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:12.967728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:12.967728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:12.967728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:12.967728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:12.967728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:12.967728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:12.967728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:12.967728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:12.967728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:12.967728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:12.967728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:12.967728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:12.967728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:12.967728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:12.968827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:12.968827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:12.968827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:12.968827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:12.968827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:12.968827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:12.968827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:12.968827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:12.968827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:12.968827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:12.968827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:12.968827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:12.968827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:12.968827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:12.968827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:12.968827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:12.969807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:12.969807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:12.969807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:12.969807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:12.969807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:12.969807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:12.969807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:12.969807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:12.969807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:12.969807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:12.969807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:26:12.969807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:12.980291 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 182/343] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:12.981983 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f40939-f9cf-4763-a890-2000c2724953 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:12.993303 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5131c5-9e21-48cc-b243-34da8a9447b5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:13.080785 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236c671-c2ce-4558-8e05-fdd64fbf9497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:13.081984 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236c671-c2ce-4558-8e05-fdd64fbf9497 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:13.083766 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236c671-c2ce-4558-8e05-fdd64fbf9497 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:13.084200 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236c671-c2ce-4558-8e05-fdd64fbf9497 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:13.108614 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236c671-c2ce-4558-8e05-fdd64fbf9497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:13.125894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-a236c671-c2ce-4558-8e05-fdd64fbf9497 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:26:13.125894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:13.125894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:13.125894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:13.125894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:13.125894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:13.125894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:13.125894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:13.125894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:13.125894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:13.125894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:13.125894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:13.125894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:13.125894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:13.125894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:13.125894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:13.127085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:13.127085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:13.127085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:13.127085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:13.127085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:13.127085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:13.127085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:13.127085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:13.127085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:13.127085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:13.127085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:13.127085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:13.127085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:13.127085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:13.127085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:13.127085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:13.128102 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:13.128102 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:13.128102 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:13.128102 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:13.128102 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:13.128102 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:13.128102 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:13.128102 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:13.128102 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:13.128102 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:13.128102 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:26:13.128102 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:13.133182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 162/344] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:13.135623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236c671-c2ce-4558-8e05-fdd64fbf9497 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:13.160599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:13.200465 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f40939-f9cf-4763-a890-2000c2724953 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:13.207251 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:13.272914 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a0902-4365-4071-99fc-818153671e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:13.273596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a0902-4365-4071-99fc-818153671e79 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:13.273882 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a0902-4365-4071-99fc-818153671e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:13.274162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a0902-4365-4071-99fc-818153671e79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:13.306688 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236c671-c2ce-4558-8e05-fdd64fbf9497 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:13.356092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93d028-0ba4-4169-8f21-8ce8f56a837e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:13.356888 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93d028-0ba4-4169-8f21-8ce8f56a837e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:13.357498 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93d028-0ba4-4169-8f21-8ce8f56a837e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:13.357785 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93d028-0ba4-4169-8f21-8ce8f56a837e None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:13.358621 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c93d028-0ba4-4169-8f21-8ce8f56a837e None admin] RBAC: Adding query filter params (name=member) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:13.359173 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c93d028-0ba4-4169-8f21-8ce8f56a837e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:13.361404 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c93d028-0ba4-4169-8f21-8ce8f56a837e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:13.374408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a0902-4365-4071-99fc-818153671e79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:13.375566 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 163/345] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:26:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:13.376085 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a0902-4365-4071-99fc-818153671e79 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:13.376462 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93d028-0ba4-4169-8f21-8ce8f56a837e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:13.473239 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:13.509463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93d028-0ba4-4169-8f21-8ce8f56a837e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:13.522645 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 183/346] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:13.524123 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143c77c-dac5-4bbf-9a3f-9fa173eff423 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:13.524411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143c77c-dac5-4bbf-9a3f-9fa173eff423 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:13.524692 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143c77c-dac5-4bbf-9a3f-9fa173eff423 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:13.525970 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 184/347] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:13.526682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143c77c-dac5-4bbf-9a3f-9fa173eff423 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:13.532272 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:13.552912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b78dfa-63e4-488f-a275-ce44d12ee2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:13.553618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b78dfa-63e4-488f-a275-ce44d12ee2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:13.553901 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b78dfa-63e4-488f-a275-ce44d12ee2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:13.554177 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b78dfa-63e4-488f-a275-ce44d12ee2e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:13.555108 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b78dfa-63e4-488f-a275-ce44d12ee2e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:13.555298 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b78dfa-63e4-488f-a275-ce44d12ee2e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:13.556712 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b78dfa-63e4-488f-a275-ce44d12ee2e3 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:13.566266 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 164/348] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:26:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:13.571288 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b78dfa-63e4-488f-a275-ce44d12ee2e3 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:13.666658 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143c77c-dac5-4bbf-9a3f-9fa173eff423 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:13.699891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b78dfa-63e4-488f-a275-ce44d12ee2e3 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:13.713014 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a557f-106c-4f59-823c-1d800ac5d1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:13.713919 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a557f-106c-4f59-823c-1d800ac5d1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:13.714517 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a557f-106c-4f59-823c-1d800ac5d1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:13.714950 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a557f-106c-4f59-823c-1d800ac5d1d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:13.733933 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:13.744444 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8323f-d940-4d01-a35d-ce74f71546ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:13.745895 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8323f-d940-4d01-a35d-ce74f71546ff None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:13.745895 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8323f-d940-4d01-a35d-ce74f71546ff None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:13.747251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8323f-d940-4d01-a35d-ce74f71546ff None admin] PATH_INFO: `/v3/projects/ce43efdcbb764869a0f4347b5b29fcca` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:13.748235 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8323f-d940-4d01-a35d-ce74f71546ff None admin] RBAC: Authorizing `identity:get_project(project_id=ce43efdcbb764869a0f4347b5b29fcca)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:13.750032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8323f-d940-4d01-a35d-ce74f71546ff None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:13.752916 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 165/349] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:26:13 2022] GET /identity/v3/projects/ce43efdcbb764869a0f4347b5b29fcca => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:13.756651 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6262609-f42f-4178-bbd1-6995355b52d2 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:13.756651 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6262609-f42f-4178-bbd1-6995355b52d2 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:13.756651 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6262609-f42f-4178-bbd1-6995355b52d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:13.779665 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d6262609-f42f-4178-bbd1-6995355b52d2 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:13.781107 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d6262609-f42f-4178-bbd1-6995355b52d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:13.817691 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a557f-106c-4f59-823c-1d800ac5d1d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:13.819257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a557f-106c-4f59-823c-1d800ac5d1d7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:13.822124 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:13.863923 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 166/350] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:13.867586 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6262609-f42f-4178-bbd1-6995355b52d2 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:13.937264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 185/351] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:13.938771 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd9dee-8e9b-4b83-a3f0-c830703939b7 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:13.939127 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd9dee-8e9b-4b83-a3f0-c830703939b7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:13.939466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd9dee-8e9b-4b83-a3f0-c830703939b7 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:13.945447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 186/352] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:13.946378 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd9dee-8e9b-4b83-a3f0-c830703939b7 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:13.986387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6262609-f42f-4178-bbd1-6995355b52d2 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:14.021897 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:14.030517 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc78af-2f65-4aa0-b174-adbeefcda525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:14.031218 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc78af-2f65-4aa0-b174-adbeefcda525 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:14.031509 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc78af-2f65-4aa0-b174-adbeefcda525 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:14.031775 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc78af-2f65-4aa0-b174-adbeefcda525 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:14.071330 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd9dee-8e9b-4b83-a3f0-c830703939b7 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:14.074868 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:14.110232 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaef358-3cd0-428d-9fa6-cc5125e525d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:14.111138 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaef358-3cd0-428d-9fa6-cc5125e525d8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:14.111416 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaef358-3cd0-428d-9fa6-cc5125e525d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:14.111852 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaef358-3cd0-428d-9fa6-cc5125e525d8 None admin] PATH_INFO: `/v3/groups/c59f5373ff3d4a02aa2c101e978f047a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:14.120701 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaef358-3cd0-428d-9fa6-cc5125e525d8 None admin] RBAC: Authorizing `identity:get_group(group_id=c59f5373ff3d4a02aa2c101e978f047a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:14.122166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaef358-3cd0-428d-9fa6-cc5125e525d8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:14.124171 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 187/353] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 13:26:13 2022] GET /identity/v3/groups/c59f5373ff3d4a02aa2c101e978f047a => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:14.124801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaef358-3cd0-428d-9fa6-cc5125e525d8 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:14.129427 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc78af-2f65-4aa0-b174-adbeefcda525 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:14.131019 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc78af-2f65-4aa0-b174-adbeefcda525 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:14.244732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 167/354] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:14.245600 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc78af-2f65-4aa0-b174-adbeefcda525 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:14.246378 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaef358-3cd0-428d-9fa6-cc5125e525d8 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:14.283442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:14.287985 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d90c2-35ad-4d62-b629-ebfd00c93dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:14.288800 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d90c2-35ad-4d62-b629-ebfd00c93dff None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:14.289074 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d90c2-35ad-4d62-b629-ebfd00c93dff None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:14.289340 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d90c2-35ad-4d62-b629-ebfd00c93dff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:14.303567 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d90c2-35ad-4d62-b629-ebfd00c93dff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:14.311443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-fb5d90c2-35ad-4d62-b629-ebfd00c93dff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:26:14.311443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:14.311443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:14.311443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:14.311443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:14.311443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:14.311443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:14.311443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:14.311443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:14.311443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:14.311443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:14.311443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:14.311443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:14.311443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:14.311443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:14.311443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:14.312323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:14.312323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:14.312323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:14.312323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:14.312323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:14.312323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:14.312323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:14.312323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:14.312323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:14.312323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:14.312323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:14.312323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:14.312323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:14.312323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:14.312323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:14.312323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:14.313103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:14.313103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:14.313103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:14.313103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:14.313103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:14.313103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:14.313103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:14.313103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:14.313103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:14.313103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:14.313103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:26:14.313103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:14.313103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 188/355] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:14.314184 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792d017-7bf1-42cd-91ce-6fdcca43ec98 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:14.314184 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792d017-7bf1-42cd-91ce-6fdcca43ec98 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:14.314737 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792d017-7bf1-42cd-91ce-6fdcca43ec98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:14.335595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-9792d017-7bf1-42cd-91ce-6fdcca43ec98 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:14.336794 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9792d017-7bf1-42cd-91ce-6fdcca43ec98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:14.368670 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:14.376245 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc78af-2f65-4aa0-b174-adbeefcda525 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:14.416260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb85f38-7ebb-4f4f-8471-3843212ac095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:14.417144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb85f38-7ebb-4f4f-8471-3843212ac095 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:14.417421 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb85f38-7ebb-4f4f-8471-3843212ac095 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:14.417690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb85f38-7ebb-4f4f-8471-3843212ac095 None admin] PATH_INFO: `/v3/projects/ce43efdcbb764869a0f4347b5b29fcca` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:14.419826 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb85f38-7ebb-4f4f-8471-3843212ac095 None admin] RBAC: Authorizing `identity:get_project(project_id=ce43efdcbb764869a0f4347b5b29fcca)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:14.420438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 189/356] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:14.421668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766e617-4013-45d5-8d9d-86962fbfd04f None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:14.421952 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766e617-4013-45d5-8d9d-86962fbfd04f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:14.422223 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766e617-4013-45d5-8d9d-86962fbfd04f None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:14.423686 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 190/357] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:14.423794 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb85f38-7ebb-4f4f-8471-3843212ac095 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:14.424233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766e617-4013-45d5-8d9d-86962fbfd04f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:14.425549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 168/358] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:26:14 2022] GET /identity/v3/projects/ce43efdcbb764869a0f4347b5b29fcca => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:14.429133 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb85f38-7ebb-4f4f-8471-3843212ac095 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:14.541620 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:14.546613 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766e617-4013-45d5-8d9d-86962fbfd04f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:14.546793 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb85f38-7ebb-4f4f-8471-3843212ac095 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:14.590391 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e06683-6337-4a09-a766-1bb583ae3fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:14.591398 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39565645-7a2e-48c7-bfac-aae6bc521b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:14.591557 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e06683-6337-4a09-a766-1bb583ae3fcb None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:14.591849 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e06683-6337-4a09-a766-1bb583ae3fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:14.592070 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e06683-6337-4a09-a766-1bb583ae3fcb None admin] PATH_INFO: `/v3/projects/6f065dd8bbe74892af29e05cef5a6d11` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:14.592180 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39565645-7a2e-48c7-bfac-aae6bc521b84 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:14.592452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39565645-7a2e-48c7-bfac-aae6bc521b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:14.592838 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39565645-7a2e-48c7-bfac-aae6bc521b84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:14.593626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e06683-6337-4a09-a766-1bb583ae3fcb None admin] RBAC: Authorizing `identity:get_project(project_id=6f065dd8bbe74892af29e05cef5a6d11)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:14.593732 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39565645-7a2e-48c7-bfac-aae6bc521b84 None admin] RBAC: Adding query filter params (group.id=c59f5373ff3d4a02aa2c101e978f047a, role.id=f63a52fb33144307bba2318551138669, scope.project.id=ce43efdcbb764869a0f4347b5b29fcca) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:14.593976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39565645-7a2e-48c7-bfac-aae6bc521b84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:14.595089 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e06683-6337-4a09-a766-1bb583ae3fcb None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:14.595462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39565645-7a2e-48c7-bfac-aae6bc521b84 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:14.596779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 169/359] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:26:14 2022] GET /identity/v3/projects/6f065dd8bbe74892af29e05cef5a6d11 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:14.597631 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e06683-6337-4a09-a766-1bb583ae3fcb None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:14.603099 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 191/360] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 2 13:26:14 2022] GET /identity/v3/role_assignments?group.id=c59f5373ff3d4a02aa2c101e978f047a&scope.project.id=ce43efdcbb764869a0f4347b5b29fcca&role.id=f63a52fb33144307bba2318551138669 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:14.606657 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58ecef-a6c7-4850-9d13-61dede1e7b31 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:14.606657 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58ecef-a6c7-4850-9d13-61dede1e7b31 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:14.606657 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58ecef-a6c7-4850-9d13-61dede1e7b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:14.623488 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ab58ecef-a6c7-4850-9d13-61dede1e7b31 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:14.624890 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ab58ecef-a6c7-4850-9d13-61dede1e7b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:14.656883 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:14.727891 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 192/361] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:14.729520 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58ecef-a6c7-4850-9d13-61dede1e7b31 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:14.738623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e06683-6337-4a09-a766-1bb583ae3fcb None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:14.792728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1db21d-7505-4f3d-933c-1a2fedfac11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:14.793355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1db21d-7505-4f3d-933c-1a2fedfac11f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:14.793635 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1db21d-7505-4f3d-933c-1a2fedfac11f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:14.793911 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1db21d-7505-4f3d-933c-1a2fedfac11f None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:14.794831 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1db21d-7505-4f3d-933c-1a2fedfac11f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:14.795132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1db21d-7505-4f3d-933c-1a2fedfac11f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:14.796565 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1db21d-7505-4f3d-933c-1a2fedfac11f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:14.808689 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 170/362] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:26:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:14.809605 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1db21d-7505-4f3d-933c-1a2fedfac11f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:14.844491 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:14.864030 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58ecef-a6c7-4850-9d13-61dede1e7b31 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:14.914137 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8d9dd-18ab-40e6-83ac-ebdbb5158c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:14.915114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8d9dd-18ab-40e6-83ac-ebdbb5158c47 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:14.915563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8d9dd-18ab-40e6-83ac-ebdbb5158c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:14.915845 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8d9dd-18ab-40e6-83ac-ebdbb5158c47 None admin] PATH_INFO: `/v3/groups/c59f5373ff3d4a02aa2c101e978f047a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:14.917494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8d9dd-18ab-40e6-83ac-ebdbb5158c47 None admin] RBAC: Authorizing `identity:get_group(group_id=c59f5373ff3d4a02aa2c101e978f047a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:14.919266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8d9dd-18ab-40e6-83ac-ebdbb5158c47 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:14.921585 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 193/363] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 13:26:14 2022] GET /identity/v3/groups/c59f5373ff3d4a02aa2c101e978f047a => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:14.922211 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8d9dd-18ab-40e6-83ac-ebdbb5158c47 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:14.935770 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1db21d-7505-4f3d-933c-1a2fedfac11f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:14.953674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:14.974661 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6bde6-2954-4cc4-b2b4-8e4594ffe9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:14.975480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6bde6-2954-4cc4-b2b4-8e4594ffe9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:14.975811 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6bde6-2954-4cc4-b2b4-8e4594ffe9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:14.976079 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6bde6-2954-4cc4-b2b4-8e4594ffe9a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:14.989030 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6bde6-2954-4cc4-b2b4-8e4594ffe9a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:14.998184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-23c6bde6-2954-4cc4-b2b4-8e4594ffe9a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:26:14.998184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:14.998184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:14.998184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:14.998184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:14.998184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:14.998184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:14.998184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:14.998184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:14.998184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:14.998184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:14.998184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:14.998184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:14.998184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:14.998184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:14.998184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:14.999297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:14.999297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:14.999297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:14.999297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:14.999297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:14.999297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:14.999297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:14.999297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:14.999297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:14.999297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:14.999297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:14.999297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:14.999297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:14.999297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:14.999297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:14.999297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:15.000240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:15.000240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:15.000240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:15.000240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:15.000240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:15.000240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:15.000240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:15.000240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:15.000240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:15.000240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:15.000240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:26:15.000240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:15.000240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 171/364] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 13:26:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:15.000961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6bde6-2954-4cc4-b2b4-8e4594ffe9a7 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:15.056157 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8d9dd-18ab-40e6-83ac-ebdbb5158c47 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:15.099915 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff53506-1dde-42c1-a88b-3738a223e0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:15.100520 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff53506-1dde-42c1-a88b-3738a223e0cd None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:15.100793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff53506-1dde-42c1-a88b-3738a223e0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:15.101171 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff53506-1dde-42c1-a88b-3738a223e0cd None admin] PATH_INFO: `/v3/groups/c59f5373ff3d4a02aa2c101e978f047a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:15.103323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff53506-1dde-42c1-a88b-3738a223e0cd None admin] RBAC: Authorizing `identity:get_group(group_id=c59f5373ff3d4a02aa2c101e978f047a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:15.104581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:15.107784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff53506-1dde-42c1-a88b-3738a223e0cd None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:15.107784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 194/365] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 13:26:14 2022] GET /identity/v3/groups/c59f5373ff3d4a02aa2c101e978f047a => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:15.109572 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff53506-1dde-42c1-a88b-3738a223e0cd None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:15.123695 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6bde6-2954-4cc4-b2b4-8e4594ffe9a7 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:15.169250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666e698-db80-4f5d-b83c-bf879352f53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:15.170138 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666e698-db80-4f5d-b83c-bf879352f53b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:15.170423 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666e698-db80-4f5d-b83c-bf879352f53b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:15.170871 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666e698-db80-4f5d-b83c-bf879352f53b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:15.182707 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666e698-db80-4f5d-b83c-bf879352f53b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:15.191448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-6666e698-db80-4f5d-b83c-bf879352f53b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:26:15.191448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:15.191448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:15.191448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:15.191448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:15.191448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:15.191448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:15.191448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:15.191448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:15.191448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:15.191448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:15.191448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:15.191448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:15.191448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:15.191448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:15.191448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:15.192343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:15.192343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:15.192343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:15.192343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:15.192343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:15.192343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:15.192343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:15.192343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:15.192343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:15.192343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:15.192343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:15.192343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:15.192343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:15.192343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:15.192343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:15.192343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:15.193137 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:15.193137 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:15.193137 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:15.193137 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:15.193137 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:15.193137 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:15.193137 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:15.193137 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:15.193137 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:15.193137 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:15.193137 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:26:15.193137 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:15.193137 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 172/366] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:26:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:15.193786 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666e698-db80-4f5d-b83c-bf879352f53b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:15.217872 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:15.238466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff53506-1dde-42c1-a88b-3738a223e0cd None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:15.284696 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb5120-fb8d-4967-bf14-568aa643639a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:15.285606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb5120-fb8d-4967-bf14-568aa643639a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:15.285887 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb5120-fb8d-4967-bf14-568aa643639a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:15.286663 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb5120-fb8d-4967-bf14-568aa643639a None admin] PATH_INFO: `/v3/users/010db7bf2c0e4250bd87959760c9ed75` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:15.287917 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb5120-fb8d-4967-bf14-568aa643639a None admin] RBAC: Authorizing `identity:get_user(user_id=010db7bf2c0e4250bd87959760c9ed75)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:15.290043 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb5120-fb8d-4967-bf14-568aa643639a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:15.294318 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 195/367] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:26:15 2022] GET /identity/v3/users/010db7bf2c0e4250bd87959760c9ed75 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:15.294318 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb5120-fb8d-4967-bf14-568aa643639a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:15.316943 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666e698-db80-4f5d-b83c-bf879352f53b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:15.361879 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a9f77-b411-4923-86fb-65293f51ab02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:15.362564 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a9f77-b411-4923-86fb-65293f51ab02 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:15.362878 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a9f77-b411-4923-86fb-65293f51ab02 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:15.363361 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a9f77-b411-4923-86fb-65293f51ab02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:15.364507 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a9f77-b411-4923-86fb-65293f51ab02 None admin] RBAC: Adding query filter params (group.id=c59f5373ff3d4a02aa2c101e978f047a, role.id=891bd78dbb334259bdef8495ca3f4132, scope.project.id=ce43efdcbb764869a0f4347b5b29fcca) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:15.364844 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a9f77-b411-4923-86fb-65293f51ab02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:15.366563 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a9f77-b411-4923-86fb-65293f51ab02 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:15.373520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 173/368] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 2 13:26:15 2022] GET /identity/v3/role_assignments?group.id=c59f5373ff3d4a02aa2c101e978f047a&scope.project.id=ce43efdcbb764869a0f4347b5b29fcca&role.id=891bd78dbb334259bdef8495ca3f4132 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:15.374946 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a9f77-b411-4923-86fb-65293f51ab02 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:15.399539 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:15.416274 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb5120-fb8d-4967-bf14-568aa643639a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:15.457820 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f3cb7-b0a1-48e7-a9a4-5b8ddb58db36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:15.458799 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f3cb7-b0a1-48e7-a9a4-5b8ddb58db36 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:15.459177 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f3cb7-b0a1-48e7-a9a4-5b8ddb58db36 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:15.459575 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f3cb7-b0a1-48e7-a9a4-5b8ddb58db36 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:15.460344 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f3cb7-b0a1-48e7-a9a4-5b8ddb58db36 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:15.460653 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f3cb7-b0a1-48e7-a9a4-5b8ddb58db36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:15.462051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f3cb7-b0a1-48e7-a9a4-5b8ddb58db36 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:15.475127 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 196/369] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:15.476038 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f3cb7-b0a1-48e7-a9a4-5b8ddb58db36 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:15.505702 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:15.518187 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a9f77-b411-4923-86fb-65293f51ab02 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:15.556723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2ae62-97e8-46c7-bd46-04e48789616b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:15.557828 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2ae62-97e8-46c7-bd46-04e48789616b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:15.558350 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2ae62-97e8-46c7-bd46-04e48789616b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:15.558822 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2ae62-97e8-46c7-bd46-04e48789616b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:15.559849 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2ae62-97e8-46c7-bd46-04e48789616b None admin] RBAC: Adding query filter params (group.id=c59f5373ff3d4a02aa2c101e978f047a, role.id=891bd78dbb334259bdef8495ca3f4132, scope.project.id=6f065dd8bbe74892af29e05cef5a6d11) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:15.560440 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2ae62-97e8-46c7-bd46-04e48789616b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:15.562203 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2ae62-97e8-46c7-bd46-04e48789616b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:15.569313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 174/370] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 2 13:26:15 2022] GET /identity/v3/role_assignments?group.id=c59f5373ff3d4a02aa2c101e978f047a&scope.project.id=6f065dd8bbe74892af29e05cef5a6d11&role.id=891bd78dbb334259bdef8495ca3f4132 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:15.570446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2ae62-97e8-46c7-bd46-04e48789616b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:15.646940 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f3cb7-b0a1-48e7-a9a4-5b8ddb58db36 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:15.668310 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:15.716276 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2ae62-97e8-46c7-bd46-04e48789616b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:15.729600 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702387b9-6794-47fa-8a01-32ca3a30346b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:15.730585 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702387b9-6794-47fa-8a01-32ca3a30346b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:15.731028 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702387b9-6794-47fa-8a01-32ca3a30346b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:15.731458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702387b9-6794-47fa-8a01-32ca3a30346b None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:15.732417 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702387b9-6794-47fa-8a01-32ca3a30346b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:15.732887 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702387b9-6794-47fa-8a01-32ca3a30346b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:15.734678 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702387b9-6794-47fa-8a01-32ca3a30346b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:15.753266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 197/371] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:15.754145 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702387b9-6794-47fa-8a01-32ca3a30346b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:15.787098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a12bd-c13a-484b-b184-3ab978b7598b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:15.787785 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a12bd-c13a-484b-b184-3ab978b7598b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:15.788057 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a12bd-c13a-484b-b184-3ab978b7598b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:15.788324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a12bd-c13a-484b-b184-3ab978b7598b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:15.789179 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a12bd-c13a-484b-b184-3ab978b7598b None admin] RBAC: Adding query filter params (role.id=e3afb7f30d8240539b9d7139c5ade987, user.id=010db7bf2c0e4250bd87959760c9ed75, scope.system=all) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:15.789488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a12bd-c13a-484b-b184-3ab978b7598b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:15.790980 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a12bd-c13a-484b-b184-3ab978b7598b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:15.818423 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 175/372] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Jun 2 13:26:15 2022] GET /identity/v3/role_assignments?user.id=010db7bf2c0e4250bd87959760c9ed75&scope.system=all&role.id=e3afb7f30d8240539b9d7139c5ade987 => generated 510 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:15.819467 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a12bd-c13a-484b-b184-3ab978b7598b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:15.922382 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:15.962466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702387b9-6794-47fa-8a01-32ca3a30346b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:16.020935 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a12bd-c13a-484b-b184-3ab978b7598b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:16.030765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d4cdb-41ce-4c90-9f01-40a137c29a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:16.031442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d4cdb-41ce-4c90-9f01-40a137c29a2c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:16.031716 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d4cdb-41ce-4c90-9f01-40a137c29a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:16.031981 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d4cdb-41ce-4c90-9f01-40a137c29a2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:16.089470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713b1a2-35a6-4f55-b4e4-ddd5e7e9c2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:16.090045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713b1a2-35a6-4f55-b4e4-ddd5e7e9c2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:16.090319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713b1a2-35a6-4f55-b4e4-ddd5e7e9c2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:16.090602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713b1a2-35a6-4f55-b4e4-ddd5e7e9c2c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:16.096892 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:16.159799 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d4cdb-41ce-4c90-9f01-40a137c29a2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:16.161289 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d4cdb-41ce-4c90-9f01-40a137c29a2c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:16.186035 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713b1a2-35a6-4f55-b4e4-ddd5e7e9c2c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:16.187957 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713b1a2-35a6-4f55-b4e4-ddd5e7e9c2c6 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:16.311115 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:16.325177 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 176/373] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:16.332565 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713b1a2-35a6-4f55-b4e4-ddd5e7e9c2c6 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:16.346024 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 198/374] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:16.350991 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d4cdb-41ce-4c90-9f01-40a137c29a2c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:16.390351 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:16.502519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d4cdb-41ce-4c90-9f01-40a137c29a2c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:16.524718 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713b1a2-35a6-4f55-b4e4-ddd5e7e9c2c6 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:16.540722 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb896f9-d725-461d-8c32-fddfe73ba8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:16.541609 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb896f9-d725-461d-8c32-fddfe73ba8ea None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:16.542230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb896f9-d725-461d-8c32-fddfe73ba8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:16.542521 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb896f9-d725-461d-8c32-fddfe73ba8ea None admin] PATH_INFO: `/v3/projects/6f065dd8bbe74892af29e05cef5a6d11` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:16.543797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb896f9-d725-461d-8c32-fddfe73ba8ea None admin] RBAC: Authorizing `identity:get_project(project_id=6f065dd8bbe74892af29e05cef5a6d11)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:16.546777 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb896f9-d725-461d-8c32-fddfe73ba8ea None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:16.549132 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 199/375] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:26:16 2022] GET /identity/v3/projects/6f065dd8bbe74892af29e05cef5a6d11 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:26:16.555516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb896f9-d725-461d-8c32-fddfe73ba8ea None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:16.598365 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148a487-b215-4351-9dc7-6031f4e92bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:16.599206 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148a487-b215-4351-9dc7-6031f4e92bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:16.599485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148a487-b215-4351-9dc7-6031f4e92bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:16.599755 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148a487-b215-4351-9dc7-6031f4e92bf1 None admin] PATH_INFO: `/v3/projects/119d80c3d10b4ce0978a2de4f94e5475` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:16.601715 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148a487-b215-4351-9dc7-6031f4e92bf1 None admin] RBAC: Authorizing `identity:get_project(project_id=119d80c3d10b4ce0978a2de4f94e5475)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:16.603184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148a487-b215-4351-9dc7-6031f4e92bf1 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:16.605841 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 177/376] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:26:16 2022] GET /identity/v3/projects/119d80c3d10b4ce0978a2de4f94e5475 => generated 344 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:26:16.612914 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148a487-b215-4351-9dc7-6031f4e92bf1 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:16.647005 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:16.740296 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148a487-b215-4351-9dc7-6031f4e92bf1 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:16.741158 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb896f9-d725-461d-8c32-fddfe73ba8ea None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:16.742443 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:16.784506 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280cdea-8c0f-4a46-858b-02caeb510551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:16.785805 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280cdea-8c0f-4a46-858b-02caeb510551 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:16.786282 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280cdea-8c0f-4a46-858b-02caeb510551 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:16.787447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280cdea-8c0f-4a46-858b-02caeb510551 None admin] PATH_INFO: `/v3/groups/4834fed164b345118eb1f82c612b7c99` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:16.796183 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280cdea-8c0f-4a46-858b-02caeb510551 None admin] RBAC: Authorizing `identity:get_group(group_id=4834fed164b345118eb1f82c612b7c99)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:16.798075 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280cdea-8c0f-4a46-858b-02caeb510551 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:16.801251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 178/377] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 13:26:16 2022] GET /identity/v3/groups/4834fed164b345118eb1f82c612b7c99 => generated 229 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:16.807704 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280cdea-8c0f-4a46-858b-02caeb510551 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:16.827211 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c76ad-953b-4e51-b23b-ee6777d4a031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:16.829781 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c76ad-953b-4e51-b23b-ee6777d4a031 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:16.830498 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c76ad-953b-4e51-b23b-ee6777d4a031 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:16.832285 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c76ad-953b-4e51-b23b-ee6777d4a031 None admin] PATH_INFO: `/v3/groups/c59f5373ff3d4a02aa2c101e978f047a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:16.834149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c76ad-953b-4e51-b23b-ee6777d4a031 None admin] RBAC: Authorizing `identity:get_group(group_id=c59f5373ff3d4a02aa2c101e978f047a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:16.837117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c76ad-953b-4e51-b23b-ee6777d4a031 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:16.840172 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 200/378] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 13:26:16 2022] GET /identity/v3/groups/c59f5373ff3d4a02aa2c101e978f047a => generated 226 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:16.846774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c76ad-953b-4e51-b23b-ee6777d4a031 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:16.980545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c76ad-953b-4e51-b23b-ee6777d4a031 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:17.001643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:17.021859 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4a793-4aba-4fe4-a497-b18e477c55f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:17.022925 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4a793-4aba-4fe4-a497-b18e477c55f5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:17.023396 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4a793-4aba-4fe4-a497-b18e477c55f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:17.023868 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4a793-4aba-4fe4-a497-b18e477c55f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:17.024896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4a793-4aba-4fe4-a497-b18e477c55f5 None admin] RBAC: Adding query filter params (group.id=c59f5373ff3d4a02aa2c101e978f047a, role.id=f63a52fb33144307bba2318551138669, scope.project.id=6f065dd8bbe74892af29e05cef5a6d11) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:17.025400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4a793-4aba-4fe4-a497-b18e477c55f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:17.027055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4a793-4aba-4fe4-a497-b18e477c55f5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:17.034303 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 201/379] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 2 13:26:16 2022] GET /identity/v3/role_assignments?group.id=c59f5373ff3d4a02aa2c101e978f047a&scope.project.id=6f065dd8bbe74892af29e05cef5a6d11&role.id=f63a52fb33144307bba2318551138669 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:17.042833 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280cdea-8c0f-4a46-858b-02caeb510551 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:17.086155 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd01cb1-e578-42da-b805-77c8e1616dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:17.087216 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd01cb1-e578-42da-b805-77c8e1616dec None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:17.087715 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd01cb1-e578-42da-b805-77c8e1616dec None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:17.088177 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd01cb1-e578-42da-b805-77c8e1616dec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:17.089196 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd01cb1-e578-42da-b805-77c8e1616dec None admin] RBAC: Adding query filter params (group.id=4834fed164b345118eb1f82c612b7c99, role.id=6edd584a77084fa78240661ea76cddb5, scope.project.id=119d80c3d10b4ce0978a2de4f94e5475) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:17.089710 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd01cb1-e578-42da-b805-77c8e1616dec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:17.091346 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd01cb1-e578-42da-b805-77c8e1616dec None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:17.099720 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 179/380] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 2 13:26:16 2022] GET /identity/v3/role_assignments?group.id=4834fed164b345118eb1f82c612b7c99&scope.project.id=119d80c3d10b4ce0978a2de4f94e5475&role.id=6edd584a77084fa78240661ea76cddb5 => generated 260 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:17.305015 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c76a7-d472-406a-98cb-c7f037ca043d None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:17.305656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c76a7-d472-406a-98cb-c7f037ca043d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:17.306125 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c76a7-d472-406a-98cb-c7f037ca043d None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:17.307823 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 202/381] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:17.314113 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d0bc9-a1e2-45b6-9295-af2c28c517f8 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:17.314758 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d0bc9-a1e2-45b6-9295-af2c28c517f8 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:17.315253 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d0bc9-a1e2-45b6-9295-af2c28c517f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:17.338202 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-094d0bc9-a1e2-45b6-9295-af2c28c517f8 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:17.340226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-094d0bc9-a1e2-45b6-9295-af2c28c517f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:17.376738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:17.439833 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 180/382] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:26:17.463899 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c76a7-d472-406a-98cb-c7f037ca043d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:17.599912 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c76a7-d472-406a-98cb-c7f037ca043d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:17.668227 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a968a3-0ff0-46f5-98c7-e98e0b86c6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:17.669341 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a968a3-0ff0-46f5-98c7-e98e0b86c6fb None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:17.669916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a968a3-0ff0-46f5-98c7-e98e0b86c6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:17.670464 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a968a3-0ff0-46f5-98c7-e98e0b86c6fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:17.688309 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a968a3-0ff0-46f5-98c7-e98e0b86c6fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:17.696643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-43a968a3-0ff0-46f5-98c7-e98e0b86c6fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:26:17.696643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:17.696643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:17.696643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:17.696643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:17.696643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:17.696643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:17.696643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:17.696643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:17.696643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:17.696643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:17.696643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:17.696643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:17.696643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:17.696643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:17.696643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:17.697695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:17.697695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:17.697695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:17.697695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:17.697695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:17.697695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:17.697695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:17.697695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:17.697695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:17.697695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:17.697695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:17.697695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:17.697695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:17.697695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:17.697695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:17.697695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:17.702804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:17.702804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:17.702804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:17.702804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:17.702804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:17.702804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:17.702804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:17.702804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:17.702804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:17.702804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:17.702804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:26:17.702804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:17.704269 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 203/383] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 13:26:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:17.710223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d0bc9-a1e2-45b6-9295-af2c28c517f8 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:17.868429 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d0bc9-a1e2-45b6-9295-af2c28c517f8 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:17.903869 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce2fcd-7168-412d-9f8d-8b568d1e0ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:17.904658 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce2fcd-7168-412d-9f8d-8b568d1e0ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:17.904960 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce2fcd-7168-412d-9f8d-8b568d1e0ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:17.905290 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce2fcd-7168-412d-9f8d-8b568d1e0ad5 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:17.906153 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce2fcd-7168-412d-9f8d-8b568d1e0ad5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:17.906453 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce2fcd-7168-412d-9f8d-8b568d1e0ad5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:17.907873 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce2fcd-7168-412d-9f8d-8b568d1e0ad5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:17.916889 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 181/384] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:17.923894 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a968a3-0ff0-46f5-98c7-e98e0b86c6fb None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:17.995250 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:18.078232 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a968a3-0ff0-46f5-98c7-e98e0b86c6fb None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:18.116725 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d45b2-f4e4-4f62-948d-6484e4d49aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:18.117596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d45b2-f4e4-4f62-948d-6484e4d49aee None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:18.117871 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d45b2-f4e4-4f62-948d-6484e4d49aee None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:18.118138 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d45b2-f4e4-4f62-948d-6484e4d49aee None admin] PATH_INFO: `/v3/groups/c59f5373ff3d4a02aa2c101e978f047a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:18.119391 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d45b2-f4e4-4f62-948d-6484e4d49aee None admin] RBAC: Authorizing `identity:get_group(group_id=c59f5373ff3d4a02aa2c101e978f047a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:18.120777 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d45b2-f4e4-4f62-948d-6484e4d49aee None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:18.122926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 204/385] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 13:26:17 2022] GET /identity/v3/groups/c59f5373ff3d4a02aa2c101e978f047a => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:18.131678 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce2fcd-7168-412d-9f8d-8b568d1e0ad5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:18.169512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:18.207609 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b184e1-fb58-42a2-8bb7-b5009983b29e None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:18.207938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b184e1-fb58-42a2-8bb7-b5009983b29e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:18.208166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b184e1-fb58-42a2-8bb7-b5009983b29e None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:18.210376 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 205/386] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:18.216010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cee01-4546-433d-8a34-83cc359c5b0b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:18.216296 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cee01-4546-433d-8a34-83cc359c5b0b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:18.217206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cee01-4546-433d-8a34-83cc359c5b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:18.240817 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-174cee01-4546-433d-8a34-83cc359c5b0b None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:18.242060 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-174cee01-4546-433d-8a34-83cc359c5b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:18.306355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce2fcd-7168-412d-9f8d-8b568d1e0ad5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:18.349817 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad03f1f-30e5-4047-9543-7795ec6848a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:18.350654 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad03f1f-30e5-4047-9543-7795ec6848a0 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:18.350943 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad03f1f-30e5-4047-9543-7795ec6848a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:18.351218 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad03f1f-30e5-4047-9543-7795ec6848a0 None admin] PATH_INFO: `/v3/projects/ce43efdcbb764869a0f4347b5b29fcca` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:18.355353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad03f1f-30e5-4047-9543-7795ec6848a0 None admin] RBAC: Authorizing `identity:get_project(project_id=ce43efdcbb764869a0f4347b5b29fcca)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:18.356834 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad03f1f-30e5-4047-9543-7795ec6848a0 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:18.359028 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 182/387] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:26:18 2022] GET /identity/v3/projects/ce43efdcbb764869a0f4347b5b29fcca => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:18.366459 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad03f1f-30e5-4047-9543-7795ec6848a0 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:18.370604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 206/388] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:26:18.455674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cee01-4546-433d-8a34-83cc359c5b0b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:18.486010 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:18.497153 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad03f1f-30e5-4047-9543-7795ec6848a0 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:18.537348 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b641528-b7e5-4b8b-8714-8bbfd515ad70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:18.538477 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b641528-b7e5-4b8b-8714-8bbfd515ad70 None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:18.538777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b641528-b7e5-4b8b-8714-8bbfd515ad70 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:18.539048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b641528-b7e5-4b8b-8714-8bbfd515ad70 None admin] PATH_INFO: `/v3/projects/ce43efdcbb764869a0f4347b5b29fcca/groups/c59f5373ff3d4a02aa2c101e978f047a/roles/f63a52fb33144307bba2318551138669` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:18.543832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b641528-b7e5-4b8b-8714-8bbfd515ad70 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce43efdcbb764869a0f4347b5b29fcca, group_id=c59f5373ff3d4a02aa2c101e978f047a, role_id=f63a52fb33144307bba2318551138669)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:18.546809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b641528-b7e5-4b8b-8714-8bbfd515ad70 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:18.554938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:18.574351 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 183/389] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Jun 2 13:26:18 2022] PUT /identity/v3/projects/ce43efdcbb764869a0f4347b5b29fcca/groups/c59f5373ff3d4a02aa2c101e978f047a/roles/f63a52fb33144307bba2318551138669 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:26:18.585764 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a09d42-a7cd-48cb-9e38-35c67411f34f None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:18.586107 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a09d42-a7cd-48cb-9e38-35c67411f34f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:18.586307 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a09d42-a7cd-48cb-9e38-35c67411f34f None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:18.587901 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 184/390] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:26:18.593780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028c406-6eb8-45a6-a5cf-f8921891a358 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:18.594080 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028c406-6eb8-45a6-a5cf-f8921891a358 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:18.594336 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028c406-6eb8-45a6-a5cf-f8921891a358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:18.631589 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d028c406-6eb8-45a6-a5cf-f8921891a358 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:18.631589 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d028c406-6eb8-45a6-a5cf-f8921891a358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:18.663645 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cee01-4546-433d-8a34-83cc359c5b0b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:18.705091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965e5d8-d4c7-4276-8610-46c44da3caac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:18.705972 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965e5d8-d4c7-4276-8610-46c44da3caac None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:18.706254 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965e5d8-d4c7-4276-8610-46c44da3caac None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:18.706525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965e5d8-d4c7-4276-8610-46c44da3caac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:18.720974 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965e5d8-d4c7-4276-8610-46c44da3caac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:18.729847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-2965e5d8-d4c7-4276-8610-46c44da3caac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:26:18.729847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:18.729847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:18.729847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:18.729847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:18.729847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:18.729847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:18.729847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:18.729847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:18.729847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:18.729847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:18.729847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:18.729847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:18.729847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:18.729847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:18.729847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:18.730837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:18.730837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:18.730837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:18.730837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:18.730837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:18.730837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:18.730837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:18.730837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:18.730837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:18.730837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:18.730837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:18.730837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:18.730837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:18.730837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:18.730837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:18.730837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:18.731617 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:18.731617 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:18.731617 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:18.731617 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:18.731617 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:18.731617 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:18.731617 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:18.731617 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:18.731617 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:18.731617 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:18.731617 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:26:18.731617 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:18.731617 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 207/391] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:18.737716 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965e5d8-d4c7-4276-8610-46c44da3caac None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:18.822048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 185/392] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:26:18.855849 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028c406-6eb8-45a6-a5cf-f8921891a358 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:18.891608 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:18.895432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965e5d8-d4c7-4276-8610-46c44da3caac None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:18.933377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9877d8-c826-4e39-b591-856a30088459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:18.934201 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9877d8-c826-4e39-b591-856a30088459 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:18.934553 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9877d8-c826-4e39-b591-856a30088459 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:18.934992 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9877d8-c826-4e39-b591-856a30088459 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:18.935901 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9877d8-c826-4e39-b591-856a30088459 None admin] RBAC: Adding query filter params (name=member) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:18.936261 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9877d8-c826-4e39-b591-856a30088459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:18.937847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9877d8-c826-4e39-b591-856a30088459 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:18.946733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 208/393] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:26:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:26:18.955353 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9877d8-c826-4e39-b591-856a30088459 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:18.967171 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:19.005308 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028c406-6eb8-45a6-a5cf-f8921891a358 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:19.076531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4884dd-3189-4882-bfdd-3c35b370d6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:19.077428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4884dd-3189-4882-bfdd-3c35b370d6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:19.077759 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4884dd-3189-4882-bfdd-3c35b370d6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:19.078031 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4884dd-3189-4882-bfdd-3c35b370d6e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:19.096196 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4884dd-3189-4882-bfdd-3c35b370d6e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:19.104447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-5d4884dd-3189-4882-bfdd-3c35b370d6e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:26:19.104447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:19.104447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:19.104447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:19.104447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:19.104447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:19.104447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:19.104447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:19.104447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:19.104447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:19.104447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:19.104447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:19.104447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:19.104447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:19.104447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:19.104447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:19.105340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:19.105340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:19.105340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:19.105340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:19.105340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:19.105340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:19.105340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:19.105340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:19.105340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:19.105340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:19.105340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:19.105340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:19.105340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:19.105340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:19.105340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:19.105340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:19.106136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:19.106136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:19.106136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:19.106136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:19.106136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:19.106136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:19.106136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:19.106136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:19.106136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:19.106136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:19.106136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:26:19.106136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:19.106136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 186/394] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:26:19.111567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4884dd-3189-4882-bfdd-3c35b370d6e2 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:19.129946 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9877d8-c826-4e39-b591-856a30088459 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:19.200075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdafb3b-111c-46e0-bd4a-40041b7410b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:19.201140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdafb3b-111c-46e0-bd4a-40041b7410b2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:19.201561 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdafb3b-111c-46e0-bd4a-40041b7410b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:19.201845 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdafb3b-111c-46e0-bd4a-40041b7410b2 None admin] PATH_INFO: `/v3/groups/c59f5373ff3d4a02aa2c101e978f047a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:19.207425 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdafb3b-111c-46e0-bd4a-40041b7410b2 None admin] RBAC: Authorizing `identity:get_group(group_id=c59f5373ff3d4a02aa2c101e978f047a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:19.208987 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdafb3b-111c-46e0-bd4a-40041b7410b2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:19.211167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 209/395] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 13:26:18 2022] GET /identity/v3/groups/c59f5373ff3d4a02aa2c101e978f047a => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:19.215303 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4884dd-3189-4882-bfdd-3c35b370d6e2 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:19.216787 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdafb3b-111c-46e0-bd4a-40041b7410b2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:19.251775 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa541d-06e8-4074-81b9-1677b8a65f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:19.252560 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa541d-06e8-4074-81b9-1677b8a65f44 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:19.252836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa541d-06e8-4074-81b9-1677b8a65f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:19.253119 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa541d-06e8-4074-81b9-1677b8a65f44 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:19.253984 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa541d-06e8-4074-81b9-1677b8a65f44 None admin] RBAC: Adding query filter params (name=member) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:19.254297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa541d-06e8-4074-81b9-1677b8a65f44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:19.255704 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa541d-06e8-4074-81b9-1677b8a65f44 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:19.263501 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:19.264776 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 187/396] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:26:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:26:19.271589 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa541d-06e8-4074-81b9-1677b8a65f44 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:19.277038 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:19.384167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdafb3b-111c-46e0-bd4a-40041b7410b2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:19.388981 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa541d-06e8-4074-81b9-1677b8a65f44 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:19.452363 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f2154-9bd4-4c1a-b831-c2768cfc2e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:19.453158 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f2154-9bd4-4c1a-b831-c2768cfc2e1b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:19.453433 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f2154-9bd4-4c1a-b831-c2768cfc2e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:19.453695 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f2154-9bd4-4c1a-b831-c2768cfc2e1b None admin] PATH_INFO: `/v3/groups/c59f5373ff3d4a02aa2c101e978f047a` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:19.455119 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f2154-9bd4-4c1a-b831-c2768cfc2e1b None admin] RBAC: Authorizing `identity:get_group(group_id=c59f5373ff3d4a02aa2c101e978f047a)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:19.456670 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f2154-9bd4-4c1a-b831-c2768cfc2e1b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:19.458479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 188/397] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 13:26:19 2022] GET /identity/v3/groups/c59f5373ff3d4a02aa2c101e978f047a => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:19.467390 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f2154-9bd4-4c1a-b831-c2768cfc2e1b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:19.475221 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be18442-d53c-4538-82ba-16a06b317ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:19.476023 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be18442-d53c-4538-82ba-16a06b317ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:19.476300 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be18442-d53c-4538-82ba-16a06b317ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:19.476569 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be18442-d53c-4538-82ba-16a06b317ae8 None admin] PATH_INFO: `/v3/projects/ce43efdcbb764869a0f4347b5b29fcca` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:19.483016 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be18442-d53c-4538-82ba-16a06b317ae8 None admin] RBAC: Authorizing `identity:get_project(project_id=ce43efdcbb764869a0f4347b5b29fcca)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:19.484186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be18442-d53c-4538-82ba-16a06b317ae8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:19.485936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 210/398] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:26:19 2022] GET /identity/v3/projects/ce43efdcbb764869a0f4347b5b29fcca => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:26:19.495884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be18442-d53c-4538-82ba-16a06b317ae8 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:19.552061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:19.587470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f2154-9bd4-4c1a-b831-c2768cfc2e1b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:19.626747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc113d49-07a0-4267-8457-302949bbaa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:19.636939 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc113d49-07a0-4267-8457-302949bbaa0b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:19.637249 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc113d49-07a0-4267-8457-302949bbaa0b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:19.637512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc113d49-07a0-4267-8457-302949bbaa0b None admin] PATH_INFO: `/v3/projects/6f065dd8bbe74892af29e05cef5a6d11` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:19.639319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc113d49-07a0-4267-8457-302949bbaa0b None admin] RBAC: Authorizing `identity:get_project(project_id=6f065dd8bbe74892af29e05cef5a6d11)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:19.641025 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc113d49-07a0-4267-8457-302949bbaa0b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:19.643785 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 189/399] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:26:19 2022] GET /identity/v3/projects/6f065dd8bbe74892af29e05cef5a6d11 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:19.649161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc113d49-07a0-4267-8457-302949bbaa0b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:19.727018 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:19.737063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be18442-d53c-4538-82ba-16a06b317ae8 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:19.785254 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc113d49-07a0-4267-8457-302949bbaa0b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:19.786196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddb93d-877e-4c42-96c0-5f04af6125ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:19.787163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddb93d-877e-4c42-96c0-5f04af6125ea None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:19.787426 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddb93d-877e-4c42-96c0-5f04af6125ea None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:19.787700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddb93d-877e-4c42-96c0-5f04af6125ea None admin] PATH_INFO: `/v3/projects/ce43efdcbb764869a0f4347b5b29fcca/groups/c59f5373ff3d4a02aa2c101e978f047a/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:19.789695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddb93d-877e-4c42-96c0-5f04af6125ea None admin] RBAC: Authorizing `identity:create_grant(project_id=ce43efdcbb764869a0f4347b5b29fcca, group_id=c59f5373ff3d4a02aa2c101e978f047a, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:19.791398 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddb93d-877e-4c42-96c0-5f04af6125ea None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:19.808748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 211/400] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Jun 2 13:26:19 2022] PUT /identity/v3/projects/ce43efdcbb764869a0f4347b5b29fcca/groups/c59f5373ff3d4a02aa2c101e978f047a/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:26:19.810211 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97880d8-05a7-4228-8be0-41bac5200321 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:19.810558 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97880d8-05a7-4228-8be0-41bac5200321 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:19.810974 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97880d8-05a7-4228-8be0-41bac5200321 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:19.812334 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 212/401] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:19.823568 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96a03b-f711-473e-ac79-ae82f7c57983 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:19.823901 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96a03b-f711-473e-ac79-ae82f7c57983 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:19.824114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96a03b-f711-473e-ac79-ae82f7c57983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:19.852509 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3eb96-19fc-4dd5-a4df-47bc32efffbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:19.853479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3eb96-19fc-4dd5-a4df-47bc32efffbe None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:19.853754 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3eb96-19fc-4dd5-a4df-47bc32efffbe None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:19.854022 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3eb96-19fc-4dd5-a4df-47bc32efffbe None admin] PATH_INFO: `/v3/projects/6f065dd8bbe74892af29e05cef5a6d11/groups/c59f5373ff3d4a02aa2c101e978f047a/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:19.856758 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3eb96-19fc-4dd5-a4df-47bc32efffbe None admin] RBAC: Authorizing `identity:create_grant(project_id=6f065dd8bbe74892af29e05cef5a6d11, group_id=c59f5373ff3d4a02aa2c101e978f047a, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:19.858353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3eb96-19fc-4dd5-a4df-47bc32efffbe None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:19.860362 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-1e96a03b-f711-473e-ac79-ae82f7c57983 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:19.863269 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1e96a03b-f711-473e-ac79-ae82f7c57983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:19.877952 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:19.884691 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 190/402] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Jun 2 13:26:19 2022] PUT /identity/v3/projects/6f065dd8bbe74892af29e05cef5a6d11/groups/c59f5373ff3d4a02aa2c101e978f047a/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:26:19.949850 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 213/403] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:19.973213 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3eb96-19fc-4dd5-a4df-47bc32efffbe None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:19.998032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39216f-b488-4c54-8eab-a41ba1eadd90 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:19.998245 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39216f-b488-4c54-8eab-a41ba1eadd90 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:19.998461 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39216f-b488-4c54-8eab-a41ba1eadd90 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:20.000410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 214/404] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:26:20.005927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cf105-005e-4cd2-8773-09f3d0c70bf0 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:20.006206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cf105-005e-4cd2-8773-09f3d0c70bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:20.006475 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cf105-005e-4cd2-8773-09f3d0c70bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:20.037594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-916cf105-005e-4cd2-8773-09f3d0c70bf0 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:20.038843 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-916cf105-005e-4cd2-8773-09f3d0c70bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:20.150015 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3eb96-19fc-4dd5-a4df-47bc32efffbe None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:20.167316 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 215/405] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:26:20.194977 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cf105-005e-4cd2-8773-09f3d0c70bf0 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:20.199753 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4088013-5041-4d56-afdd-306b2b5372fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:20.200852 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4088013-5041-4d56-afdd-306b2b5372fc None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:20.201478 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4088013-5041-4d56-afdd-306b2b5372fc None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:20.201948 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4088013-5041-4d56-afdd-306b2b5372fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:20.214298 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:20.216141 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4088013-5041-4d56-afdd-306b2b5372fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:20.225094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-b4088013-5041-4d56-afdd-306b2b5372fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:26:20.225094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:20.225094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:20.225094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:20.225094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:20.225094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:20.225094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:20.225094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:20.225094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:20.225094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:20.225094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:20.225094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:20.225094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:20.225094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:20.225094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:20.225094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:20.226076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:20.226076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:20.226076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:20.226076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:20.226076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:20.226076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:20.226076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:20.226076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:20.226076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:20.226076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:20.226076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:20.226076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:20.226076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:20.226076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:20.226076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:20.226076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:20.226884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:20.226884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:20.226884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:20.226884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:20.226884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:20.226884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:20.226884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:20.226884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:20.226884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:20.226884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:20.226884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:26:20.226884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:20.229854 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 191/406] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 13:26:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:20.235851 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4088013-5041-4d56-afdd-306b2b5372fc None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:20.310622 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cf105-005e-4cd2-8773-09f3d0c70bf0 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:20.348186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2d0e6-9489-4bb4-8172-1f55c0f9c1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:20.349003 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2d0e6-9489-4bb4-8172-1f55c0f9c1cb None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:20.349284 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2d0e6-9489-4bb4-8172-1f55c0f9c1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:20.349554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2d0e6-9489-4bb4-8172-1f55c0f9c1cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:20.353909 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:20.371092 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2d0e6-9489-4bb4-8172-1f55c0f9c1cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:20.383450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-e8e2d0e6-9489-4bb4-8172-1f55c0f9c1cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:26:20.383450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:20.383450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:20.383450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:20.383450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:20.383450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:20.383450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:20.383450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:20.383450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:20.383450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:20.383450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:20.383450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:20.383450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:20.383450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:20.383450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:20.383450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:20.384423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:20.384423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:20.384423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:20.384423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:20.384423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:20.384423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:20.384423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:20.384423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:20.384423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:20.384423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:20.384423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:20.384423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:20.384423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:20.384423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:20.384423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:20.384423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:20.385213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:20.385213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:20.385213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:20.385213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:20.385213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:20.385213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:20.385213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:20.385213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:20.385213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:20.385213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:20.385213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:26:20.385213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:20.390938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 216/407] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:26:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:26:20.395890 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2d0e6-9489-4bb4-8172-1f55c0f9c1cb None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:20.440363 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4088013-5041-4d56-afdd-306b2b5372fc None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:20.495083 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46754e9a-4471-46ff-9146-a9b3edce33d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:20.495770 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46754e9a-4471-46ff-9146-a9b3edce33d9 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:20.496052 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46754e9a-4471-46ff-9146-a9b3edce33d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:20.496831 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46754e9a-4471-46ff-9146-a9b3edce33d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:20.497640 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46754e9a-4471-46ff-9146-a9b3edce33d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:20.498163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46754e9a-4471-46ff-9146-a9b3edce33d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:20.499663 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46754e9a-4471-46ff-9146-a9b3edce33d9 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:20.510736 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 192/408] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:26:20.519777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46754e9a-4471-46ff-9146-a9b3edce33d9 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:20.547010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:20.571838 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2d0e6-9489-4bb4-8172-1f55c0f9c1cb None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:20.605320 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93625b29-a8f4-4e17-9820-40ca2a246904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:20.605996 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93625b29-a8f4-4e17-9820-40ca2a246904 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:20.606271 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93625b29-a8f4-4e17-9820-40ca2a246904 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:20.606537 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93625b29-a8f4-4e17-9820-40ca2a246904 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:20.607422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93625b29-a8f4-4e17-9820-40ca2a246904 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:20.607729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93625b29-a8f4-4e17-9820-40ca2a246904 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:20.609110 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93625b29-a8f4-4e17-9820-40ca2a246904 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:20.621581 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 217/409] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:20.630127 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93625b29-a8f4-4e17-9820-40ca2a246904 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:20.772971 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46754e9a-4471-46ff-9146-a9b3edce33d9 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:20.788778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93625b29-a8f4-4e17-9820-40ca2a246904 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:20.814983 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:20.841325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2231a1-031b-4ca3-b8d8-596275f94a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:20.842246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2231a1-031b-4ca3-b8d8-596275f94a48 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:20.843762 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2231a1-031b-4ca3-b8d8-596275f94a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:20.844039 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2231a1-031b-4ca3-b8d8-596275f94a48 None admin] PATH_INFO: `/v3/groups/c59f5373ff3d4a02aa2c101e978f047a` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:20.846120 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2231a1-031b-4ca3-b8d8-596275f94a48 None admin] RBAC: Authorizing `identity:get_group(group_id=c59f5373ff3d4a02aa2c101e978f047a)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:20.848949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2231a1-031b-4ca3-b8d8-596275f94a48 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:20.857047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 193/410] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 13:26:20 2022] GET /identity/v3/groups/c59f5373ff3d4a02aa2c101e978f047a => generated 226 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:20.858207 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258eb46f-bf69-4cf7-9c28-379444267db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:20.859118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258eb46f-bf69-4cf7-9c28-379444267db0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:20.859396 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258eb46f-bf69-4cf7-9c28-379444267db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:20.859665 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258eb46f-bf69-4cf7-9c28-379444267db0 None admin] PATH_INFO: `/v3/groups/4834fed164b345118eb1f82c612b7c99` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:20.860835 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258eb46f-bf69-4cf7-9c28-379444267db0 None admin] RBAC: Authorizing `identity:get_group(group_id=4834fed164b345118eb1f82c612b7c99)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:20.862270 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258eb46f-bf69-4cf7-9c28-379444267db0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:20.864782 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 218/411] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 13:26:20 2022] GET /identity/v3/groups/4834fed164b345118eb1f82c612b7c99 => generated 229 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:20.869636 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2231a1-031b-4ca3-b8d8-596275f94a48 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:20.872444 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258eb46f-bf69-4cf7-9c28-379444267db0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:20.890980 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:21.019809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2231a1-031b-4ca3-b8d8-596275f94a48 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:21.026809 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258eb46f-bf69-4cf7-9c28-379444267db0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:21.065664 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1cb04-f6f2-4eec-a6ba-724cc9940c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:21.067103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1cb04-f6f2-4eec-a6ba-724cc9940c15 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:21.067602 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1cb04-f6f2-4eec-a6ba-724cc9940c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:21.068303 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1cb04-f6f2-4eec-a6ba-724cc9940c15 None admin] PATH_INFO: `/v3/projects/119d80c3d10b4ce0978a2de4f94e5475` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:21.069668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1cb04-f6f2-4eec-a6ba-724cc9940c15 None admin] RBAC: Authorizing `identity:get_project(project_id=119d80c3d10b4ce0978a2de4f94e5475)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:21.071781 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1cb04-f6f2-4eec-a6ba-724cc9940c15 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:21.074472 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 219/412] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:26:20 2022] GET /identity/v3/projects/119d80c3d10b4ce0978a2de4f94e5475 => generated 344 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:21.080761 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1cb04-f6f2-4eec-a6ba-724cc9940c15 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:21.100912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04394e89-f1df-49bf-96cd-10f41b570598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:21.101833 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04394e89-f1df-49bf-96cd-10f41b570598 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:21.102118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04394e89-f1df-49bf-96cd-10f41b570598 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:21.102393 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04394e89-f1df-49bf-96cd-10f41b570598 None admin] PATH_INFO: `/v3/projects/6f065dd8bbe74892af29e05cef5a6d11` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:21.105529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04394e89-f1df-49bf-96cd-10f41b570598 None admin] RBAC: Authorizing `identity:get_project(project_id=6f065dd8bbe74892af29e05cef5a6d11)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:21.107048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04394e89-f1df-49bf-96cd-10f41b570598 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:21.109725 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 194/413] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:26:20 2022] GET /identity/v3/projects/6f065dd8bbe74892af29e05cef5a6d11 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:21.116662 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04394e89-f1df-49bf-96cd-10f41b570598 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:21.172772 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:21.226117 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:21.227665 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1cb04-f6f2-4eec-a6ba-724cc9940c15 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:21.296614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ba35c-fe9f-4699-a952-cc31ea28d943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:21.297525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ba35c-fe9f-4699-a952-cc31ea28d943 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:21.297804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ba35c-fe9f-4699-a952-cc31ea28d943 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:21.298077 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ba35c-fe9f-4699-a952-cc31ea28d943 None admin] PATH_INFO: `/v3/projects/119d80c3d10b4ce0978a2de4f94e5475/groups/4834fed164b345118eb1f82c612b7c99/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:21.301851 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ba35c-fe9f-4699-a952-cc31ea28d943 None admin] RBAC: Authorizing `identity:create_grant(project_id=119d80c3d10b4ce0978a2de4f94e5475, group_id=4834fed164b345118eb1f82c612b7c99, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:21.303334 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ba35c-fe9f-4699-a952-cc31ea28d943 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:21.313191 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04394e89-f1df-49bf-96cd-10f41b570598 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:21.325991 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 220/414] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Jun 2 13:26:21 2022] PUT /identity/v3/projects/119d80c3d10b4ce0978a2de4f94e5475/groups/4834fed164b345118eb1f82c612b7c99/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:26:21.360353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464458a-4b40-40dd-8004-fccde59f6249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:21.361180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464458a-4b40-40dd-8004-fccde59f6249 None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:21.361463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464458a-4b40-40dd-8004-fccde59f6249 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:21.361735 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464458a-4b40-40dd-8004-fccde59f6249 None admin] PATH_INFO: `/v3/projects/6f065dd8bbe74892af29e05cef5a6d11/groups/c59f5373ff3d4a02aa2c101e978f047a/roles/f63a52fb33144307bba2318551138669` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:21.364248 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464458a-4b40-40dd-8004-fccde59f6249 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f065dd8bbe74892af29e05cef5a6d11, group_id=c59f5373ff3d4a02aa2c101e978f047a, role_id=f63a52fb33144307bba2318551138669)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:21.365811 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464458a-4b40-40dd-8004-fccde59f6249 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:21.388202 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 195/415] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Jun 2 13:26:21 2022] PUT /identity/v3/projects/6f065dd8bbe74892af29e05cef5a6d11/groups/c59f5373ff3d4a02aa2c101e978f047a/roles/f63a52fb33144307bba2318551138669 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:26:21.604074 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b237847-5758-40aa-9e07-3904afa857ea None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:21.604796 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b237847-5758-40aa-9e07-3904afa857ea None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:21.605272 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b237847-5758-40aa-9e07-3904afa857ea None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:21.606976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 221/416] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:21.613225 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27df6bf-f6e5-4977-98bc-42e811027eca None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:21.614145 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27df6bf-f6e5-4977-98bc-42e811027eca None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:21.614679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27df6bf-f6e5-4977-98bc-42e811027eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:21.645441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-c27df6bf-f6e5-4977-98bc-42e811027eca None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:21.647042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c27df6bf-f6e5-4977-98bc-42e811027eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:21.719644 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 196/417] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:21.743352 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b237847-5758-40aa-9e07-3904afa857ea None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:21.850588 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b237847-5758-40aa-9e07-3904afa857ea None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:21.885082 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9add46-c945-41db-9702-502044762e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:21.886268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9add46-c945-41db-9702-502044762e32 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:21.886758 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9add46-c945-41db-9702-502044762e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:21.887237 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9add46-c945-41db-9702-502044762e32 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:21.892579 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:21.900099 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9add46-c945-41db-9702-502044762e32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:21.909268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-ac9add46-c945-41db-9702-502044762e32 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:26:21.909268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:21.909268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:21.909268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:21.909268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:21.909268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:21.909268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:21.909268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:21.909268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:21.909268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:21.909268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:21.909268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:21.909268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:21.909268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:21.909268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:21.909268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:21.910368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:21.910368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:21.910368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:21.910368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:21.910368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:21.910368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:21.910368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:21.910368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:21.910368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:21.910368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:21.910368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:21.910368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:21.910368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:21.910368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:21.910368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:21.910368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:21.911264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:21.911264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:21.911264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:21.911264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:21.911264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:21.911264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:21.911264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:21.911264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:21.911264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:21.911264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:21.911264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:26:21.911264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:21.916151 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 222/418] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 13:26:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:21.921847 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27df6bf-f6e5-4977-98bc-42e811027eca None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:21.986081 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:22.082235 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27df6bf-f6e5-4977-98bc-42e811027eca None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:22.130085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b49654-f950-4f2f-983f-919625bca922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:22.130799 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b49654-f950-4f2f-983f-919625bca922 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:22.131080 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b49654-f950-4f2f-983f-919625bca922 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:22.131355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b49654-f950-4f2f-983f-919625bca922 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:22.132112 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b49654-f950-4f2f-983f-919625bca922 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:22.132415 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b49654-f950-4f2f-983f-919625bca922 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:22.133783 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b49654-f950-4f2f-983f-919625bca922 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:22.146497 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 197/419] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:22.151854 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9add46-c945-41db-9702-502044762e32 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:22.297862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9add46-c945-41db-9702-502044762e32 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:22.333154 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b3603-264b-4112-9203-037bde7c6154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:22.333813 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b3603-264b-4112-9203-037bde7c6154 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:22.334136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b3603-264b-4112-9203-037bde7c6154 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:22.334406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b3603-264b-4112-9203-037bde7c6154 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:22.406477 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:22.416577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b3603-264b-4112-9203-037bde7c6154 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:22.418028 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b3603-264b-4112-9203-037bde7c6154 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:22.546819 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 223/420] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:22.552324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b49654-f950-4f2f-983f-919625bca922 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:22.729234 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b49654-f950-4f2f-983f-919625bca922 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:22.743690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:22.775370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f2f26-f908-4234-b39b-447acf448b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:22.776263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f2f26-f908-4234-b39b-447acf448b15 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:22.776542 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f2f26-f908-4234-b39b-447acf448b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:22.776810 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f2f26-f908-4234-b39b-447acf448b15 None admin] PATH_INFO: `/v3/projects/ce43efdcbb764869a0f4347b5b29fcca` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:22.780155 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f2f26-f908-4234-b39b-447acf448b15 None admin] RBAC: Authorizing `identity:get_project(project_id=ce43efdcbb764869a0f4347b5b29fcca)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:22.781626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f2f26-f908-4234-b39b-447acf448b15 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:22.783601 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 198/421] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:26:22 2022] GET /identity/v3/projects/ce43efdcbb764869a0f4347b5b29fcca => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:22.788921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b3603-264b-4112-9203-037bde7c6154 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:22.818884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f4796-a86a-4e87-8509-a3d74eb39228 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:22.819228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f4796-a86a-4e87-8509-a3d74eb39228 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:22.819442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f4796-a86a-4e87-8509-a3d74eb39228 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:22.822289 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 199/422] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:26:22.827269 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e43eeb-4325-4a56-817a-dc49030f8358 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:22.827578 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e43eeb-4325-4a56-817a-dc49030f8358 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:22.827849 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e43eeb-4325-4a56-817a-dc49030f8358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:22.847040 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-56e43eeb-4325-4a56-817a-dc49030f8358 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:22.848398 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-56e43eeb-4325-4a56-817a-dc49030f8358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:22.929015 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 200/423] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:26:22.934656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85625df-af7c-4185-a14e-f138e6c0eac3 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:22.934983 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85625df-af7c-4185-a14e-f138e6c0eac3 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:22.935426 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85625df-af7c-4185-a14e-f138e6c0eac3 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:22.937124 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 201/424] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:22.951771 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76085-e3ae-47b6-b1ce-ebdada68c35c None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:22.952066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76085-e3ae-47b6-b1ce-ebdada68c35c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:22.952324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76085-e3ae-47b6-b1ce-ebdada68c35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:22.965081 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:22.975989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b3603-264b-4112-9203-037bde7c6154 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:22.978509 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-5cb76085-e3ae-47b6-b1ce-ebdada68c35c None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:22.979771 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5cb76085-e3ae-47b6-b1ce-ebdada68c35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:23.021611 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea868fb-96d4-4ce2-b14d-e8ce319b444b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:23.022502 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea868fb-96d4-4ce2-b14d-e8ce319b444b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:23.022831 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea868fb-96d4-4ce2-b14d-e8ce319b444b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:23.023105 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea868fb-96d4-4ce2-b14d-e8ce319b444b None admin] PATH_INFO: `/v3/groups/c59f5373ff3d4a02aa2c101e978f047a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:23.024347 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea868fb-96d4-4ce2-b14d-e8ce319b444b None admin] RBAC: Authorizing `identity:get_group(group_id=c59f5373ff3d4a02aa2c101e978f047a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:23.026450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea868fb-96d4-4ce2-b14d-e8ce319b444b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:23.029073 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 224/425] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 13:26:22 2022] GET /identity/v3/groups/c59f5373ff3d4a02aa2c101e978f047a => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:23.030406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea868fb-96d4-4ce2-b14d-e8ce319b444b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:23.054274 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 202/426] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:23.055232 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb76085-e3ae-47b6-b1ce-ebdada68c35c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:23.103609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:23.175433 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb76085-e3ae-47b6-b1ce-ebdada68c35c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:23.175641 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea868fb-96d4-4ce2-b14d-e8ce319b444b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:23.220402 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b24cca-7e9c-457a-bf0f-1e14288fccdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:23.222112 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b24cca-7e9c-457a-bf0f-1e14288fccdf None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:23.222536 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b24cca-7e9c-457a-bf0f-1e14288fccdf None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:23.222982 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b24cca-7e9c-457a-bf0f-1e14288fccdf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:23.226378 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be15fe-342a-4e22-8fc9-10c3bf72863e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:23.227144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be15fe-342a-4e22-8fc9-10c3bf72863e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:23.227495 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be15fe-342a-4e22-8fc9-10c3bf72863e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:23.227834 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be15fe-342a-4e22-8fc9-10c3bf72863e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:23.228918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be15fe-342a-4e22-8fc9-10c3bf72863e None admin] RBAC: Adding query filter params (group.id=c59f5373ff3d4a02aa2c101e978f047a, role.id=f63a52fb33144307bba2318551138669, scope.project.id=ce43efdcbb764869a0f4347b5b29fcca) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:23.229439 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be15fe-342a-4e22-8fc9-10c3bf72863e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:23.231024 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be15fe-342a-4e22-8fc9-10c3bf72863e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:23.236582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b24cca-7e9c-457a-bf0f-1e14288fccdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:23.239231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 203/427] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 2 13:26:23 2022] GET /identity/v3/role_assignments?group.id=c59f5373ff3d4a02aa2c101e978f047a&scope.project.id=ce43efdcbb764869a0f4347b5b29fcca&role.id=f63a52fb33144307bba2318551138669 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:23.240204 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be15fe-342a-4e22-8fc9-10c3bf72863e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:23.247140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-49b24cca-7e9c-457a-bf0f-1e14288fccdf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:26:23.247140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:23.247140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:23.247140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:23.247140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:23.247140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:23.247140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:23.247140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:23.247140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:23.247140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:23.247140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:23.247140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:23.247140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:23.247140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:23.247140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:23.247140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:23.248565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:23.248565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:23.248565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:23.248565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:23.248565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:23.248565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:23.248565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:23.248565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:23.248565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:23.248565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:23.248565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:23.248565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:23.248565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:23.248565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:23.248565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:23.248565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:23.249682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:23.249682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:23.249682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:23.249682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:23.249682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:23.249682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:23.249682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:23.249682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:23.249682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:23.249682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:23.249682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:26:23.249682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:23.258291 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 225/428] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:23.261125 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b24cca-7e9c-457a-bf0f-1e14288fccdf None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:23.327884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:23.367877 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:23.371734 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be15fe-342a-4e22-8fc9-10c3bf72863e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:23.412602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ca933-6bec-4964-96e8-637228fe882a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:23.413851 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ca933-6bec-4964-96e8-637228fe882a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:23.414348 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ca933-6bec-4964-96e8-637228fe882a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:23.414884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ca933-6bec-4964-96e8-637228fe882a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:23.428940 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5ca933-6bec-4964-96e8-637228fe882a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:23.438047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-0d5ca933-6bec-4964-96e8-637228fe882a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:26:23.438047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:23.438047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:23.438047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:23.438047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:23.438047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:23.438047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:23.438047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:23.438047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:23.438047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:23.438047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:23.438047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:23.438047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:23.438047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:23.438047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:23.438047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:23.438997 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:23.438997 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:23.438997 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:23.438997 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:23.438997 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:23.438997 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:23.438997 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:23.438997 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:23.438997 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:23.438997 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:23.438997 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:23.438997 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:23.438997 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:23.438997 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:23.438997 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:23.438997 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:23.439791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:23.439791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:23.439791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:23.439791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:23.439791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:23.439791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:23.439791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:23.439791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:23.439791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:23.439791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:23.439791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:26:23.439791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:23.442736 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 204/429] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:23.452218 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ca933-6bec-4964-96e8-637228fe882a None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:23.492806 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b24cca-7e9c-457a-bf0f-1e14288fccdf None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:23.542095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9952dc-dc55-49a3-84cd-f4fc6d2d66a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:23.544622 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9952dc-dc55-49a3-84cd-f4fc6d2d66a1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:23.547474 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9952dc-dc55-49a3-84cd-f4fc6d2d66a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:23.548064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9952dc-dc55-49a3-84cd-f4fc6d2d66a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:23.549110 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9952dc-dc55-49a3-84cd-f4fc6d2d66a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:23.550701 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9952dc-dc55-49a3-84cd-f4fc6d2d66a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:23.552335 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9952dc-dc55-49a3-84cd-f4fc6d2d66a1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:23.570639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 226/430] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:26:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:23.581985 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9952dc-dc55-49a3-84cd-f4fc6d2d66a1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:23.642468 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ca933-6bec-4964-96e8-637228fe882a None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:23.697783 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b406445-8d0f-446d-b6b7-acf8f2ffcae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:23.698086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:23.698856 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b406445-8d0f-446d-b6b7-acf8f2ffcae5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:23.698856 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b406445-8d0f-446d-b6b7-acf8f2ffcae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:23.699110 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b406445-8d0f-446d-b6b7-acf8f2ffcae5 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:23.700021 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b406445-8d0f-446d-b6b7-acf8f2ffcae5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:23.700295 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b406445-8d0f-446d-b6b7-acf8f2ffcae5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:23.702159 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b406445-8d0f-446d-b6b7-acf8f2ffcae5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:23.714532 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 205/431] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:26:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:23.720548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b406445-8d0f-446d-b6b7-acf8f2ffcae5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:23.724499 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9952dc-dc55-49a3-84cd-f4fc6d2d66a1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:23.753082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:23.776704 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d32ea-bb42-43cd-920b-1f7b82dba464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:23.777096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d32ea-bb42-43cd-920b-1f7b82dba464 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:23.777376 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d32ea-bb42-43cd-920b-1f7b82dba464 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:23.777642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d32ea-bb42-43cd-920b-1f7b82dba464 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:23.857781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b406445-8d0f-446d-b6b7-acf8f2ffcae5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:23.862845 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d32ea-bb42-43cd-920b-1f7b82dba464 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:23.864560 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d32ea-bb42-43cd-920b-1f7b82dba464 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:23.895600 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a29f1-54fa-4ecb-a2b6-16e68979cd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:23.896728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a29f1-54fa-4ecb-a2b6-16e68979cd18 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:23.896728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a29f1-54fa-4ecb-a2b6-16e68979cd18 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:23.896909 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a29f1-54fa-4ecb-a2b6-16e68979cd18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:23.970999 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:23.988656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a29f1-54fa-4ecb-a2b6-16e68979cd18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:23.989751 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a29f1-54fa-4ecb-a2b6-16e68979cd18 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:23.995017 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 227/432] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:26:23.995017 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4e563-a293-4cc1-bd6b-81dbb31ca1d5 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:23.995017 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4e563-a293-4cc1-bd6b-81dbb31ca1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:23.995269 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4e563-a293-4cc1-bd6b-81dbb31ca1d5 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:23.996928 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 228/433] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:23.999424 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4e563-a293-4cc1-bd6b-81dbb31ca1d5 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:24.022103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:24.106436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 206/434] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:24.111974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b7bb6-bd97-44f6-a13c-8d28e09e6b4e None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:24.111974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b7bb6-bd97-44f6-a13c-8d28e09e6b4e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:24.111974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b7bb6-bd97-44f6-a13c-8d28e09e6b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:24.114419 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4e563-a293-4cc1-bd6b-81dbb31ca1d5 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:24.125635 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-680b7bb6-bd97-44f6-a13c-8d28e09e6b4e None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:24.127112 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-680b7bb6-bd97-44f6-a13c-8d28e09e6b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:24.150005 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb84c90-b911-4bd8-b2ad-0bf3ed14f8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:24.150910 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb84c90-b911-4bd8-b2ad-0bf3ed14f8bd None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:24.151618 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb84c90-b911-4bd8-b2ad-0bf3ed14f8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:24.151896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb84c90-b911-4bd8-b2ad-0bf3ed14f8bd None admin] PATH_INFO: `/v3/projects/6f065dd8bbe74892af29e05cef5a6d11` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:24.153736 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb84c90-b911-4bd8-b2ad-0bf3ed14f8bd None admin] RBAC: Authorizing `identity:get_project(project_id=6f065dd8bbe74892af29e05cef5a6d11)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:24.156390 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb84c90-b911-4bd8-b2ad-0bf3ed14f8bd None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:24.163285 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 229/435] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:26:23 2022] GET /identity/v3/projects/6f065dd8bbe74892af29e05cef5a6d11 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:24.163285 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb84c90-b911-4bd8-b2ad-0bf3ed14f8bd None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:24.204961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 207/436] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:24.206149 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b7bb6-bd97-44f6-a13c-8d28e09e6b4e None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:24.222704 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:24.266631 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:24.270746 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb84c90-b911-4bd8-b2ad-0bf3ed14f8bd None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:24.306554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadfa865-af1b-42cd-ac24-9d9a782cabca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:24.307383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfa865-af1b-42cd-ac24-9d9a782cabca None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:24.307658 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfa865-af1b-42cd-ac24-9d9a782cabca None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:24.307922 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfa865-af1b-42cd-ac24-9d9a782cabca None admin] PATH_INFO: `/v3/projects/ce43efdcbb764869a0f4347b5b29fcca` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:24.309124 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadfa865-af1b-42cd-ac24-9d9a782cabca None admin] RBAC: Authorizing `identity:get_project(project_id=ce43efdcbb764869a0f4347b5b29fcca)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:24.310731 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadfa865-af1b-42cd-ac24-9d9a782cabca None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:24.312441 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 230/437] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:26:24 2022] GET /identity/v3/projects/ce43efdcbb764869a0f4347b5b29fcca => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:24.313555 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b7bb6-bd97-44f6-a13c-8d28e09e6b4e None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:24.313686 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6565605-bf74-46a7-81c8-d0e5fdd463d7 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:24.313926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6565605-bf74-46a7-81c8-d0e5fdd463d7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:24.314196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6565605-bf74-46a7-81c8-d0e5fdd463d7 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:24.315497 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 231/438] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:24.316223 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6565605-bf74-46a7-81c8-d0e5fdd463d7 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:24.352013 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7b5d7-8369-4cc5-98bf-aae82f627a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:24.352880 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7b5d7-8369-4cc5-98bf-aae82f627a9a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:24.353155 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7b5d7-8369-4cc5-98bf-aae82f627a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:24.353422 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7b5d7-8369-4cc5-98bf-aae82f627a9a None admin] PATH_INFO: `/v3/groups/c59f5373ff3d4a02aa2c101e978f047a` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:24.354596 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc7b5d7-8369-4cc5-98bf-aae82f627a9a None admin] RBAC: Authorizing `identity:get_group(group_id=c59f5373ff3d4a02aa2c101e978f047a)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:24.356035 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc7b5d7-8369-4cc5-98bf-aae82f627a9a None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:24.357752 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 208/439] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 13:26:24 2022] GET /identity/v3/groups/c59f5373ff3d4a02aa2c101e978f047a => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:24.358497 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7b5d7-8369-4cc5-98bf-aae82f627a9a None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:24.419127 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6565605-bf74-46a7-81c8-d0e5fdd463d7 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:24.441418 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:24.457439 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377c5ad-d6c7-444f-aa71-90cffd4f4f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:24.458254 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377c5ad-d6c7-444f-aa71-90cffd4f4f38 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:24.458529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377c5ad-d6c7-444f-aa71-90cffd4f4f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:24.458825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377c5ad-d6c7-444f-aa71-90cffd4f4f38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:24.470825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377c5ad-d6c7-444f-aa71-90cffd4f4f38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:24.478798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-4377c5ad-d6c7-444f-aa71-90cffd4f4f38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:26:24.478798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:24.478798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:24.478798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:24.478798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:24.478798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:24.478798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:24.478798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:24.478798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:24.478798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:24.478798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:24.478798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:24.478798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:24.478798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:24.478798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:24.478798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:24.479791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:24.479791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:24.479791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:24.479791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:24.479791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:24.479791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:24.479791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:24.479791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:24.479791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:24.479791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:24.479791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:24.479791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:24.479791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:24.479791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:24.479791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:24.479791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:24.480651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:24.480651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:24.480651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:24.480651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:24.480651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:24.480651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:24.480651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:24.480651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:24.480651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:24.480651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:24.480651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:26:24.480651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:24.480651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 232/440] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:26:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:24.481314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960a6f4-7687-4c30-9336-b3558ab10248 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:24.481722 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960a6f4-7687-4c30-9336-b3558ab10248 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:24.481810 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960a6f4-7687-4c30-9336-b3558ab10248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:24.499955 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b960a6f4-7687-4c30-9336-b3558ab10248 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:24.501169 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b960a6f4-7687-4c30-9336-b3558ab10248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:24.573406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 233/441] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:24.574164 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960a6f4-7687-4c30-9336-b3558ab10248 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:24.587371 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7b5d7-8369-4cc5-98bf-aae82f627a9a None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:24.607687 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:24.621589 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50467393-00e0-4319-850e-891ed57ecaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:24.622760 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50467393-00e0-4319-850e-891ed57ecaac None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:24.623025 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50467393-00e0-4319-850e-891ed57ecaac None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:24.623292 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50467393-00e0-4319-850e-891ed57ecaac None admin] PATH_INFO: `/v3/groups/c59f5373ff3d4a02aa2c101e978f047a` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:24.624433 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50467393-00e0-4319-850e-891ed57ecaac None admin] RBAC: Authorizing `identity:get_group(group_id=c59f5373ff3d4a02aa2c101e978f047a)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:24.626351 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50467393-00e0-4319-850e-891ed57ecaac None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:24.628018 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 209/442] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 13:26:24 2022] GET /identity/v3/groups/c59f5373ff3d4a02aa2c101e978f047a => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:24.628980 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50467393-00e0-4319-850e-891ed57ecaac None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:24.682813 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960a6f4-7687-4c30-9336-b3558ab10248 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:24.693698 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:24.718053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6faaad9-749a-4e49-bb9d-3bdc0b87034c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:24.718744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6faaad9-749a-4e49-bb9d-3bdc0b87034c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:24.719017 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6faaad9-749a-4e49-bb9d-3bdc0b87034c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:24.719282 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6faaad9-749a-4e49-bb9d-3bdc0b87034c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:24.720106 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6faaad9-749a-4e49-bb9d-3bdc0b87034c None admin] RBAC: Adding query filter params (group.id=c59f5373ff3d4a02aa2c101e978f047a, role.id=891bd78dbb334259bdef8495ca3f4132, scope.project.id=6f065dd8bbe74892af29e05cef5a6d11) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:24.720411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6faaad9-749a-4e49-bb9d-3bdc0b87034c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:24.721839 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6faaad9-749a-4e49-bb9d-3bdc0b87034c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:24.727768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 234/443] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 2 13:26:24 2022] GET /identity/v3/role_assignments?group.id=c59f5373ff3d4a02aa2c101e978f047a&scope.project.id=6f065dd8bbe74892af29e05cef5a6d11&role.id=891bd78dbb334259bdef8495ca3f4132 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:24.728620 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6faaad9-749a-4e49-bb9d-3bdc0b87034c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:24.730753 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50467393-00e0-4319-850e-891ed57ecaac None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:24.768955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b3ec6-0401-46b9-a4d6-e2c02a0b1c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:24.769751 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b3ec6-0401-46b9-a4d6-e2c02a0b1c16 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:24.769941 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b3ec6-0401-46b9-a4d6-e2c02a0b1c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:24.770195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b3ec6-0401-46b9-a4d6-e2c02a0b1c16 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:24.770994 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b3ec6-0401-46b9-a4d6-e2c02a0b1c16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:24.771300 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b3ec6-0401-46b9-a4d6-e2c02a0b1c16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:24.772714 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b3ec6-0401-46b9-a4d6-e2c02a0b1c16 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:24.782513 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 210/444] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:24.783253 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b3ec6-0401-46b9-a4d6-e2c02a0b1c16 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:24.845443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6faaad9-749a-4e49-bb9d-3bdc0b87034c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:24.845657 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:24.882278 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dec186-20e3-46be-afed-13d73e0b9355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:24.883164 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dec186-20e3-46be-afed-13d73e0b9355 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:24.883443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dec186-20e3-46be-afed-13d73e0b9355 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:24.883716 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dec186-20e3-46be-afed-13d73e0b9355 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:24.895369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dec186-20e3-46be-afed-13d73e0b9355 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:24.901657 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b3ec6-0401-46b9-a4d6-e2c02a0b1c16 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:24.904166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-33dec186-20e3-46be-afed-13d73e0b9355 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:26:24.904166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:24.904166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:24.904166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:24.904166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:24.904166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:24.904166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:24.904166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:24.904166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:24.904166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:24.904166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:24.904166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:24.904166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:24.904166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:24.904166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:24.904166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:24.905229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:24.905229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:24.905229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:24.905229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:24.905229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:24.905229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:24.905229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:24.905229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:24.905229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:24.905229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:24.905229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:24.905229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:24.905229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:24.905229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:24.905229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:24.905229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:24.906019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:24.906019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:24.906019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:24.906019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:24.906019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:24.906019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:24.906019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:24.906019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:24.906019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:24.906019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:24.906019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:26:24.906019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:24.906019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 235/445] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 13:26:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:24.907467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dec186-20e3-46be-afed-13d73e0b9355 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:24.955077 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ccd96-584b-43db-8b2e-307a2c6c0f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:24.955764 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ccd96-584b-43db-8b2e-307a2c6c0f24 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:24.956041 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ccd96-584b-43db-8b2e-307a2c6c0f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:24.956890 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ccd96-584b-43db-8b2e-307a2c6c0f24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:24.957182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ccd96-584b-43db-8b2e-307a2c6c0f24 None admin] RBAC: Adding query filter params (group.id=c59f5373ff3d4a02aa2c101e978f047a, role.id=891bd78dbb334259bdef8495ca3f4132, scope.project.id=ce43efdcbb764869a0f4347b5b29fcca) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:24.957458 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ccd96-584b-43db-8b2e-307a2c6c0f24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:24.958923 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ccd96-584b-43db-8b2e-307a2c6c0f24 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:24.960124 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:24.965371 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 211/446] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 2 13:26:24 2022] GET /identity/v3/role_assignments?group.id=c59f5373ff3d4a02aa2c101e978f047a&scope.project.id=ce43efdcbb764869a0f4347b5b29fcca&role.id=891bd78dbb334259bdef8495ca3f4132 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:24.966178 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ccd96-584b-43db-8b2e-307a2c6c0f24 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:25.053356 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dec186-20e3-46be-afed-13d73e0b9355 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:25.090001 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acc753-38ce-41b6-a2be-2c9d66ace0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:25.090984 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acc753-38ce-41b6-a2be-2c9d66ace0bc None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:25.091405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ccd96-584b-43db-8b2e-307a2c6c0f24 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:25.091613 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acc753-38ce-41b6-a2be-2c9d66ace0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:25.092018 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acc753-38ce-41b6-a2be-2c9d66ace0bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:25.108107 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:25.130221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579563a7-5a83-4cfe-8c4a-bcb0785f907f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:25.131222 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579563a7-5a83-4cfe-8c4a-bcb0785f907f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:25.131513 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579563a7-5a83-4cfe-8c4a-bcb0785f907f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:25.131787 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579563a7-5a83-4cfe-8c4a-bcb0785f907f None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:25.132557 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579563a7-5a83-4cfe-8c4a-bcb0785f907f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:25.132862 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579563a7-5a83-4cfe-8c4a-bcb0785f907f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:25.134242 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579563a7-5a83-4cfe-8c4a-bcb0785f907f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:25.144275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 212/447] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:25.149953 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579563a7-5a83-4cfe-8c4a-bcb0785f907f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:25.167757 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00acc753-38ce-41b6-a2be-2c9d66ace0bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:25.169240 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00acc753-38ce-41b6-a2be-2c9d66ace0bc None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:25.206265 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:25.272492 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579563a7-5a83-4cfe-8c4a-bcb0785f907f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:25.288336 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 236/448] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:25.294028 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acc753-38ce-41b6-a2be-2c9d66ace0bc None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:25.322067 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc99815-7cc0-4e84-8fd1-56332513b3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:25.322887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc99815-7cc0-4e84-8fd1-56332513b3fa None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:25.323225 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc99815-7cc0-4e84-8fd1-56332513b3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:25.323560 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc99815-7cc0-4e84-8fd1-56332513b3fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:25.385094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:25.414131 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc99815-7cc0-4e84-8fd1-56332513b3fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:25.416334 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc99815-7cc0-4e84-8fd1-56332513b3fa None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:25.419892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acc753-38ce-41b6-a2be-2c9d66ace0bc None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:25.456900 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b39ef5-0258-4e5f-8d74-b899044a7a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:25.458928 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b39ef5-0258-4e5f-8d74-b899044a7a41 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:25.458928 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b39ef5-0258-4e5f-8d74-b899044a7a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:25.458928 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b39ef5-0258-4e5f-8d74-b899044a7a41 None admin] PATH_INFO: `/v3/projects/119d80c3d10b4ce0978a2de4f94e5475` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:25.461547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b39ef5-0258-4e5f-8d74-b899044a7a41 None admin] RBAC: Authorizing `identity:get_project(project_id=119d80c3d10b4ce0978a2de4f94e5475)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:25.461886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b39ef5-0258-4e5f-8d74-b899044a7a41 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:25.463609 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 237/449] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:26:25 2022] GET /identity/v3/projects/119d80c3d10b4ce0978a2de4f94e5475 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:25.470391 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b39ef5-0258-4e5f-8d74-b899044a7a41 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:25.475395 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:25.538027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 213/450] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:26:25.543678 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc99815-7cc0-4e84-8fd1-56332513b3fa None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:25.590724 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b39ef5-0258-4e5f-8d74-b899044a7a41 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:25.636892 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:25.642732 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e794c9d-d513-437b-b6cc-4f36a303ee24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:25.643597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e794c9d-d513-437b-b6cc-4f36a303ee24 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:25.643903 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e794c9d-d513-437b-b6cc-4f36a303ee24 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:25.644171 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e794c9d-d513-437b-b6cc-4f36a303ee24 None admin] PATH_INFO: `/v3/groups/4834fed164b345118eb1f82c612b7c99` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:25.645426 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e794c9d-d513-437b-b6cc-4f36a303ee24 None admin] RBAC: Authorizing `identity:get_group(group_id=4834fed164b345118eb1f82c612b7c99)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:25.646933 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e794c9d-d513-437b-b6cc-4f36a303ee24 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:25.648566 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 238/451] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 13:26:25 2022] GET /identity/v3/groups/4834fed164b345118eb1f82c612b7c99 => generated 229 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:25.656376 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e794c9d-d513-437b-b6cc-4f36a303ee24 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:25.668279 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc99815-7cc0-4e84-8fd1-56332513b3fa None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:25.703437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079841c-c381-4c1a-a3b5-0ffa89b81506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:25.704356 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079841c-c381-4c1a-a3b5-0ffa89b81506 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:25.704639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079841c-c381-4c1a-a3b5-0ffa89b81506 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:25.704914 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079841c-c381-4c1a-a3b5-0ffa89b81506 None admin] PATH_INFO: `/v3/projects/6f065dd8bbe74892af29e05cef5a6d11` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:25.706155 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079841c-c381-4c1a-a3b5-0ffa89b81506 None admin] RBAC: Authorizing `identity:get_project(project_id=6f065dd8bbe74892af29e05cef5a6d11)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:25.707642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079841c-c381-4c1a-a3b5-0ffa89b81506 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:25.709386 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 214/452] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:26:25 2022] GET /identity/v3/projects/6f065dd8bbe74892af29e05cef5a6d11 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:26:25.714920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079841c-c381-4c1a-a3b5-0ffa89b81506 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:25.733029 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:25.765328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e794c9d-d513-437b-b6cc-4f36a303ee24 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:25.801036 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dea68d-c4ae-4091-99af-76cdbd6197f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:25.801696 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dea68d-c4ae-4091-99af-76cdbd6197f1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:25.801977 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dea68d-c4ae-4091-99af-76cdbd6197f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:25.802251 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dea68d-c4ae-4091-99af-76cdbd6197f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:25.803124 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dea68d-c4ae-4091-99af-76cdbd6197f1 None admin] RBAC: Adding query filter params (group.id=4834fed164b345118eb1f82c612b7c99, role.id=6edd584a77084fa78240661ea76cddb5, scope.project.id=119d80c3d10b4ce0978a2de4f94e5475) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:25.803430 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dea68d-c4ae-4091-99af-76cdbd6197f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:25.804880 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dea68d-c4ae-4091-99af-76cdbd6197f1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:25.811197 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 239/453] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 2 13:26:25 2022] GET /identity/v3/role_assignments?group.id=4834fed164b345118eb1f82c612b7c99&scope.project.id=119d80c3d10b4ce0978a2de4f94e5475&role.id=6edd584a77084fa78240661ea76cddb5 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:25.814210 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079841c-c381-4c1a-a3b5-0ffa89b81506 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:25.852858 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3e89a-e52b-4e28-a1b9-d96d7fabadc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:25.853755 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3e89a-e52b-4e28-a1b9-d96d7fabadc7 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:25.854034 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3e89a-e52b-4e28-a1b9-d96d7fabadc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:25.854303 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3e89a-e52b-4e28-a1b9-d96d7fabadc7 None admin] PATH_INFO: `/v3/groups/c59f5373ff3d4a02aa2c101e978f047a` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:25.855699 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3e89a-e52b-4e28-a1b9-d96d7fabadc7 None admin] RBAC: Authorizing `identity:get_group(group_id=c59f5373ff3d4a02aa2c101e978f047a)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:25.857416 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3e89a-e52b-4e28-a1b9-d96d7fabadc7 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:25.859288 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 215/454] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 13:26:25 2022] GET /identity/v3/groups/c59f5373ff3d4a02aa2c101e978f047a => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:26:25.865544 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dea68d-c4ae-4091-99af-76cdbd6197f1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:25.976589 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dea68d-c4ae-4091-99af-76cdbd6197f1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:26.013641 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a3a47-1b50-4e74-af12-d1a39f0d846d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:26.014681 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a3a47-1b50-4e74-af12-d1a39f0d846d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:26.014681 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a3a47-1b50-4e74-af12-d1a39f0d846d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:26.014960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a3a47-1b50-4e74-af12-d1a39f0d846d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:26.015795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a3a47-1b50-4e74-af12-d1a39f0d846d None admin] RBAC: Adding query filter params (group.id=c59f5373ff3d4a02aa2c101e978f047a, role.id=f63a52fb33144307bba2318551138669, scope.project.id=6f065dd8bbe74892af29e05cef5a6d11) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:26.016108 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a3a47-1b50-4e74-af12-d1a39f0d846d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:26.017521 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a3a47-1b50-4e74-af12-d1a39f0d846d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:26.019479 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:26.025069 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 240/455] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 2 13:26:25 2022] GET /identity/v3/role_assignments?group.id=c59f5373ff3d4a02aa2c101e978f047a&scope.project.id=6f065dd8bbe74892af29e05cef5a6d11&role.id=f63a52fb33144307bba2318551138669 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:28.995457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158ee15-6286-468d-a982-e39758113bd0 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:28.995981 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158ee15-6286-468d-a982-e39758113bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:28.995981 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158ee15-6286-468d-a982-e39758113bd0 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:28.997713 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 216/456] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:29.002612 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b67e0-514a-46a9-9789-9b6ed2283475 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:29.003100 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b67e0-514a-46a9-9789-9b6ed2283475 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:29.003266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b67e0-514a-46a9-9789-9b6ed2283475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:29.027633 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d97b67e0-514a-46a9-9789-9b6ed2283475 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:29.029980 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d97b67e0-514a-46a9-9789-9b6ed2283475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:29.106165 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed1c57-af8a-44f5-9438-9874cda24864 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:29.106972 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed1c57-af8a-44f5-9438-9874cda24864 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:29.107614 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed1c57-af8a-44f5-9438-9874cda24864 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:29.109787 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 217/457] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:26:29.115773 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab43831-91d1-460c-a0c4-cefcdb0da2bb None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:29.116404 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab43831-91d1-460c-a0c4-cefcdb0da2bb None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:29.116891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab43831-91d1-460c-a0c4-cefcdb0da2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:29.124812 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 241/458] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:29.134899 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-cab43831-91d1-460c-a0c4-cefcdb0da2bb None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:29.136366 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-cab43831-91d1-460c-a0c4-cefcdb0da2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:29.146272 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:29.173721 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b67e0-514a-46a9-9789-9b6ed2283475 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:29.213587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 218/459] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:26:29.243069 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab43831-91d1-460c-a0c4-cefcdb0da2bb None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:29.343635 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b67e0-514a-46a9-9789-9b6ed2283475 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:29.382680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:29.389398 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3622a6-0af0-4098-a7d0-cf464b9fc22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:29.389864 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab43831-91d1-460c-a0c4-cefcdb0da2bb None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:29.390418 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3622a6-0af0-4098-a7d0-cf464b9fc22b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:29.390724 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3622a6-0af0-4098-a7d0-cf464b9fc22b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:29.390997 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3622a6-0af0-4098-a7d0-cf464b9fc22b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:29.405434 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3622a6-0af0-4098-a7d0-cf464b9fc22b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:29.407180 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3622a6-0af0-4098-a7d0-cf464b9fc22b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:29.431733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-df3622a6-0af0-4098-a7d0-cf464b9fc22b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:29.431733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:29.431733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:29.431733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:29.431733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:29.431733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:29.431733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:29.431733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:29.431733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:29.431733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:29.431733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:29.431733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:29.431733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:29.431733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:29.431733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:29.432668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:29.432668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:29.432668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:29.432668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:29.432668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:29.432668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:29.432668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:29.432668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:29.432668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:29.432668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:29.432668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:29.432668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:29.432668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:29.432668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:29.432668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:29.432668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:29.432668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:29.433531 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:29.433531 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:29.433531 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:29.433531 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:29.435654 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7de30c-54d0-414e-85fb-581336320e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:29.436363 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7de30c-54d0-414e-85fb-581336320e6a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:29.436495 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 242/460] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:26:29.436893 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7de30c-54d0-414e-85fb-581336320e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:29.437316 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7de30c-54d0-414e-85fb-581336320e6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:29.437833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177e304-5e41-4d8b-957a-68caa20d3872 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:29.438121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177e304-5e41-4d8b-957a-68caa20d3872 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:29.438390 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177e304-5e41-4d8b-957a-68caa20d3872 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:29.439968 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 243/461] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:29.441738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177e304-5e41-4d8b-957a-68caa20d3872 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:29.449992 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7de30c-54d0-414e-85fb-581336320e6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:29.451756 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7de30c-54d0-414e-85fb-581336320e6a None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:29.454349 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:29.478372 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-6e7de30c-54d0-414e-85fb-581336320e6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:29.478372 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:29.478372 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:29.478372 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:29.478372 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:29.478372 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:29.478372 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:29.478372 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:29.478372 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:29.478372 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:29.478372 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:29.478372 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:29.478372 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:29.478372 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:29.478372 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:29.479328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:29.479328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:29.479328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:29.479328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:29.479328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:29.479328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:29.479328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:29.479328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:29.479328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:29.479328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:29.479328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:29.479328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:29.479328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:29.479328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:29.479328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:29.479328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:29.479328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:29.480792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:29.480792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:29.480792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:29.480792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:29.480792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 219/462] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:26:29.481137 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444905d9-ec5e-41fb-a301-b8fd5d2266fc None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:29.481569 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444905d9-ec5e-41fb-a301-b8fd5d2266fc None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:29.482216 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444905d9-ec5e-41fb-a301-b8fd5d2266fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:29.502935 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-444905d9-ec5e-41fb-a301-b8fd5d2266fc None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:29.504957 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-444905d9-ec5e-41fb-a301-b8fd5d2266fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:29.561712 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177e304-5e41-4d8b-957a-68caa20d3872 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:29.598675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 220/463] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:29.598675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444905d9-ec5e-41fb-a301-b8fd5d2266fc None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:29.611806 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8ef0b-9fae-444a-b9b2-ae0fb29b675e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:29.612775 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8ef0b-9fae-444a-b9b2-ae0fb29b675e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:29.613292 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8ef0b-9fae-444a-b9b2-ae0fb29b675e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:29.613791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8ef0b-9fae-444a-b9b2-ae0fb29b675e None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:29.614848 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8ef0b-9fae-444a-b9b2-ae0fb29b675e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:29.615344 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8ef0b-9fae-444a-b9b2-ae0fb29b675e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:29.616918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8ef0b-9fae-444a-b9b2-ae0fb29b675e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:29.648582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 244/464] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:29.649852 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8ef0b-9fae-444a-b9b2-ae0fb29b675e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:29.696172 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:29.712386 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444905d9-ec5e-41fb-a301-b8fd5d2266fc None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:29.736516 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:29.748436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7046b2-c8df-41d4-a9d3-09f8d4ea7d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:29.749118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7046b2-c8df-41d4-a9d3-09f8d4ea7d6b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:29.749416 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7046b2-c8df-41d4-a9d3-09f8d4ea7d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:29.749678 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7046b2-c8df-41d4-a9d3-09f8d4ea7d6b None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:29.750389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7046b2-c8df-41d4-a9d3-09f8d4ea7d6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:29.750723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7046b2-c8df-41d4-a9d3-09f8d4ea7d6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:29.752084 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7046b2-c8df-41d4-a9d3-09f8d4ea7d6b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:29.757849 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8ef0b-9fae-444a-b9b2-ae0fb29b675e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:29.769324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 221/465] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:29.769324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76677ad-b363-4f0e-a8ec-ea45c643b7f0 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:29.769324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76677ad-b363-4f0e-a8ec-ea45c643b7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:29.769324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76677ad-b363-4f0e-a8ec-ea45c643b7f0 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:29.769968 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 222/466] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:29.770707 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76677ad-b363-4f0e-a8ec-ea45c643b7f0 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:29.797985 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7f1ec-b106-4a64-aad1-07b3ce78cd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:29.798825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7f1ec-b106-4a64-aad1-07b3ce78cd40 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:29.799103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7f1ec-b106-4a64-aad1-07b3ce78cd40 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:29.799377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7f1ec-b106-4a64-aad1-07b3ce78cd40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:29.809564 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7f1ec-b106-4a64-aad1-07b3ce78cd40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:29.811113 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7f1ec-b106-4a64-aad1-07b3ce78cd40 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:29.828697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-b2a7f1ec-b106-4a64-aad1-07b3ce78cd40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:29.828697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:29.828697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:29.828697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:29.828697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:29.828697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:29.828697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:29.828697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:29.828697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:29.828697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:29.828697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:29.828697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:29.828697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:29.828697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:29.828697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:29.829594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:29.829594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:29.829594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:29.829594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:29.829594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:29.829594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:29.829594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:29.829594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:29.829594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:29.829594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:29.829594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:29.829594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:29.829594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:29.829594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:29.829594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:29.829594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:29.829594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:29.830427 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:29.830427 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:29.830427 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:29.830427 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:29.835543 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 245/467] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:29.836633 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7f1ec-b106-4a64-aad1-07b3ce78cd40 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:29.880888 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76677ad-b363-4f0e-a8ec-ea45c643b7f0 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:29.917026 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec02f75-4172-47b8-8a5f-234b5c99810d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:29.917811 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec02f75-4172-47b8-8a5f-234b5c99810d None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:29.918373 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec02f75-4172-47b8-8a5f-234b5c99810d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:29.918486 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec02f75-4172-47b8-8a5f-234b5c99810d None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:29.919145 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec02f75-4172-47b8-8a5f-234b5c99810d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:29.920642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec02f75-4172-47b8-8a5f-234b5c99810d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:29.935345 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:29.943920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 223/468] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 13:26:29 2022] POST /identity/v3/users => generated 246 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:26:29.945497 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7f1ec-b106-4a64-aad1-07b3ce78cd40 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:29.945708 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29975d70-9494-4ce9-aeb4-96f95c6c2736 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:29.946172 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29975d70-9494-4ce9-aeb4-96f95c6c2736 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:29.946713 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29975d70-9494-4ce9-aeb4-96f95c6c2736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:29.968041 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-29975d70-9494-4ce9-aeb4-96f95c6c2736 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:29.969790 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-29975d70-9494-4ce9-aeb4-96f95c6c2736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:29.995515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d5171-5c61-4e8f-9dba-ea35ddcdbaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:29.996264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d5171-5c61-4e8f-9dba-ea35ddcdbaaf None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:29.996551 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d5171-5c61-4e8f-9dba-ea35ddcdbaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:29.996899 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d5171-5c61-4e8f-9dba-ea35ddcdbaaf None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:29.997708 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d5171-5c61-4e8f-9dba-ea35ddcdbaaf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:29.999420 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d5171-5c61-4e8f-9dba-ea35ddcdbaaf None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:30.022341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:30.035140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 246/469] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 13:26:29 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:26:30.035140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d5171-5c61-4e8f-9dba-ea35ddcdbaaf None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:30.104403 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 224/470] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:30.138483 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29975d70-9494-4ce9-aeb4-96f95c6c2736 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:30.308565 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29975d70-9494-4ce9-aeb4-96f95c6c2736 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:30.309583 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d5171-5c61-4e8f-9dba-ea35ddcdbaaf None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:30.351209 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d9a89-6712-4399-b090-e548f67ea629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:30.351901 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d9a89-6712-4399-b090-e548f67ea629 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:30.352183 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d9a89-6712-4399-b090-e548f67ea629 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:30.353151 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d9a89-6712-4399-b090-e548f67ea629 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:30.353252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785af217-477a-41d2-ba0f-d7257c2130a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:30.353354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d9a89-6712-4399-b090-e548f67ea629 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:30.353520 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d9a89-6712-4399-b090-e548f67ea629 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:30.353876 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785af217-477a-41d2-ba0f-d7257c2130a6 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:30.354157 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785af217-477a-41d2-ba0f-d7257c2130a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:30.354426 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785af217-477a-41d2-ba0f-d7257c2130a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:30.354882 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d9a89-6712-4399-b090-e548f67ea629 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:30.368670 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785af217-477a-41d2-ba0f-d7257c2130a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:30.370153 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785af217-477a-41d2-ba0f-d7257c2130a6 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:30.370473 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 247/471] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:30.376123 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d9a89-6712-4399-b090-e548f67ea629 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:30.391709 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:30.395648 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-785af217-477a-41d2-ba0f-d7257c2130a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:30.395648 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:30.395648 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:30.395648 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:30.395648 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:30.395648 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:30.395648 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:30.395648 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:30.395648 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:30.395648 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:30.395648 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:30.395648 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:30.395648 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:30.395648 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:30.395648 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:30.396677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:30.396677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:30.396677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:30.396677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:30.396677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:30.396677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:30.396677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:30.396677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:30.396677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:30.396677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:30.396677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:30.396677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:30.396677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:30.396677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:30.396677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:30.396677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:30.396677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:30.397638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:30.397638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:30.397638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:30.397638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:30.399733 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 225/472] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:26:30.406450 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785af217-477a-41d2-ba0f-d7257c2130a6 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:30.439454 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:30.529037 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d9a89-6712-4399-b090-e548f67ea629 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:30.546611 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785af217-477a-41d2-ba0f-d7257c2130a6 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:30.575129 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878a49f-0449-479b-a642-1f7769bf84a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:30.576154 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878a49f-0449-479b-a642-1f7769bf84a8 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:30.576616 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878a49f-0449-479b-a642-1f7769bf84a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:30.576888 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878a49f-0449-479b-a642-1f7769bf84a8 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:30.577601 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878a49f-0449-479b-a642-1f7769bf84a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:30.579239 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878a49f-0449-479b-a642-1f7769bf84a8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:30.592768 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0ad7d-2248-46e0-9039-f6035edff69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:30.593643 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0ad7d-2248-46e0-9039-f6035edff69f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:30.594216 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0ad7d-2248-46e0-9039-f6035edff69f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:30.594466 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0ad7d-2248-46e0-9039-f6035edff69f None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:30.595338 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0ad7d-2248-46e0-9039-f6035edff69f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:30.595692 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0ad7d-2248-46e0-9039-f6035edff69f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:30.599882 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0ad7d-2248-46e0-9039-f6035edff69f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:30.609782 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 248/473] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 13:26:30 2022] POST /identity/v3/users => generated 248 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:26:30.609782 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559437f8-ceb7-4a9c-8aee-340ed886f21a None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:30.609782 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559437f8-ceb7-4a9c-8aee-340ed886f21a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:30.609782 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559437f8-ceb7-4a9c-8aee-340ed886f21a None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:30.610184 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 249/474] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:30.616441 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c97060-0a8e-43a7-9a6f-ec07219fff17 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:30.616803 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c97060-0a8e-43a7-9a6f-ec07219fff17 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:30.616982 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c97060-0a8e-43a7-9a6f-ec07219fff17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:30.633402 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 226/475] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:30.642634 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0ad7d-2248-46e0-9039-f6035edff69f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:30.651876 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b3c97060-0a8e-43a7-9a6f-ec07219fff17 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:30.653478 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b3c97060-0a8e-43a7-9a6f-ec07219fff17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:30.738408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:30.762608 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0ad7d-2248-46e0-9039-f6035edff69f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:30.796207 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019164af-a055-4d01-983c-47dcd15bf6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:30.796948 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019164af-a055-4d01-983c-47dcd15bf6d8 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:30.797234 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019164af-a055-4d01-983c-47dcd15bf6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:30.797556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019164af-a055-4d01-983c-47dcd15bf6d8 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:30.798269 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019164af-a055-4d01-983c-47dcd15bf6d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:30.799357 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:30.799766 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019164af-a055-4d01-983c-47dcd15bf6d8 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:30.820467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 250/476] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:30.826732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 227/477] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 13:26:30 2022] POST /identity/v3/users => generated 249 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:26:30.846631 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c97060-0a8e-43a7-9a6f-ec07219fff17 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:30.969678 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c97060-0a8e-43a7-9a6f-ec07219fff17 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:31.012314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705daf3-0642-485e-bc81-b2ce0c567b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:31.013002 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705daf3-0642-485e-bc81-b2ce0c567b29 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:31.013433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705daf3-0642-485e-bc81-b2ce0c567b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:31.013704 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705daf3-0642-485e-bc81-b2ce0c567b29 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:31.014463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705daf3-0642-485e-bc81-b2ce0c567b29 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:31.015906 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705daf3-0642-485e-bc81-b2ce0c567b29 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:31.024830 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.sql.core [None req-f705daf3-0642-485e-bc81-b2ce0c567b29 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 13:26:31.024830 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 02 13:26:31.024830 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [parameters: {'id': '4da31eaaaeb643bcb7b2559bce970425', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 02 13:26:31.024830 dv-cinder-836083-8-smb devstack@keystone.service[80237]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80237) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 13:26:31.042522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-f705daf3-0642-485e-bc81-b2ce0c567b29 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 02 13:26:31.042522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:31.042522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:26:31.042522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:26:31.042522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:26:31.042522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:26:31.042522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:26:31.042522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:26:31.042522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:26:31.042522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:26:31.042522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:26:31.042522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:26:31.042522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:26:31.042522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application result.read() Jun 02 13:26:31.042522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:26:31.043949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:26:31.043949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:26:31.043949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:26:31.043949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:26:31.043949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:26:31.043949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:26:31.043949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:26:31.043949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 13:26:31.043949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:31.043949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 13:26:31.043949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:31.043949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:31.043949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 13:26:31.043949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 13:26:31.043949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 02 13:26:31.043949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return ref.to_dict() Jun 02 13:26:31.043949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:26:31.043949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:26:31.044953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 13:26:31.044953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application yield resource Jun 02 13:26:31.044953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:26:31.044953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:26:31.044953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 13:26:31.044953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 13:26:31.044953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 13:26:31.044953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 13:26:31.044953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 13:26:31.044953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise self.value Jun 02 13:26:31.044953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 13:26:31.044953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 13:26:31.044953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 13:26:31.044953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application session.commit() Jun 02 13:26:31.044953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 13:26:31.044953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 13:26:31.044953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 13:26:31.046719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 13:26:31.046719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 13:26:31.046719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self.session.flush() Jun 02 13:26:31.046719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 13:26:31.046719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 13:26:31.046719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 13:26:31.046719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 13:26:31.046719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 13:26:31.046719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application compat.raise_( Jun 02 13:26:31.046719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:26:31.046719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception Jun 02 13:26:31.046719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 13:26:31.046719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 13:26:31.046719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 13:26:31.046719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 13:26:31.046719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 13:26:31.046719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 13:26:31.048642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 13:26:31.048642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 13:26:31.048642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 02 13:26:31.048642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 02 13:26:31.048642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 13:26:31.048642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 13:26:31.048642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 13:26:31.048642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 13:26:31.048642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 13:26:31.048642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 13:26:31.048642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 13:26:31.048642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 13:26:31.048642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 13:26:31.048642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 13:26:31.048642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:26:31.048642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception Jun 02 13:26:31.050795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:26:31.050795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:26:31.050795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:26:31.050795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:26:31.050795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:26:31.050795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:26:31.050795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:26:31.050795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:26:31.050795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:26:31.050795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:26:31.050795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:26:31.050795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application result.read() Jun 02 13:26:31.050795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:26:31.050795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:26:31.050795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:26:31.050795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:26:31.052354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:26:31.052354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:26:31.052354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:26:31.052354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:26:31.052354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 13:26:31.052354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 02 13:26:31.052354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [parameters: {'id': '4da31eaaaeb643bcb7b2559bce970425', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 02 13:26:31.052354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 13:26:31.052354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:31.052354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:26:31.052354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:31.052354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:31.052354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:31.052354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:31.052354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:31.052354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:31.059693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:31.059693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:31.059693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:31.059693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:31.059693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:31.059693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:31.059693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 02 13:26:31.059693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 02 13:26:31.059693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:31.059693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:31.059693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 02 13:26:31.059693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 02 13:26:31.059693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 13:26:31.059693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 13:26:31.059693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 02 13:26:31.059693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:31.060870 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 251/478] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Jun 2 13:26:30 2022] POST /identity/v3/roles => generated 144 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:31.060959 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019164af-a055-4d01-983c-47dcd15bf6d8 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:31.172389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019164af-a055-4d01-983c-47dcd15bf6d8 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:31.206875 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095371ac-34a2-4131-acfc-d3c885d71156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:31.207703 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095371ac-34a2-4131-acfc-d3c885d71156 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:31.207975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095371ac-34a2-4131-acfc-d3c885d71156 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:31.208244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095371ac-34a2-4131-acfc-d3c885d71156 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:31.215212 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:31.218939 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095371ac-34a2-4131-acfc-d3c885d71156 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:31.228347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-095371ac-34a2-4131-acfc-d3c885d71156 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:26:31.228347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:31.228347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:31.228347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:31.228347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:31.228347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:31.228347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:31.228347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:31.228347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:31.228347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:31.228347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:31.228347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:31.228347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:31.228347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:31.228347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:31.228347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:31.230500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:31.230500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:31.230500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:31.230500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:31.230500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:31.230500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:31.230500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:31.230500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:31.230500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:31.230500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:31.230500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:31.230500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:31.230500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:31.230500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:31.230500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:31.230500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:31.232556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:31.232556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:31.232556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:31.232556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:31.232556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:31.232556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:31.232556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:31.232556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:31.232556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:31.232556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:31.232556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:26:31.232556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:31.232556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 228/479] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 13:26:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:26:31.236051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705daf3-0642-485e-bc81-b2ce0c567b29 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:31.299229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:31.343982 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705daf3-0642-485e-bc81-b2ce0c567b29 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:31.378423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906080d-c524-4029-9ab5-1372b089f1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:31.379129 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906080d-c524-4029-9ab5-1372b089f1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:31.379405 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906080d-c524-4029-9ab5-1372b089f1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:31.379672 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906080d-c524-4029-9ab5-1372b089f1a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:31.380422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906080d-c524-4029-9ab5-1372b089f1a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:31.380727 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906080d-c524-4029-9ab5-1372b089f1a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:31.382091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906080d-c524-4029-9ab5-1372b089f1a0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:31.391293 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 252/480] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:26:32.854329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55435edd-f988-4271-8be9-1031a3da5a60 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:32.854871 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55435edd-f988-4271-8be9-1031a3da5a60 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:32.854871 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55435edd-f988-4271-8be9-1031a3da5a60 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:32.856472 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 229/481] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:32.862259 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2f5a0-9eb8-433a-95b0-f1786a39c2fb None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:32.862696 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2f5a0-9eb8-433a-95b0-f1786a39c2fb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:32.862903 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2f5a0-9eb8-433a-95b0-f1786a39c2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:32.891706 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-19f2f5a0-9eb8-433a-95b0-f1786a39c2fb None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:32.892823 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-19f2f5a0-9eb8-433a-95b0-f1786a39c2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:32.978694 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 253/482] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:26:33.014315 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55435edd-f988-4271-8be9-1031a3da5a60 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:33.048406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb75c51-29b2-4888-84ed-b0927250e6a6 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:33.048752 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb75c51-29b2-4888-84ed-b0927250e6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:33.048939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb75c51-29b2-4888-84ed-b0927250e6a6 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:33.050664 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 254/483] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:33.056636 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6c1e1-f075-4493-b814-ef246d1a6d46 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:33.056945 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6c1e1-f075-4493-b814-ef246d1a6d46 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:33.057187 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6c1e1-f075-4493-b814-ef246d1a6d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:33.082213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b4a6c1e1-f075-4493-b814-ef246d1a6d46 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:33.083427 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b4a6c1e1-f075-4493-b814-ef246d1a6d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:33.171466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:33.202010 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55435edd-f988-4271-8be9-1031a3da5a60 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:33.210423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 255/484] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:26:33.235359 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6c1e1-f075-4493-b814-ef246d1a6d46 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:33.262738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b815e3d-a82d-42ff-9eff-5ca91cf8480f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:33.263988 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b815e3d-a82d-42ff-9eff-5ca91cf8480f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:33.264273 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b815e3d-a82d-42ff-9eff-5ca91cf8480f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:33.264549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b815e3d-a82d-42ff-9eff-5ca91cf8480f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:33.288019 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b815e3d-a82d-42ff-9eff-5ca91cf8480f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:33.301064 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-4b815e3d-a82d-42ff-9eff-5ca91cf8480f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:33.301064 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:33.301064 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:33.301064 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:33.301064 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:33.301064 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:33.301064 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:33.301064 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:33.301064 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:33.301064 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:33.301064 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:33.301064 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:33.301064 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:33.301064 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:33.301064 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:33.301064 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:33.302211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:33.302211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:33.302211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:33.302211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:33.302211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:33.302211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:33.302211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:33.302211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:33.302211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:33.302211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:33.302211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:33.302211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:33.302211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:33.302211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:33.302211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:33.302211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:33.303228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:33.303228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:33.303228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:33.303228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:33.303228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:33.303228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:33.303228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:33.303228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:33.303228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:33.303228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:33.303228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:33.303228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:33.309069 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 230/485] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 13:26:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:33.312786 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b815e3d-a82d-42ff-9eff-5ca91cf8480f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:33.393650 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6c1e1-f075-4493-b814-ef246d1a6d46 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:33.422038 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:33.457078 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283a1c3-6b1e-4a24-a7d7-5b443787401c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:33.458100 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283a1c3-6b1e-4a24-a7d7-5b443787401c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:33.458767 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283a1c3-6b1e-4a24-a7d7-5b443787401c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:33.459128 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283a1c3-6b1e-4a24-a7d7-5b443787401c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:33.477050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283a1c3-6b1e-4a24-a7d7-5b443787401c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:33.480887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b815e3d-a82d-42ff-9eff-5ca91cf8480f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:33.485760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-2283a1c3-6b1e-4a24-a7d7-5b443787401c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:33.485760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:33.485760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:33.485760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:33.485760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:33.485760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:33.485760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:33.485760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:33.485760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:33.485760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:33.485760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:33.485760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:33.485760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:33.485760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:33.485760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:33.485760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:33.486715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:33.486715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:33.486715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:33.486715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:33.486715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:33.486715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:33.486715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:33.486715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:33.486715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:33.486715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:33.486715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:33.486715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:33.486715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:33.486715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:33.486715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:33.486715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:33.487507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:33.487507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:33.487507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:33.487507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:33.487507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:33.487507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:33.487507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:33.487507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:33.487507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:33.487507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:33.487507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:33.487507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:33.490127 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 256/486] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 13:26:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:26:33.491705 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10071bb2-5b99-4725-9419-e896fd3ebb62 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:33.492166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10071bb2-5b99-4725-9419-e896fd3ebb62 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:33.492611 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10071bb2-5b99-4725-9419-e896fd3ebb62 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:33.494328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 257/487] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:33.495374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10071bb2-5b99-4725-9419-e896fd3ebb62 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:33.532703 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe9a08-dd55-452e-a42a-6b355a90420e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:33.533477 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe9a08-dd55-452e-a42a-6b355a90420e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:33.533763 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe9a08-dd55-452e-a42a-6b355a90420e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:33.534039 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe9a08-dd55-452e-a42a-6b355a90420e None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:33.534905 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe9a08-dd55-452e-a42a-6b355a90420e None admin] RBAC: Adding query filter params (name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:33.535225 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe9a08-dd55-452e-a42a-6b355a90420e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:33.536656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe9a08-dd55-452e-a42a-6b355a90420e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:33.544780 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:33.547986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 231/488] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 13:26:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:33.549682 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244ff3a-121f-4855-9149-3c6a478d57a9 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:33.549971 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244ff3a-121f-4855-9149-3c6a478d57a9 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:33.550249 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244ff3a-121f-4855-9149-3c6a478d57a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:33.572799 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-9244ff3a-121f-4855-9149-3c6a478d57a9 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:33.574054 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9244ff3a-121f-4855-9149-3c6a478d57a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:33.628222 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10071bb2-5b99-4725-9419-e896fd3ebb62 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:33.658039 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 232/489] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:33.659482 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244ff3a-121f-4855-9149-3c6a478d57a9 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:33.693481 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e10ee-ab33-4e65-9088-1d2263a8fc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:33.694092 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e10ee-ab33-4e65-9088-1d2263a8fc7c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:33.694375 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e10ee-ab33-4e65-9088-1d2263a8fc7c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:33.694743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e10ee-ab33-4e65-9088-1d2263a8fc7c None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:33.695784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e10ee-ab33-4e65-9088-1d2263a8fc7c None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:33.696096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e10ee-ab33-4e65-9088-1d2263a8fc7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:33.697736 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e10ee-ab33-4e65-9088-1d2263a8fc7c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:33.709507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 258/490] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 13:26:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:33.711314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e10ee-ab33-4e65-9088-1d2263a8fc7c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:33.729774 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:33.790128 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244ff3a-121f-4855-9149-3c6a478d57a9 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:33.817647 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e10ee-ab33-4e65-9088-1d2263a8fc7c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:33.819214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:33.830636 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ca435-dd33-4100-a3f5-a4d3ffe0e2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:33.831951 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ca435-dd33-4100-a3f5-a4d3ffe0e2ed None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:33.832523 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ca435-dd33-4100-a3f5-a4d3ffe0e2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:33.833008 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ca435-dd33-4100-a3f5-a4d3ffe0e2ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:33.844885 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ca435-dd33-4100-a3f5-a4d3ffe0e2ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:33.846746 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ca435-dd33-4100-a3f5-a4d3ffe0e2ed None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:33.852525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecae92-2978-4074-b46e-068a772893e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:33.853300 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecae92-2978-4074-b46e-068a772893e0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:33.853578 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecae92-2978-4074-b46e-068a772893e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:33.853847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecae92-2978-4074-b46e-068a772893e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:33.864697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faecae92-2978-4074-b46e-068a772893e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:33.870706 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-eb5ca435-dd33-4100-a3f5-a4d3ffe0e2ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:33.870706 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:33.870706 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:33.870706 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:33.870706 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:33.870706 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:33.870706 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:33.870706 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:33.870706 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:33.870706 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:33.870706 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:33.870706 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:33.870706 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:33.870706 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:33.870706 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:33.871836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:33.871836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:33.871836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:33.871836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:33.871836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:33.871836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:33.871836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:33.871836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:33.871836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:33.871836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:33.871836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:33.871836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:33.871836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:33.871836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:33.871836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:33.871836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:33.871836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:33.872750 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:33.872750 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:33.872750 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:33.872750 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:33.872971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-faecae92-2978-4074-b46e-068a772893e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:33.872971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:33.872971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:33.872971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:33.872971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:33.872971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:33.872971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:33.872971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:33.872971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:33.872971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:33.872971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:33.872971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:33.872971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:33.872971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:33.872971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:33.872971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:33.873778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:33.873778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:33.873778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:33.873778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:33.873778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:33.873778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:33.873778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:33.873778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:33.873778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:33.873778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:33.873778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:33.873778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:33.873778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:33.873778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:33.873778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:33.873778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:33.875486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:33.875486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:33.875486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:33.875486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:33.875486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:33.875486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:33.875486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:33.875486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:33.875486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:33.875486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:33.875486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:33.875486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:33.875486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 259/491] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 13:26:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:33.875486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecae92-2978-4074-b46e-068a772893e0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:33.878758 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 233/492] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:33.879969 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ca435-dd33-4100-a3f5-a4d3ffe0e2ed None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:33.979189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecae92-2978-4074-b46e-068a772893e0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:33.985127 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ca435-dd33-4100-a3f5-a4d3ffe0e2ed None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:33.987674 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:34.017309 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eaa86d-f86e-4f97-88ca-088a3dbab089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:34.018125 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eaa86d-f86e-4f97-88ca-088a3dbab089 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:34.018405 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eaa86d-f86e-4f97-88ca-088a3dbab089 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:34.018724 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eaa86d-f86e-4f97-88ca-088a3dbab089 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:34.021188 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3a60a-5cd4-4111-9d33-cadf96bf6afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:34.022052 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3a60a-5cd4-4111-9d33-cadf96bf6afd None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:34.022497 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3a60a-5cd4-4111-9d33-cadf96bf6afd None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:34.022994 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3a60a-5cd4-4111-9d33-cadf96bf6afd None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:34.023909 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b3a60a-5cd4-4111-9d33-cadf96bf6afd None admin] RBAC: Adding query filter params (name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:34.024388 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b3a60a-5cd4-4111-9d33-cadf96bf6afd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:34.025910 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b3a60a-5cd4-4111-9d33-cadf96bf6afd None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:34.031292 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eaa86d-f86e-4f97-88ca-088a3dbab089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:34.032743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eaa86d-f86e-4f97-88ca-088a3dbab089 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:34.036155 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 234/493] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 13:26:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:34.037316 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3a60a-5cd4-4111-9d33-cadf96bf6afd None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:34.058966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-f4eaa86d-f86e-4f97-88ca-088a3dbab089 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:34.058966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:34.058966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:34.058966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:34.058966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:34.058966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:34.058966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:34.058966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:34.058966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:34.058966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:34.058966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:34.058966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:34.058966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:34.058966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:34.058966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:34.060075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:34.060075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:34.060075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:34.060075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:34.060075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:34.060075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:34.060075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:34.060075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:34.060075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:34.060075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:34.060075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:34.060075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:34.060075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:34.060075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:34.060075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:34.060075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:34.060075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:34.061226 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:34.061226 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:34.061226 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:34.061226 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:34.061226 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 260/494] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:34.061859 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91ca8d-1663-4e81-9db9-37ec943a41f7 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:34.062115 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91ca8d-1663-4e81-9db9-37ec943a41f7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:34.062386 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91ca8d-1663-4e81-9db9-37ec943a41f7 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:34.066707 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 261/495] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:34.066707 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91ca8d-1663-4e81-9db9-37ec943a41f7 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:34.085972 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:34.151601 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3a60a-5cd4-4111-9d33-cadf96bf6afd None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:34.177228 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91ca8d-1663-4e81-9db9-37ec943a41f7 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:34.187953 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5bf9e-6857-41a8-965f-1cf892b35fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:34.188624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5bf9e-6857-41a8-965f-1cf892b35fdb None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:34.188904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5bf9e-6857-41a8-965f-1cf892b35fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:34.189174 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5bf9e-6857-41a8-965f-1cf892b35fdb None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:34.189889 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5bf9e-6857-41a8-965f-1cf892b35fdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:34.190191 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5bf9e-6857-41a8-965f-1cf892b35fdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:34.191602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5bf9e-6857-41a8-965f-1cf892b35fdb None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:34.204270 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 235/496] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:34.205099 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5bf9e-6857-41a8-965f-1cf892b35fdb None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:34.221428 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08a0fe-3453-4ed6-9d3b-40f6c0cca788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:34.222633 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08a0fe-3453-4ed6-9d3b-40f6c0cca788 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:34.222919 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08a0fe-3453-4ed6-9d3b-40f6c0cca788 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:34.223328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08a0fe-3453-4ed6-9d3b-40f6c0cca788 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:34.233718 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:34.235726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08a0fe-3453-4ed6-9d3b-40f6c0cca788 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:34.237167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08a0fe-3453-4ed6-9d3b-40f6c0cca788 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:34.254922 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-8b08a0fe-3453-4ed6-9d3b-40f6c0cca788 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:34.254922 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:34.254922 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:34.254922 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:34.254922 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:34.254922 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:34.254922 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:34.254922 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:34.254922 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:34.254922 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:34.254922 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:34.254922 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:34.254922 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:34.254922 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:34.254922 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:34.255847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:34.255847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:34.255847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:34.255847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:34.255847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:34.255847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:34.255847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:34.255847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:34.255847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:34.255847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:34.255847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:34.255847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:34.255847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:34.255847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:34.255847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:34.255847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:34.255847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:34.256717 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:34.256717 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:34.256717 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:34.256717 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:34.256717 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 262/497] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:34.257767 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58be580-d429-4f76-958b-abdb961baf53 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:34.258119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58be580-d429-4f76-958b-abdb961baf53 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:34.258412 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58be580-d429-4f76-958b-abdb961baf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:34.275730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e58be580-d429-4f76-958b-abdb961baf53 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:34.276879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e58be580-d429-4f76-958b-abdb961baf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:34.317860 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5bf9e-6857-41a8-965f-1cf892b35fdb None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:34.340421 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:34.348931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 263/498] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:34.349765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58be580-d429-4f76-958b-abdb961baf53 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:34.364646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418e43e-0e33-461e-8376-5ac1b1d0cc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:34.366168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418e43e-0e33-461e-8376-5ac1b1d0cc50 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:34.366723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418e43e-0e33-461e-8376-5ac1b1d0cc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:34.367136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418e43e-0e33-461e-8376-5ac1b1d0cc50 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:34.368260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418e43e-0e33-461e-8376-5ac1b1d0cc50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:34.369037 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418e43e-0e33-461e-8376-5ac1b1d0cc50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:34.370594 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418e43e-0e33-461e-8376-5ac1b1d0cc50 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:34.385894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 236/499] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:34.386802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418e43e-0e33-461e-8376-5ac1b1d0cc50 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:34.448810 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58be580-d429-4f76-958b-abdb961baf53 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:34.468259 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:34.482257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018c865-c915-4411-b697-b6570a8cbf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:34.483093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018c865-c915-4411-b697-b6570a8cbf36 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:34.483366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018c865-c915-4411-b697-b6570a8cbf36 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:34.483634 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018c865-c915-4411-b697-b6570a8cbf36 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:34.484396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418e43e-0e33-461e-8376-5ac1b1d0cc50 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:34.490731 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018c865-c915-4411-b697-b6570a8cbf36 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:34.492187 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018c865-c915-4411-b697-b6570a8cbf36 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:34.507879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-1018c865-c915-4411-b697-b6570a8cbf36 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:26:34.507879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:34.507879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:34.507879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:34.507879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:34.507879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:34.507879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:34.507879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:34.507879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:34.507879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:34.507879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:34.507879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:34.507879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:26:34.507879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:26:34.507879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:26:34.507879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:26:34.508960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:34.508960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:34.508960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:26:34.508960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:34.508960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:26:34.508960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:34.508960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:34.508960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:34.508960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:34.508960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:34.508960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:34.508960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:34.508960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:34.508960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:34.508960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:34.508960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:34.508960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:34.508960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:34.510083 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:34.510083 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:34.510083 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:26:34.510083 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:26:34.510083 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:26:34.510083 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:26:34.510083 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:26:34.510083 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:26:34.510083 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:26:34.510083 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:34.510083 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 264/500] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 2 13:26:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:34.510083 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018c865-c915-4411-b697-b6570a8cbf36 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:34.523135 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0d37a-055c-468c-943a-aa4f1d02d0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:34.523817 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0d37a-055c-468c-943a-aa4f1d02d0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:34.524097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0d37a-055c-468c-943a-aa4f1d02d0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:34.524367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0d37a-055c-468c-943a-aa4f1d02d0f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:34.525092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0d37a-055c-468c-943a-aa4f1d02d0f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:34.525396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0d37a-055c-468c-943a-aa4f1d02d0f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:34.526818 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0d37a-055c-468c-943a-aa4f1d02d0f1 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:34.539629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 237/501] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:34.540941 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccde66-3f66-4adb-aa29-0f3f71080764 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:34.541231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccde66-3f66-4adb-aa29-0f3f71080764 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:34.541505 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccde66-3f66-4adb-aa29-0f3f71080764 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:34.546628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 238/502] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:34.546628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccde66-3f66-4adb-aa29-0f3f71080764 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:34.571200 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:34.620805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018c865-c915-4411-b697-b6570a8cbf36 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:34.647600 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccde66-3f66-4adb-aa29-0f3f71080764 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:34.665952 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9625b3-4a22-4e54-956a-de5d4ac29bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:34.666798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9625b3-4a22-4e54-956a-de5d4ac29bdc None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:34.667161 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9625b3-4a22-4e54-956a-de5d4ac29bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:34.667436 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9625b3-4a22-4e54-956a-de5d4ac29bdc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:34.678032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9625b3-4a22-4e54-956a-de5d4ac29bdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:34.681655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec31d4-ca3b-4163-8dce-91946bc26751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:34.682461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec31d4-ca3b-4163-8dce-91946bc26751 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:34.682774 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec31d4-ca3b-4163-8dce-91946bc26751 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:34.683050 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec31d4-ca3b-4163-8dce-91946bc26751 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:34.685870 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-4f9625b3-4a22-4e54-956a-de5d4ac29bdc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:34.685870 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:34.685870 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:34.685870 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:34.685870 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:34.685870 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:34.685870 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:34.685870 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:34.685870 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:34.685870 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:34.685870 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:34.685870 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:34.685870 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:34.685870 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:34.685870 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:34.685870 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:34.686748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:34.686748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:34.686748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:34.686748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:34.686748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:34.686748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:34.686748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:34.686748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:34.686748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:34.686748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:34.686748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:34.686748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:34.686748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:34.686748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:34.686748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:34.686748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:34.687556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:34.687556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:34.687556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:34.687556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:34.687556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:34.687556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:34.687556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:34.687556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:34.687556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:34.687556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:34.687556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:34.687556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:34.687556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 265/503] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 13:26:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:34.688219 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9625b3-4a22-4e54-956a-de5d4ac29bdc None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:34.690284 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec31d4-ca3b-4163-8dce-91946bc26751 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:34.691815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec31d4-ca3b-4163-8dce-91946bc26751 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:34.707664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-84ec31d4-ca3b-4163-8dce-91946bc26751 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:26:34.707664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:34.707664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:34.707664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:34.707664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:34.707664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:34.707664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:34.707664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:34.707664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:34.707664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:34.707664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:34.707664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:34.707664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:26:34.707664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:26:34.707664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:26:34.707664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:26:34.708581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:34.708581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:34.708581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:26:34.708581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:34.708581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:26:34.708581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:34.708581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:34.708581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:34.708581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:34.708581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:34.708581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:34.708581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:34.708581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:34.708581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:34.708581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:34.708581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:34.708581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:34.708581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:34.709457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:34.709457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:34.709457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:26:34.709457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:26:34.709457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:26:34.709457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:26:34.709457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:26:34.709457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:26:34.709457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:26:34.709457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:34.709457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 239/504] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:34.710557 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec31d4-ca3b-4163-8dce-91946bc26751 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:34.713152 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:34.790091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9625b3-4a22-4e54-956a-de5d4ac29bdc None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:34.806055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:34.808588 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec31d4-ca3b-4163-8dce-91946bc26751 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:34.826359 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c67dc3-d9e0-4c7a-8d2b-4ba2afa3c6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:34.827068 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c67dc3-d9e0-4c7a-8d2b-4ba2afa3c6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:34.827346 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c67dc3-d9e0-4c7a-8d2b-4ba2afa3c6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:34.827611 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c67dc3-d9e0-4c7a-8d2b-4ba2afa3c6d4 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:34.828448 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c67dc3-d9e0-4c7a-8d2b-4ba2afa3c6d4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:34.828731 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c67dc3-d9e0-4c7a-8d2b-4ba2afa3c6d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:34.830236 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c67dc3-d9e0-4c7a-8d2b-4ba2afa3c6d4 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:34.841647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c61f0-aa5f-48de-9c0e-bcead94a6f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:34.842448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c61f0-aa5f-48de-9c0e-bcead94a6f3d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:34.842759 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c61f0-aa5f-48de-9c0e-bcead94a6f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:34.843037 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c61f0-aa5f-48de-9c0e-bcead94a6f3d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:34.851323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c61f0-aa5f-48de-9c0e-bcead94a6f3d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:34.852748 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c61f0-aa5f-48de-9c0e-bcead94a6f3d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:34.865715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 266/505] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 2 13:26:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:34.867088 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814c88e-3d7b-4122-ace0-878750cfed67 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:34.867367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-5f3c61f0-aa5f-48de-9c0e-bcead94a6f3d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:26:34.867367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:34.867367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:34.867367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:34.867367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:34.867367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:34.867367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:34.867367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:34.867367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:34.867367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:34.867367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:34.867367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:34.867367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:26:34.867367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:26:34.867367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:26:34.867367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:26:34.868244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:34.868244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:34.868244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:26:34.868244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:34.868244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:26:34.868244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:34.868244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:34.868244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:34.868244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:34.868244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:34.868244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:34.868244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:34.868244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:34.868244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:34.868244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:34.868244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:34.868244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:34.868244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:34.871893 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:34.871893 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:34.871893 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:26:34.871893 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:26:34.871893 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:26:34.871893 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:26:34.871893 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:26:34.871893 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:26:34.871893 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:26:34.871893 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:34.872412 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814c88e-3d7b-4122-ace0-878750cfed67 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:34.872412 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814c88e-3d7b-4122-ace0-878750cfed67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:34.872533 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 240/506] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:34.872533 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c61f0-aa5f-48de-9c0e-bcead94a6f3d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:34.885775 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3814c88e-3d7b-4122-ace0-878750cfed67 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:34.887190 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3814c88e-3d7b-4122-ace0-878750cfed67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:34.933719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:34.955613 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 267/507] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:34.956753 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814c88e-3d7b-4122-ace0-878750cfed67 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:34.971497 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c61f0-aa5f-48de-9c0e-bcead94a6f3d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:35.005119 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e10bc-73ba-4824-89aa-f843263f9142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:35.005784 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e10bc-73ba-4824-89aa-f843263f9142 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:35.006061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e10bc-73ba-4824-89aa-f843263f9142 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:35.006333 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e10bc-73ba-4824-89aa-f843263f9142 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:35.007120 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e10bc-73ba-4824-89aa-f843263f9142 None admin] RBAC: Adding query filter params (name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:35.007425 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e10bc-73ba-4824-89aa-f843263f9142 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:35.008776 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e10bc-73ba-4824-89aa-f843263f9142 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:35.016799 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 241/508] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 13:26:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:35.017580 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e10bc-73ba-4824-89aa-f843263f9142 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:35.065979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814c88e-3d7b-4122-ace0-878750cfed67 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:35.068200 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:35.100750 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f9a3c-434b-4c16-b774-ff513f41d87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:35.101439 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f9a3c-434b-4c16-b774-ff513f41d87a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:35.101720 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f9a3c-434b-4c16-b774-ff513f41d87a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:35.101993 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f9a3c-434b-4c16-b774-ff513f41d87a None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:35.102878 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f9a3c-434b-4c16-b774-ff513f41d87a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:35.103185 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f9a3c-434b-4c16-b774-ff513f41d87a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:35.104622 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f9a3c-434b-4c16-b774-ff513f41d87a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:35.117753 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e10bc-73ba-4824-89aa-f843263f9142 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:35.121718 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 268/509] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Jun 2 13:26:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:35.122661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f9a3c-434b-4c16-b774-ff513f41d87a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:35.143325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:35.152185 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef62e8-e10d-41cb-8bc7-e9ebb56e9ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:35.153203 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef62e8-e10d-41cb-8bc7-e9ebb56e9ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:35.153579 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef62e8-e10d-41cb-8bc7-e9ebb56e9ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:35.153860 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef62e8-e10d-41cb-8bc7-e9ebb56e9ab5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:35.218783 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f9a3c-434b-4c16-b774-ff513f41d87a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:35.221304 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef62e8-e10d-41cb-8bc7-e9ebb56e9ab5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:35.222788 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef62e8-e10d-41cb-8bc7-e9ebb56e9ab5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:35.252864 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6b1b5-134e-48dc-b4ce-2c89d6af0409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:35.253537 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6b1b5-134e-48dc-b4ce-2c89d6af0409 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:35.253814 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6b1b5-134e-48dc-b4ce-2c89d6af0409 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:35.254082 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6b1b5-134e-48dc-b4ce-2c89d6af0409 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:35.254940 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6b1b5-134e-48dc-b4ce-2c89d6af0409 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:35.255247 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6b1b5-134e-48dc-b4ce-2c89d6af0409 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:35.256661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6b1b5-134e-48dc-b4ce-2c89d6af0409 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:35.273678 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 269/510] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Jun 2 13:26:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:35.274661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6b1b5-134e-48dc-b4ce-2c89d6af0409 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:35.298809 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:35.319380 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 242/511] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:35.320165 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef62e8-e10d-41cb-8bc7-e9ebb56e9ab5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:35.344925 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:35.381426 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6b1b5-134e-48dc-b4ce-2c89d6af0409 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:35.416682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3cefa-368c-4dda-a237-d064cc505355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:35.417482 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3cefa-368c-4dda-a237-d064cc505355 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:35.417757 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3cefa-368c-4dda-a237-d064cc505355 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:35.418005 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef62e8-e10d-41cb-8bc7-e9ebb56e9ab5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:35.418100 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3cefa-368c-4dda-a237-d064cc505355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:35.428349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3cefa-368c-4dda-a237-d064cc505355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:35.429768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3cefa-368c-4dda-a237-d064cc505355 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:35.447562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-cfb3cefa-368c-4dda-a237-d064cc505355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:35.447562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:35.447562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:35.447562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:35.447562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:35.447562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:35.447562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:35.447562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:35.447562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:35.447562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:35.447562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:35.447562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:35.447562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:35.447562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:35.447562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:35.448582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:35.448582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:35.448582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:35.448582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:35.448582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:35.448582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:35.448582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:35.448582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:35.448582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:35.448582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:35.448582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:35.448582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:35.448582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:35.448582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:35.448582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:35.448582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:35.448582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:35.449476 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:35.449476 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:35.449476 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:35.449476 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:35.449476 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 270/512] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:35.449934 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3cefa-368c-4dda-a237-d064cc505355 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:35.457488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8ee84-5d88-406c-b801-e74d9330922e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:35.458300 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8ee84-5d88-406c-b801-e74d9330922e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:35.458601 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8ee84-5d88-406c-b801-e74d9330922e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:35.458879 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8ee84-5d88-406c-b801-e74d9330922e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:35.469346 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c8ee84-5d88-406c-b801-e74d9330922e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:35.470799 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c8ee84-5d88-406c-b801-e74d9330922e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:35.489090 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-18c8ee84-5d88-406c-b801-e74d9330922e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:35.489090 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:35.489090 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:35.489090 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:35.489090 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:35.489090 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:35.489090 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:35.489090 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:35.489090 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:35.489090 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:35.489090 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:35.489090 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:35.489090 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:35.489090 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:35.489090 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:35.490122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:35.490122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:35.490122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:35.490122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:35.490122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:35.490122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:35.490122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:35.490122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:35.490122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:35.490122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:35.490122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:35.490122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:35.490122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:35.490122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:35.490122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:35.490122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:35.490122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:35.491276 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:35.491276 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:35.491276 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:35.491276 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:35.491276 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 243/513] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:35.491584 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8ee84-5d88-406c-b801-e74d9330922e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:35.526454 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:35.561468 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3cefa-368c-4dda-a237-d064cc505355 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:35.579994 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:35.596760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4a854-67bc-4c94-9237-dd337d589f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:35.597420 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4a854-67bc-4c94-9237-dd337d589f59 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:35.597698 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4a854-67bc-4c94-9237-dd337d589f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:35.597969 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4a854-67bc-4c94-9237-dd337d589f59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:35.602634 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8ee84-5d88-406c-b801-e74d9330922e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:35.639280 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126ff4f-763f-4c9d-8aa2-2c719ca7e32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:35.639942 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126ff4f-763f-4c9d-8aa2-2c719ca7e32d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:35.640222 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126ff4f-763f-4c9d-8aa2-2c719ca7e32d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:35.640495 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126ff4f-763f-4c9d-8aa2-2c719ca7e32d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:35.665218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4a854-67bc-4c94-9237-dd337d589f59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:35.666697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4a854-67bc-4c94-9237-dd337d589f59 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:35.707494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126ff4f-763f-4c9d-8aa2-2c719ca7e32d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:35.708950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126ff4f-763f-4c9d-8aa2-2c719ca7e32d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:35.732432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:35.762704 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 271/514] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:35.763995 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4a854-67bc-4c94-9237-dd337d589f59 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:35.790499 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:35.814818 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 244/515] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:35.816043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126ff4f-763f-4c9d-8aa2-2c719ca7e32d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:35.881323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4a854-67bc-4c94-9237-dd337d589f59 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:35.923030 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9418a-2071-49e3-8fd3-412a3f03b3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:35.923408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126ff4f-763f-4c9d-8aa2-2c719ca7e32d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:35.923866 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9418a-2071-49e3-8fd3-412a3f03b3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:35.924117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9418a-2071-49e3-8fd3-412a3f03b3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:35.924384 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9418a-2071-49e3-8fd3-412a3f03b3f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:35.938995 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9418a-2071-49e3-8fd3-412a3f03b3f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:35.940448 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9418a-2071-49e3-8fd3-412a3f03b3f7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:35.957664 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-6da9418a-2071-49e3-8fd3-412a3f03b3f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:35.957664 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:35.957664 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:35.957664 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:35.957664 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:35.957664 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:35.957664 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:35.957664 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:35.957664 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:35.957664 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:35.957664 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:35.957664 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:35.957664 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:35.957664 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:35.957664 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:35.958509 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:35.958509 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:35.958509 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:35.958509 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:35.958509 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:35.958509 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:35.958509 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:35.958509 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:35.958509 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:35.958509 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:35.958509 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:35.958509 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:35.958509 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:35.958509 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:35.958509 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:35.958509 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:35.958509 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:35.959722 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:35.959722 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:35.959722 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:35.959722 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:35.959930 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21decec0-8a35-4b31-b0aa-bbad4b1406d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:35.959930 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21decec0-8a35-4b31-b0aa-bbad4b1406d0 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:35.960267 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 272/516] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:35.960356 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21decec0-8a35-4b31-b0aa-bbad4b1406d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:35.960356 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21decec0-8a35-4b31-b0aa-bbad4b1406d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:35.960495 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9418a-2071-49e3-8fd3-412a3f03b3f7 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:35.960585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21decec0-8a35-4b31-b0aa-bbad4b1406d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:35.960585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21decec0-8a35-4b31-b0aa-bbad4b1406d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:35.961758 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21decec0-8a35-4b31-b0aa-bbad4b1406d0 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:35.973129 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 245/517] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:35.973937 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21decec0-8a35-4b31-b0aa-bbad4b1406d0 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:35.990647 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:36.014441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:36.063572 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9418a-2071-49e3-8fd3-412a3f03b3f7 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:36.073738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21decec0-8a35-4b31-b0aa-bbad4b1406d0 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:36.097726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def79311-1075-467a-a699-0770ebacc33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:36.098708 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def79311-1075-467a-a699-0770ebacc33e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:36.099103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def79311-1075-467a-a699-0770ebacc33e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:36.099377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def79311-1075-467a-a699-0770ebacc33e None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:36.100095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def79311-1075-467a-a699-0770ebacc33e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:36.100390 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def79311-1075-467a-a699-0770ebacc33e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:36.101768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def79311-1075-467a-a699-0770ebacc33e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:36.108402 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867136b-7dab-4736-a590-eb48109906ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:36.109320 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867136b-7dab-4736-a590-eb48109906ac None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:36.109598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867136b-7dab-4736-a590-eb48109906ac None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:36.109866 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867136b-7dab-4736-a590-eb48109906ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:36.113774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 273/518] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:36.114593 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def79311-1075-467a-a699-0770ebacc33e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:36.121562 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867136b-7dab-4736-a590-eb48109906ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:36.123200 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867136b-7dab-4736-a590-eb48109906ac None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:36.140629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-2867136b-7dab-4736-a590-eb48109906ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:36.140629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:36.140629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:36.140629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:36.140629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:36.140629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:36.140629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:36.140629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:36.140629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:36.140629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:36.140629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:36.140629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:36.140629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:36.140629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:36.140629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:36.141656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:36.141656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:36.141656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:36.141656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:36.141656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:36.141656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:36.141656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:36.141656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:36.141656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:36.141656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:36.141656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:36.141656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:36.141656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:36.141656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:36.141656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:36.141656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:36.141656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:36.142744 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:36.142744 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:36.142744 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:36.142744 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:36.142744 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 246/519] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:36.142744 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867136b-7dab-4736-a590-eb48109906ac None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:36.204574 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:36.221096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def79311-1075-467a-a699-0770ebacc33e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:36.236505 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:36.246565 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867136b-7dab-4736-a590-eb48109906ac None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:36.255825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7a81a-db73-461f-8fd5-f6a6cb0494c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:36.256637 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7a81a-db73-461f-8fd5-f6a6cb0494c8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:36.256943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7a81a-db73-461f-8fd5-f6a6cb0494c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:36.257203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7a81a-db73-461f-8fd5-f6a6cb0494c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:36.268250 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7a81a-db73-461f-8fd5-f6a6cb0494c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:36.269700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7a81a-db73-461f-8fd5-f6a6cb0494c8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:36.280271 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c5751-dcce-4322-afdf-b3a69a5b5c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:36.280934 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c5751-dcce-4322-afdf-b3a69a5b5c5b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:36.281208 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c5751-dcce-4322-afdf-b3a69a5b5c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:36.281476 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c5751-dcce-4322-afdf-b3a69a5b5c5b None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:36.282193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c5751-dcce-4322-afdf-b3a69a5b5c5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:36.282493 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c5751-dcce-4322-afdf-b3a69a5b5c5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:36.283867 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c5751-dcce-4322-afdf-b3a69a5b5c5b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:36.287064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-d1c7a81a-db73-461f-8fd5-f6a6cb0494c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:36.287064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:36.287064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:36.287064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:36.287064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:36.287064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:36.287064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:36.287064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:36.287064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:36.287064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:36.287064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:36.287064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:36.287064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:36.287064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:36.287064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:36.288004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:36.288004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:36.288004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:36.288004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:36.288004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:36.288004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:36.288004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:36.288004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:36.288004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:36.288004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:36.288004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:36.288004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:36.288004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:36.288004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:36.288004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:36.288004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:36.288004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:36.288996 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:36.288996 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:36.288996 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:36.288996 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:36.292840 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 274/520] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:36.293582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7a81a-db73-461f-8fd5-f6a6cb0494c8 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:36.296651 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 247/521] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:36.297421 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c5751-dcce-4322-afdf-b3a69a5b5c5b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:36.391508 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7a81a-db73-461f-8fd5-f6a6cb0494c8 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:36.396577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c5751-dcce-4322-afdf-b3a69a5b5c5b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:36.424138 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85788220-5076-4c7c-8998-2e1f08638280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:36.424785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85788220-5076-4c7c-8998-2e1f08638280 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:36.425043 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85788220-5076-4c7c-8998-2e1f08638280 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:36.425341 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85788220-5076-4c7c-8998-2e1f08638280 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:36.426009 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85788220-5076-4c7c-8998-2e1f08638280 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:36.427489 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85788220-5076-4c7c-8998-2e1f08638280 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:36.431414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0144076-f3a0-4d3b-972f-93676e46e748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:36.432215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0144076-f3a0-4d3b-972f-93676e46e748 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:36.432491 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0144076-f3a0-4d3b-972f-93676e46e748 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:36.432760 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0144076-f3a0-4d3b-972f-93676e46e748 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:36.434976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:36.440170 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0144076-f3a0-4d3b-972f-93676e46e748 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:36.441561 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0144076-f3a0-4d3b-972f-93676e46e748 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:36.449059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 275/522] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 13:26:36 2022] POST /identity/v3/users => generated 247 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:26:36.449879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85788220-5076-4c7c-8998-2e1f08638280 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:36.456624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-f0144076-f3a0-4d3b-972f-93676e46e748 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:26:36.456624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:36.456624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:36.456624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:36.456624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:36.456624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:36.456624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:36.456624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:36.456624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:36.456624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:36.456624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:36.456624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:36.456624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:26:36.456624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:26:36.456624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:26:36.456624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:26:36.457577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:36.457577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:36.457577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:26:36.457577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:36.457577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:26:36.457577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:36.457577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:36.457577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:36.457577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:36.457577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:36.457577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:36.457577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:36.457577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:36.457577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:36.457577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:36.457577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:36.457577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:36.457577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:36.458485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:36.458485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:36.458485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:26:36.458485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:26:36.458485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:26:36.458485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:26:36.458485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:26:36.458485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:26:36.458485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:26:36.458485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:36.458485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 248/523] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 13:26:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:36.459117 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0144076-f3a0-4d3b-972f-93676e46e748 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:36.482758 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:36.575239 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85788220-5076-4c7c-8998-2e1f08638280 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:36.584330 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0144076-f3a0-4d3b-972f-93676e46e748 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:36.612328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37751a15-e0f5-4db3-bc0d-d0e7f72f9559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:36.613122 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37751a15-e0f5-4db3-bc0d-d0e7f72f9559 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:36.613410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37751a15-e0f5-4db3-bc0d-d0e7f72f9559 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:36.613681 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37751a15-e0f5-4db3-bc0d-d0e7f72f9559 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:36.614415 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37751a15-e0f5-4db3-bc0d-d0e7f72f9559 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:36.614768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37751a15-e0f5-4db3-bc0d-d0e7f72f9559 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:36.616181 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37751a15-e0f5-4db3-bc0d-d0e7f72f9559 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:36.625433 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97b155-dd79-4e7e-9ca8-c97085bfa7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:36.626451 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97b155-dd79-4e7e-9ca8-c97085bfa7aa None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:36.626763 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97b155-dd79-4e7e-9ca8-c97085bfa7aa None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:36.627035 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97b155-dd79-4e7e-9ca8-c97085bfa7aa None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:36.627768 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97b155-dd79-4e7e-9ca8-c97085bfa7aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:36.628093 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97b155-dd79-4e7e-9ca8-c97085bfa7aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:36.629479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97b155-dd79-4e7e-9ca8-c97085bfa7aa None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:36.632220 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 276/524] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:36.633268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37751a15-e0f5-4db3-bc0d-d0e7f72f9559 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:36.650900 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 249/525] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:36.652220 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97b155-dd79-4e7e-9ca8-c97085bfa7aa None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:36.696985 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:36.736355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:36.748839 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37751a15-e0f5-4db3-bc0d-d0e7f72f9559 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:36.771138 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97b155-dd79-4e7e-9ca8-c97085bfa7aa None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:36.783857 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc83d2-dd38-4e31-ace5-0e611f421e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:36.784665 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc83d2-dd38-4e31-ace5-0e611f421e55 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:36.784940 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc83d2-dd38-4e31-ace5-0e611f421e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:36.785209 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc83d2-dd38-4e31-ace5-0e611f421e55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:36.794702 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc83d2-dd38-4e31-ace5-0e611f421e55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:36.796899 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc83d2-dd38-4e31-ace5-0e611f421e55 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:36.807549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1dd765-edd5-4987-90ad-2d0f4932c882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:36.808222 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dd765-edd5-4987-90ad-2d0f4932c882 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:36.808498 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dd765-edd5-4987-90ad-2d0f4932c882 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:36.808764 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dd765-edd5-4987-90ad-2d0f4932c882 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:36.809595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1dd765-edd5-4987-90ad-2d0f4932c882 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:36.809995 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1dd765-edd5-4987-90ad-2d0f4932c882 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:36.811431 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1dd765-edd5-4987-90ad-2d0f4932c882 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:36.815715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-a3dc83d2-dd38-4e31-ace5-0e611f421e55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:36.815715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:36.815715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:36.815715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:36.815715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:36.815715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:36.815715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:36.815715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:36.815715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:36.815715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:36.815715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:36.815715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:36.815715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:26:36.815715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:26:36.815715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:26:36.816793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:26:36.816793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:36.816793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:36.816793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:36.816793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:36.816793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:36.816793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:36.816793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:36.816793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:36.816793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:36.816793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:36.816793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:36.816793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:36.816793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:36.816793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:36.816793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:36.816793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:36.817829 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:26:36.817829 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:26:36.817829 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:26:36.817829 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:26:36.817829 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:26:36.817829 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:26:36.817829 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:36.817829 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:36.819945 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 277/526] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:36.820859 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc83d2-dd38-4e31-ace5-0e611f421e55 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:36.848752 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 250/527] 10.222.0.18 () {56 vars in 1139 bytes} [Thu Jun 2 13:26:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:36.849631 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1dd765-edd5-4987-90ad-2d0f4932c882 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:36.935263 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc83d2-dd38-4e31-ace5-0e611f421e55 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:36.950296 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:36.956286 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1dd765-edd5-4987-90ad-2d0f4932c882 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:36.981242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c897a13-48d7-49b9-ab0f-c8c138de984c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:36.982677 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c897a13-48d7-49b9-ab0f-c8c138de984c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:36.983124 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c897a13-48d7-49b9-ab0f-c8c138de984c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:36.983393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c897a13-48d7-49b9-ab0f-c8c138de984c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:36.984282 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:36.990761 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c897a13-48d7-49b9-ab0f-c8c138de984c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:36.992225 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c897a13-48d7-49b9-ab0f-c8c138de984c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:36.995120 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe08f22-f840-456d-9cc4-ac7e3dd664c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:36.995937 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe08f22-f840-456d-9cc4-ac7e3dd664c5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:36.996215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe08f22-f840-456d-9cc4-ac7e3dd664c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:36.996484 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe08f22-f840-456d-9cc4-ac7e3dd664c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:37.003885 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe08f22-f840-456d-9cc4-ac7e3dd664c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:37.005323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe08f22-f840-456d-9cc4-ac7e3dd664c5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:37.007595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-8c897a13-48d7-49b9-ab0f-c8c138de984c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:37.007595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:37.007595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:37.007595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:37.007595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:37.007595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:37.007595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:37.007595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:37.007595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:37.007595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:37.007595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:37.007595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:37.007595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:26:37.007595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:26:37.007595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:26:37.008467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:26:37.008467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:37.008467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:37.008467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:37.008467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:37.008467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:37.008467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:37.008467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:37.008467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:37.008467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:37.008467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:37.008467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:37.008467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:37.008467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:37.008467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:37.008467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:37.008467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:37.009298 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:26:37.009298 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:26:37.009298 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:26:37.009298 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:26:37.009298 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:26:37.009298 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:26:37.009298 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:37.009298 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:37.009298 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 278/528] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:37.009761 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c897a13-48d7-49b9-ab0f-c8c138de984c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:37.023428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-bbe08f22-f840-456d-9cc4-ac7e3dd664c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:37.023428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:37.023428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:37.023428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:37.023428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:37.023428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:37.023428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:37.023428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:37.023428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:37.023428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:37.023428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:37.023428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:37.023428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:26:37.023428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:26:37.023428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:26:37.024323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:26:37.024323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:37.024323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:37.024323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:37.024323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:37.024323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:37.024323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:37.024323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:37.024323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:37.024323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:37.024323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:37.024323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:37.024323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:37.024323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:37.024323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:37.024323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:37.024323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:37.025154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:26:37.025154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:26:37.025154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:26:37.025154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:26:37.025154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:26:37.025154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:26:37.025154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:37.025154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:37.025154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 251/529] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:37.025604 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe08f22-f840-456d-9cc4-ac7e3dd664c5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:37.122986 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c897a13-48d7-49b9-ab0f-c8c138de984c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:37.136560 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe08f22-f840-456d-9cc4-ac7e3dd664c5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:37.158361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57bf5a-4a4d-4328-b5bb-ac45b9608e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:37.159153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57bf5a-4a4d-4328-b5bb-ac45b9608e4a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:37.159450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57bf5a-4a4d-4328-b5bb-ac45b9608e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:37.159714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57bf5a-4a4d-4328-b5bb-ac45b9608e4a None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:37.160495 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57bf5a-4a4d-4328-b5bb-ac45b9608e4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:37.160798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57bf5a-4a4d-4328-b5bb-ac45b9608e4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:37.162214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57bf5a-4a4d-4328-b5bb-ac45b9608e4a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:37.171859 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411fbe2-1851-449c-a20f-28881cbdaabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:37.172559 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411fbe2-1851-449c-a20f-28881cbdaabf None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:37.172839 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411fbe2-1851-449c-a20f-28881cbdaabf None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:37.173476 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411fbe2-1851-449c-a20f-28881cbdaabf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:37.185469 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 279/530] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:26:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:37.185469 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57bf5a-4a4d-4328-b5bb-ac45b9608e4a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:37.217678 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:37.236563 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:37.249953 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411fbe2-1851-449c-a20f-28881cbdaabf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:37.251440 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411fbe2-1851-449c-a20f-28881cbdaabf None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:37.290366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57bf5a-4a4d-4328-b5bb-ac45b9608e4a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:37.331324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6102de3-e342-468d-8f8f-25b67a04fe5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:37.332237 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6102de3-e342-468d-8f8f-25b67a04fe5f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:37.332896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6102de3-e342-468d-8f8f-25b67a04fe5f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:37.333167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6102de3-e342-468d-8f8f-25b67a04fe5f None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:37.334216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6102de3-e342-468d-8f8f-25b67a04fe5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:37.334522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6102de3-e342-468d-8f8f-25b67a04fe5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:37.336207 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6102de3-e342-468d-8f8f-25b67a04fe5f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:37.352522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 280/531] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:26:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:37.353483 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6102de3-e342-468d-8f8f-25b67a04fe5f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:37.378103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 252/532] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:37.380095 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411fbe2-1851-449c-a20f-28881cbdaabf None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:37.459013 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:37.470661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6102de3-e342-468d-8f8f-25b67a04fe5f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:37.471633 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:37.484628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411fbe2-1851-449c-a20f-28881cbdaabf None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:37.509106 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e5828-da8a-4a82-b900-78177475b787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:37.509775 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e5828-da8a-4a82-b900-78177475b787 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:37.510052 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e5828-da8a-4a82-b900-78177475b787 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:37.510330 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e5828-da8a-4a82-b900-78177475b787 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:37.511246 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e5828-da8a-4a82-b900-78177475b787 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:37.511507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e5828-da8a-4a82-b900-78177475b787 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:37.513038 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e5828-da8a-4a82-b900-78177475b787 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:37.518169 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9d4d2-cd2c-4cad-89c9-bdd9452c4916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:37.518855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9d4d2-cd2c-4cad-89c9-bdd9452c4916 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:37.519136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9d4d2-cd2c-4cad-89c9-bdd9452c4916 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:37.519407 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9d4d2-cd2c-4cad-89c9-bdd9452c4916 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:37.520322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9d4d2-cd2c-4cad-89c9-bdd9452c4916 None admin] RBAC: Adding query filter params (role.id=9dc761b84aa745ad920c76ddf9fb0b9e, scope.project.id=af45a1ec7c94408bb638c55fb43fa961, user.id=5a0061e2927843cf86769d2beab18743) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:37.520543 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9d4d2-cd2c-4cad-89c9-bdd9452c4916 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:37.521963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9d4d2-cd2c-4cad-89c9-bdd9452c4916 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:37.525941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 281/533] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:26:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:37.527502 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e5828-da8a-4a82-b900-78177475b787 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:37.538780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 253/534] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:26:37 2022] GET /identity/v3/role_assignments?user.id=5a0061e2927843cf86769d2beab18743&scope.project.id=af45a1ec7c94408bb638c55fb43fa961&role.id=9dc761b84aa745ad920c76ddf9fb0b9e => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:37.539810 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9d4d2-cd2c-4cad-89c9-bdd9452c4916 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:37.672019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e5828-da8a-4a82-b900-78177475b787 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:37.678808 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9d4d2-cd2c-4cad-89c9-bdd9452c4916 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:37.712706 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bb64a-683a-4277-a2c3-615b606c0532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:37.714014 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bb64a-683a-4277-a2c3-615b606c0532 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:37.714654 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bb64a-683a-4277-a2c3-615b606c0532 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:37.715190 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bb64a-683a-4277-a2c3-615b606c0532 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:37.715587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67abc4-32bf-494e-bdb2-cb8cb6051c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:37.716542 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67abc4-32bf-494e-bdb2-cb8cb6051c8f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:37.716710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bb64a-683a-4277-a2c3-615b606c0532 None admin] RBAC: Adding query filter params (role.id=9dc761b84aa745ad920c76ddf9fb0b9e, scope.project.id=af45a1ec7c94408bb638c55fb43fa961, user.id=22df4e0d98e34758963d3b1465a3a377) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:37.716835 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67abc4-32bf-494e-bdb2-cb8cb6051c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:37.717180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67abc4-32bf-494e-bdb2-cb8cb6051c8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:37.717689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bb64a-683a-4277-a2c3-615b606c0532 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:37.719597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bb64a-683a-4277-a2c3-615b606c0532 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:37.726697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 282/535] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:26:37 2022] GET /identity/v3/role_assignments?user.id=22df4e0d98e34758963d3b1465a3a377&scope.project.id=af45a1ec7c94408bb638c55fb43fa961&role.id=9dc761b84aa745ad920c76ddf9fb0b9e => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:37.727909 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bb64a-683a-4277-a2c3-615b606c0532 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:37.729601 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67abc4-32bf-494e-bdb2-cb8cb6051c8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:37.731251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67abc4-32bf-494e-bdb2-cb8cb6051c8f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:37.750449 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:37.750762 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-0f67abc4-32bf-494e-bdb2-cb8cb6051c8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:37.750762 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:37.750762 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:37.750762 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:37.750762 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:37.750762 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:37.750762 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:37.750762 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:37.750762 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:37.750762 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:37.750762 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:37.750762 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:37.750762 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:37.750762 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:37.750762 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:37.751664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:37.751664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:37.751664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:37.751664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:37.751664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:37.751664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:37.751664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:37.751664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:37.751664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:37.751664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:37.751664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:37.751664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:37.751664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:37.751664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:37.751664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:37.751664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:37.751664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:37.752801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:37.752801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:37.752801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:37.752801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:37.752801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 254/536] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:37.757964 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67abc4-32bf-494e-bdb2-cb8cb6051c8f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:37.826994 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:37.853140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bb64a-683a-4277-a2c3-615b606c0532 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:37.873909 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67abc4-32bf-494e-bdb2-cb8cb6051c8f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:37.913498 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c39f7-c3df-4246-b8f6-e87b5d1d9c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:37.914299 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c39f7-c3df-4246-b8f6-e87b5d1d9c16 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:37.914676 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c39f7-c3df-4246-b8f6-e87b5d1d9c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:37.915155 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c39f7-c3df-4246-b8f6-e87b5d1d9c16 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:37.916090 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c39f7-c3df-4246-b8f6-e87b5d1d9c16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:37.916463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c39f7-c3df-4246-b8f6-e87b5d1d9c16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:37.919548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c39f7-c3df-4246-b8f6-e87b5d1d9c16 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:37.931048 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb96d5-db1f-4dce-9d6c-1b8f22a8f002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:37.932467 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 255/537] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:37.933369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb96d5-db1f-4dce-9d6c-1b8f22a8f002 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:37.933826 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb96d5-db1f-4dce-9d6c-1b8f22a8f002 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:37.934298 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb96d5-db1f-4dce-9d6c-1b8f22a8f002 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:37.935364 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb96d5-db1f-4dce-9d6c-1b8f22a8f002 None admin] RBAC: Adding query filter params (role.id=9dc761b84aa745ad920c76ddf9fb0b9e, scope.project.id=af45a1ec7c94408bb638c55fb43fa961, user.id=58b2f0101284461398a95538466002bd) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:37.941070 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c39f7-c3df-4246-b8f6-e87b5d1d9c16 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:37.941151 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb96d5-db1f-4dce-9d6c-1b8f22a8f002 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:37.941151 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb96d5-db1f-4dce-9d6c-1b8f22a8f002 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:37.957151 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 283/538] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:26:37 2022] GET /identity/v3/role_assignments?user.id=58b2f0101284461398a95538466002bd&scope.project.id=af45a1ec7c94408bb638c55fb43fa961&role.id=9dc761b84aa745ad920c76ddf9fb0b9e => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:38.023499 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:38.061099 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c39f7-c3df-4246-b8f6-e87b5d1d9c16 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:38.100157 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc6195-91ed-4242-8926-e664ce3da92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:38.100987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc6195-91ed-4242-8926-e664ce3da92f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:38.101268 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc6195-91ed-4242-8926-e664ce3da92f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:38.101539 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc6195-91ed-4242-8926-e664ce3da92f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:38.109736 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc6195-91ed-4242-8926-e664ce3da92f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:38.111235 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc6195-91ed-4242-8926-e664ce3da92f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:38.127353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-76cc6195-91ed-4242-8926-e664ce3da92f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:38.127353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:38.127353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:38.127353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:38.127353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:38.127353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:38.127353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:38.127353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:38.127353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:38.127353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:38.127353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:38.127353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:38.127353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:26:38.127353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:26:38.127353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:26:38.128277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:26:38.128277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:38.128277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:38.128277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:38.128277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:38.128277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:38.128277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:38.128277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:38.128277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:38.128277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:38.128277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:38.128277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:38.128277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:38.128277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:38.128277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:38.128277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:38.128277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:38.129638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:26:38.129638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:26:38.129638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:26:38.129638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:26:38.129638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:26:38.129638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:26:38.129638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:38.129638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:38.129638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 256/539] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:26:38.134720 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb96d5-db1f-4dce-9d6c-1b8f22a8f002 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:38.221005 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:38.240997 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb96d5-db1f-4dce-9d6c-1b8f22a8f002 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:38.276694 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb707170-7c48-402a-acb6-b61cef080796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:38.277293 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb707170-7c48-402a-acb6-b61cef080796 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:38.277573 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb707170-7c48-402a-acb6-b61cef080796 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:38.278203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb707170-7c48-402a-acb6-b61cef080796 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:38.279101 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb707170-7c48-402a-acb6-b61cef080796 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:38.279412 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb707170-7c48-402a-acb6-b61cef080796 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:38.280889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb707170-7c48-402a-acb6-b61cef080796 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:38.294255 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 284/540] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:26:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:38.301236 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc6195-91ed-4242-8926-e664ce3da92f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:38.403790 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc6195-91ed-4242-8926-e664ce3da92f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:38.428108 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:38.439346 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d373c-1f6a-400e-8b7f-3178343f8d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:38.440026 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d373c-1f6a-400e-8b7f-3178343f8d4e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:38.440305 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d373c-1f6a-400e-8b7f-3178343f8d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:38.440575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d373c-1f6a-400e-8b7f-3178343f8d4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:38.441412 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d373c-1f6a-400e-8b7f-3178343f8d4e None admin] RBAC: Adding query filter params (role.id=9dc761b84aa745ad920c76ddf9fb0b9e, scope.project.id=af45a1ec7c94408bb638c55fb43fa961, user.id=a072e8e01bc64c9b92579bb8f1d513a4) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:38.441721 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d373c-1f6a-400e-8b7f-3178343f8d4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:38.443184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d373c-1f6a-400e-8b7f-3178343f8d4e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:38.449568 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 257/541] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:26:38 2022] GET /identity/v3/role_assignments?user.id=a072e8e01bc64c9b92579bb8f1d513a4&scope.project.id=af45a1ec7c94408bb638c55fb43fa961&role.id=9dc761b84aa745ad920c76ddf9fb0b9e => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:38.951747 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db882f3e-3a39-432a-a922-d86ff2b50657 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:38.952288 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db882f3e-3a39-432a-a922-d86ff2b50657 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:38.952288 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db882f3e-3a39-432a-a922-d86ff2b50657 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:38.953909 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 285/542] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:38.971426 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e06b0-7730-4180-a72b-f2ce715122ad None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:38.971722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e06b0-7730-4180-a72b-f2ce715122ad None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:38.971981 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e06b0-7730-4180-a72b-f2ce715122ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:38.993575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d80e06b0-7730-4180-a72b-f2ce715122ad None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:38.994785 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d80e06b0-7730-4180-a72b-f2ce715122ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:39.095211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 258/543] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:39.130889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db882f3e-3a39-432a-a922-d86ff2b50657 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:39.256286 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db882f3e-3a39-432a-a922-d86ff2b50657 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:39.303858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bbd33-ceae-4bb7-897a-4f06e765d05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:39.304686 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bbd33-ceae-4bb7-897a-4f06e765d05e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:39.304989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bbd33-ceae-4bb7-897a-4f06e765d05e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:39.305258 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bbd33-ceae-4bb7-897a-4f06e765d05e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:39.317073 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:39.320049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2bbd33-ceae-4bb7-897a-4f06e765d05e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:39.328740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-3c2bbd33-ceae-4bb7-897a-4f06e765d05e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:39.328740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:39.328740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:39.328740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:39.328740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:39.328740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:39.328740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:39.328740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:39.328740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:39.328740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:39.328740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:39.328740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:39.328740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:39.328740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:39.328740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:39.328740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:39.329649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:39.329649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:39.329649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:39.329649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:39.329649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:39.329649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:39.329649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:39.329649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:39.329649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:39.329649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:39.329649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:39.329649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:39.329649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:39.329649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:39.329649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:39.329649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:39.330439 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:39.330439 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:39.330439 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:39.330439 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:39.330439 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:39.330439 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:39.330439 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:39.330439 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:39.330439 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:39.330439 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:39.330439 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:39.330439 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:39.330439 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 286/544] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 13:26:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:39.342715 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e06b0-7730-4180-a72b-f2ce715122ad None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:39.488270 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e06b0-7730-4180-a72b-f2ce715122ad None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:39.519727 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:39.543244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbc38a-9162-4969-b101-3165d0d0dbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:39.543954 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbc38a-9162-4969-b101-3165d0d0dbc6 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:39.544432 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbc38a-9162-4969-b101-3165d0d0dbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:39.544723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbc38a-9162-4969-b101-3165d0d0dbc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:39.545474 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccbc38a-9162-4969-b101-3165d0d0dbc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:39.545783 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccbc38a-9162-4969-b101-3165d0d0dbc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:39.547182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccbc38a-9162-4969-b101-3165d0d0dbc6 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:39.555624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 259/545] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 13:26:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:39.561383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bbd33-ceae-4bb7-897a-4f06e765d05e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:39.681267 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bbd33-ceae-4bb7-897a-4f06e765d05e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:39.730247 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84124c-7a5c-44d3-9895-fd6dbce5dbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:39.731086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84124c-7a5c-44d3-9895-fd6dbce5dbba None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:39.731365 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84124c-7a5c-44d3-9895-fd6dbce5dbba None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:39.731809 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84124c-7a5c-44d3-9895-fd6dbce5dbba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:39.748789 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84124c-7a5c-44d3-9895-fd6dbce5dbba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:39.750257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84124c-7a5c-44d3-9895-fd6dbce5dbba None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:39.775807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-fb84124c-7a5c-44d3-9895-fd6dbce5dbba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:39.775807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:39.775807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:39.775807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:39.775807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:39.775807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:39.775807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:39.775807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:39.775807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:39.775807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:39.775807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:39.775807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:39.775807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:39.775807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:39.775807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:39.776693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:39.776693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:39.776693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:39.776693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:39.776693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:39.776693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:39.776693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:39.776693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:39.776693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:39.776693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:39.776693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:39.776693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:39.776693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:39.776693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:39.776693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:39.776693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:39.776693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:39.778757 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:39.778757 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:39.778757 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:39.778757 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:39.778757 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 287/546] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:39.783870 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbc38a-9162-4969-b101-3165d0d0dbc6 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:39.954981 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbc38a-9162-4969-b101-3165d0d0dbc6 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:40.008158 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b27fa-e00f-436f-a3a6-12a1cced3df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:40.008843 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b27fa-e00f-436f-a3a6-12a1cced3df3 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:40.009121 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b27fa-e00f-436f-a3a6-12a1cced3df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:40.009392 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b27fa-e00f-436f-a3a6-12a1cced3df3 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:40.010115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b27fa-e00f-436f-a3a6-12a1cced3df3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:40.010419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b27fa-e00f-436f-a3a6-12a1cced3df3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:40.011815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b27fa-e00f-436f-a3a6-12a1cced3df3 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:40.030226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 260/547] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:40.035795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84124c-7a5c-44d3-9895-fd6dbce5dbba None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:40.110662 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:40.196322 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84124c-7a5c-44d3-9895-fd6dbce5dbba None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:40.245237 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522bee2-0602-49fe-8add-2bd33d4529ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:40.246052 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522bee2-0602-49fe-8add-2bd33d4529ba None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:40.246330 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522bee2-0602-49fe-8add-2bd33d4529ba None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:40.246615 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522bee2-0602-49fe-8add-2bd33d4529ba None admin] PATH_INFO: `/v3/users/swift` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:40.258225 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7522bee2-0602-49fe-8add-2bd33d4529ba None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:40.259739 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7522bee2-0602-49fe-8add-2bd33d4529ba None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:40.276921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-7522bee2-0602-49fe-8add-2bd33d4529ba None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:26:40.276921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:40.276921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:40.276921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:40.276921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:40.276921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:40.276921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:40.276921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:40.276921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:40.276921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:40.276921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:40.276921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:40.276921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:26:40.276921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:26:40.276921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:26:40.276921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:26:40.279133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:40.279133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:40.279133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:26:40.279133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:40.279133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:26:40.279133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:40.279133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:40.279133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:40.279133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:40.279133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:40.279133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:40.279133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:40.279133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:40.279133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:40.279133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:40.279133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:40.279133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:40.279133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:40.280681 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:40.280681 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:40.280681 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:26:40.280681 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:26:40.280681 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:26:40.280681 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:26:40.280681 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:26:40.280681 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:26:40.280681 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:26:40.280681 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:40.280681 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 288/548] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:26:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:40.284486 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b27fa-e00f-436f-a3a6-12a1cced3df3 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:40.363723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:40.448519 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b27fa-e00f-436f-a3a6-12a1cced3df3 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:40.476705 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85335fac-1e15-40f8-bed0-48d9584036fa None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:40.477122 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85335fac-1e15-40f8-bed0-48d9584036fa None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:40.477527 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85335fac-1e15-40f8-bed0-48d9584036fa None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:40.484002 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 289/549] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:40 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:40.490005 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c586d1-c5ee-4d0e-9fe2-389734141a29 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:40.490528 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c586d1-c5ee-4d0e-9fe2-389734141a29 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:40.491020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c586d1-c5ee-4d0e-9fe2-389734141a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:40.494622 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c55ff-99e8-4807-9149-fb0937b9c66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:40.494622 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c55ff-99e8-4807-9149-fb0937b9c66b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:40.494622 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c55ff-99e8-4807-9149-fb0937b9c66b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:40.494622 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c55ff-99e8-4807-9149-fb0937b9c66b None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:40.495367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c55ff-99e8-4807-9149-fb0937b9c66b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:40.495992 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c55ff-99e8-4807-9149-fb0937b9c66b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:40.497013 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c55ff-99e8-4807-9149-fb0937b9c66b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:40.516286 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-82c586d1-c5ee-4d0e-9fe2-389734141a29 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:40.517915 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-82c586d1-c5ee-4d0e-9fe2-389734141a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:40.539326 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 261/550] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Jun 2 13:26:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:40.543820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c55ff-99e8-4807-9149-fb0937b9c66b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:40.729282 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c55ff-99e8-4807-9149-fb0937b9c66b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:40.731597 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:40.733858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 290/551] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:26:40.761217 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c586d1-c5ee-4d0e-9fe2-389734141a29 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:40.767972 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b2adc-53a9-4bc5-a079-efa517a35c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:40.768865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b2adc-53a9-4bc5-a079-efa517a35c6c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:40.769299 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b2adc-53a9-4bc5-a079-efa517a35c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:40.769722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b2adc-53a9-4bc5-a079-efa517a35c6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:40.843786 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b2adc-53a9-4bc5-a079-efa517a35c6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:40.845570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b2adc-53a9-4bc5-a079-efa517a35c6c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:40.947730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 262/552] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:40.948104 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:40.951786 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581310e5-f926-4f9e-bbae-f02eeb7087ab None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:40.952295 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581310e5-f926-4f9e-bbae-f02eeb7087ab None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:40.953160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581310e5-f926-4f9e-bbae-f02eeb7087ab None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:40.954901 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 263/553] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:40.956043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581310e5-f926-4f9e-bbae-f02eeb7087ab None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:40.956806 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:41.050420 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c586d1-c5ee-4d0e-9fe2-389734141a29 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:41.095434 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581310e5-f926-4f9e-bbae-f02eeb7087ab None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:41.121089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e5732-e2f8-476f-894b-7c925522460e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:41.122738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e5732-e2f8-476f-894b-7c925522460e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:41.123215 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e5732-e2f8-476f-894b-7c925522460e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:41.123792 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e5732-e2f8-476f-894b-7c925522460e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:41.137211 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e5732-e2f8-476f-894b-7c925522460e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:41.143441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd113d-8dc2-410e-a63d-d13296ef92d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:41.144250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd113d-8dc2-410e-a63d-d13296ef92d0 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:41.144523 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd113d-8dc2-410e-a63d-d13296ef92d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:41.144791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd113d-8dc2-410e-a63d-d13296ef92d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:41.147486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-886e5732-e2f8-476f-894b-7c925522460e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:41.147486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:41.147486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:41.147486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:41.147486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:41.147486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:41.147486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:41.147486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:41.147486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:41.147486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:41.147486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:41.147486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:41.147486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:41.147486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:41.147486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:41.147486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:41.148397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:41.148397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:41.148397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:41.148397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:41.148397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:41.148397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:41.148397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:41.148397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:41.148397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:41.148397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:41.148397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:41.148397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:41.148397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:41.148397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:41.148397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:41.148397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:41.149189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:41.149189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:41.149189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:41.149189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:41.149189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:41.149189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:41.149189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:41.149189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:41.149189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:41.149189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:41.149189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:41.149189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:41.156702 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd113d-8dc2-410e-a63d-d13296ef92d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:41.157319 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 291/554] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 13:26:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:26:41.157527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd113d-8dc2-410e-a63d-d13296ef92d0 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:41.159419 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9f021-92cc-47dc-a90c-9fc8daf14626 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:41.159901 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9f021-92cc-47dc-a90c-9fc8daf14626 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:41.160380 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9f021-92cc-47dc-a90c-9fc8daf14626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:41.182493 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-72f9f021-92cc-47dc-a90c-9fc8daf14626 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:41.183224 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-98fd113d-8dc2-410e-a63d-d13296ef92d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:41.183224 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:41.183224 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:41.183224 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:41.183224 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:41.183224 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:41.183224 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:41.183224 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:41.183224 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:41.183224 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:41.183224 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:41.183224 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:41.183224 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:41.183224 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:41.183224 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:41.184106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:41.184106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:41.184106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:41.184106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:41.184106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:41.184106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:41.184106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:41.184106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:41.184106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:41.184106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:41.184106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:41.184106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:41.184106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:41.184106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:41.184106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:41.184106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:41.184106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:41.185217 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:41.185217 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:41.185217 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:41.185217 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:41.185441 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-72f9f021-92cc-47dc-a90c-9fc8daf14626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:41.185517 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 264/555] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:41.186306 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1fe8c-4f23-4e4a-a6ae-4517b1a0f6e0 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:41.186598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1fe8c-4f23-4e4a-a6ae-4517b1a0f6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:41.186887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1fe8c-4f23-4e4a-a6ae-4517b1a0f6e0 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:41.188285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 265/556] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:41.188804 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1fe8c-4f23-4e4a-a6ae-4517b1a0f6e0 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:41.241768 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:41.256887 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 292/557] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:41.257544 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9f021-92cc-47dc-a90c-9fc8daf14626 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:41.287729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:41.308722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1fe8c-4f23-4e4a-a6ae-4517b1a0f6e0 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:41.345262 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be13d9-8c46-40e3-916e-b0b0d52b2b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:41.346004 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be13d9-8c46-40e3-916e-b0b0d52b2b74 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:41.346227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be13d9-8c46-40e3-916e-b0b0d52b2b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:41.346610 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be13d9-8c46-40e3-916e-b0b0d52b2b74 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:41.347357 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be13d9-8c46-40e3-916e-b0b0d52b2b74 None admin] RBAC: Adding query filter params (name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:41.347661 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be13d9-8c46-40e3-916e-b0b0d52b2b74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:41.349008 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be13d9-8c46-40e3-916e-b0b0d52b2b74 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:41.356089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9f021-92cc-47dc-a90c-9fc8daf14626 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:41.356863 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 266/558] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 13:26:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:41.358249 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60409c1d-2899-4746-acd5-cddafef1301c None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:41.358535 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60409c1d-2899-4746-acd5-cddafef1301c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:41.358847 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60409c1d-2899-4746-acd5-cddafef1301c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:41.374600 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-60409c1d-2899-4746-acd5-cddafef1301c None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:41.375779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-60409c1d-2899-4746-acd5-cddafef1301c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:41.395705 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346cffc-356c-46a8-b138-25646f64d6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:41.396385 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346cffc-356c-46a8-b138-25646f64d6ef None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:41.396670 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346cffc-356c-46a8-b138-25646f64d6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:41.396946 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346cffc-356c-46a8-b138-25646f64d6ef None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:41.397669 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7346cffc-356c-46a8-b138-25646f64d6ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:41.397978 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7346cffc-356c-46a8-b138-25646f64d6ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:41.399412 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7346cffc-356c-46a8-b138-25646f64d6ef None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:41.411611 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 293/559] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:41.412959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06389de9-4e05-42df-87e9-5cd89b75aee6 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:41.413250 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06389de9-4e05-42df-87e9-5cd89b75aee6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:41.413797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06389de9-4e05-42df-87e9-5cd89b75aee6 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:41.414941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 294/560] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:41.419392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06389de9-4e05-42df-87e9-5cd89b75aee6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:41.443894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 267/561] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:41.444544 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60409c1d-2899-4746-acd5-cddafef1301c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:41.487938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:41.521195 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:41.532496 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06389de9-4e05-42df-87e9-5cd89b75aee6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:41.547422 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60409c1d-2899-4746-acd5-cddafef1301c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:41.566144 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57d277-8934-4ecc-bf51-6c0064bd45fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:41.566979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57d277-8934-4ecc-bf51-6c0064bd45fe None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:41.567262 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57d277-8934-4ecc-bf51-6c0064bd45fe None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:41.567533 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57d277-8934-4ecc-bf51-6c0064bd45fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:41.577820 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57d277-8934-4ecc-bf51-6c0064bd45fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:41.581489 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412799d1-19d1-48e5-b1d0-612a49f3b3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:41.582270 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412799d1-19d1-48e5-b1d0-612a49f3b3d3 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:41.582549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412799d1-19d1-48e5-b1d0-612a49f3b3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:41.582850 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412799d1-19d1-48e5-b1d0-612a49f3b3d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:41.585422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-8f57d277-8934-4ecc-bf51-6c0064bd45fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:41.585422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:41.585422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:41.585422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:41.585422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:41.585422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:41.585422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:41.585422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:41.585422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:41.585422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:41.585422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:41.585422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:41.585422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:41.585422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:41.585422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:41.585422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:41.586393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:41.586393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:41.586393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:41.586393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:41.586393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:41.586393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:41.586393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:41.586393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:41.586393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:41.586393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:41.586393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:41.586393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:41.586393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:41.586393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:41.586393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:41.586393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:41.587264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:41.587264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:41.587264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:41.587264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:41.587264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:41.587264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:41.587264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:41.587264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:41.587264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:41.587264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:41.587264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:41.587264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:41.587264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 295/562] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 13:26:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:41.588677 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57d277-8934-4ecc-bf51-6c0064bd45fe None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:41.595570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412799d1-19d1-48e5-b1d0-612a49f3b3d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:41.597073 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412799d1-19d1-48e5-b1d0-612a49f3b3d3 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:41.614606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-412799d1-19d1-48e5-b1d0-612a49f3b3d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:41.614606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:41.614606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:41.614606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:41.614606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:41.614606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:41.614606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:41.614606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:41.614606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:41.614606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:41.614606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:41.614606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:41.614606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:41.614606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:41.614606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:41.615587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:41.615587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:41.615587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:41.615587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:41.615587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:41.615587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:41.615587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:41.615587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:41.615587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:41.615587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:41.615587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:41.615587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:41.615587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:41.615587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:41.615587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:41.615587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:41.615587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:41.616581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:41.616581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:41.616581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:41.616581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:41.616581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 268/563] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:41.617254 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cff400-a42b-4a52-8ed3-86c8c431fed7 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:41.617558 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cff400-a42b-4a52-8ed3-86c8c431fed7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:41.617831 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cff400-a42b-4a52-8ed3-86c8c431fed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:41.634227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-92cff400-a42b-4a52-8ed3-86c8c431fed7 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:41.635444 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-92cff400-a42b-4a52-8ed3-86c8c431fed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:41.694971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57d277-8934-4ecc-bf51-6c0064bd45fe None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:41.700926 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 269/564] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:41.701776 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cff400-a42b-4a52-8ed3-86c8c431fed7 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:41.725684 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:41.743728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0e96d-494f-4755-a821-cc1575c8499c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:41.744535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0e96d-494f-4755-a821-cc1575c8499c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:41.744812 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0e96d-494f-4755-a821-cc1575c8499c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:41.745080 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0e96d-494f-4755-a821-cc1575c8499c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:41.752092 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0e96d-494f-4755-a821-cc1575c8499c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:41.753675 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0e96d-494f-4755-a821-cc1575c8499c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:41.768710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-ccb0e96d-494f-4755-a821-cc1575c8499c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:41.768710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:41.768710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:41.768710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:41.768710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:41.768710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:41.768710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:41.768710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:41.768710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:41.768710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:41.768710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:41.768710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:41.768710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:26:41.768710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:26:41.768710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:26:41.769708 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:26:41.769708 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:41.769708 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:41.769708 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:41.769708 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:41.769708 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:41.769708 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:41.769708 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:41.769708 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:41.769708 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:41.769708 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:41.769708 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:41.769708 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:41.769708 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:41.769708 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:41.769708 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:41.769708 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:41.770604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:26:41.770604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:26:41.770604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:26:41.770604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:26:41.770604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:26:41.770604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:26:41.770604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:41.770604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:41.770604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 296/565] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:41.771096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0e96d-494f-4755-a821-cc1575c8499c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:41.786362 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:41.806319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cff400-a42b-4a52-8ed3-86c8c431fed7 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:41.840728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf28f0-b651-47a4-9d40-0bb666865ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:41.841575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf28f0-b651-47a4-9d40-0bb666865ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:41.841849 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf28f0-b651-47a4-9d40-0bb666865ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:41.842093 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf28f0-b651-47a4-9d40-0bb666865ee7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:41.852162 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf28f0-b651-47a4-9d40-0bb666865ee7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:41.859987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-1fdf28f0-b651-47a4-9d40-0bb666865ee7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:41.859987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:41.859987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:41.859987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:41.859987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:41.859987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:41.859987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:41.859987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:41.859987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:41.859987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:41.859987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:41.859987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:41.859987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:41.859987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:41.859987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:41.859987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:41.860931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:41.860931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:41.860931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:41.860931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:41.860931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:41.860931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:41.860931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:41.860931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:41.860931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:41.860931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:41.860931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:41.860931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:41.860931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:41.860931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:41.860931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:41.860931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:41.861748 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:41.861748 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:41.861748 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:41.861748 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:41.861748 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:41.861748 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:41.861748 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:41.861748 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:41.861748 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:41.861748 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:41.861748 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:41.861748 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:41.861748 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 270/566] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 13:26:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:41.862465 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf28f0-b651-47a4-9d40-0bb666865ee7 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:41.879530 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0e96d-494f-4755-a821-cc1575c8499c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:41.912911 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe1db1-47b8-4d36-baad-f0db1162f642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:41.913599 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe1db1-47b8-4d36-baad-f0db1162f642 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:41.913872 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe1db1-47b8-4d36-baad-f0db1162f642 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:41.914134 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe1db1-47b8-4d36-baad-f0db1162f642 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:41.914899 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe1db1-47b8-4d36-baad-f0db1162f642 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:41.915194 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe1db1-47b8-4d36-baad-f0db1162f642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:41.916589 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe1db1-47b8-4d36-baad-f0db1162f642 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:41.924567 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 297/567] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 13:26:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:41.925514 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe1db1-47b8-4d36-baad-f0db1162f642 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:41.952693 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:41.968379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf28f0-b651-47a4-9d40-0bb666865ee7 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:41.999797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:42.001140 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b284a-8e12-46ef-98c3-0d695a7f0bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:42.001966 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b284a-8e12-46ef-98c3-0d695a7f0bcb None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:42.002223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b284a-8e12-46ef-98c3-0d695a7f0bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:42.002494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b284a-8e12-46ef-98c3-0d695a7f0bcb None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:42.003242 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b284a-8e12-46ef-98c3-0d695a7f0bcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:42.003543 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b284a-8e12-46ef-98c3-0d695a7f0bcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:42.004957 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b284a-8e12-46ef-98c3-0d695a7f0bcb None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:42.017655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 271/568] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:42.022394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b284a-8e12-46ef-98c3-0d695a7f0bcb None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:42.028192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe1db1-47b8-4d36-baad-f0db1162f642 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:42.065187 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932e307-6a55-4d4e-9f05-2b3df81dcd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:42.066124 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932e307-6a55-4d4e-9f05-2b3df81dcd99 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:42.066388 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932e307-6a55-4d4e-9f05-2b3df81dcd99 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:42.066695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932e307-6a55-4d4e-9f05-2b3df81dcd99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:42.077196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932e307-6a55-4d4e-9f05-2b3df81dcd99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:42.084954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-a932e307-6a55-4d4e-9f05-2b3df81dcd99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:42.084954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:42.084954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:42.084954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:42.084954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:42.084954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:42.084954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:42.084954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:42.084954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:42.084954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:42.084954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:42.084954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:42.084954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:42.084954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:42.084954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:42.084954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:42.086117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:42.086117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:42.086117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:42.086117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:42.086117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:42.086117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:42.086117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:42.086117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:42.086117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:42.086117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:42.086117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:42.086117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:42.086117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:42.086117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:42.086117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:42.086117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:42.087026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:42.087026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:42.087026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:42.087026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:42.087026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:42.087026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:42.087026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:42.087026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:42.087026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:42.087026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:42.087026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:42.087026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:42.087026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 298/569] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 13:26:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:42.087026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932e307-6a55-4d4e-9f05-2b3df81dcd99 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:42.131203 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b284a-8e12-46ef-98c3-0d695a7f0bcb None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:42.166831 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e1bcf-61d8-4f69-9493-26de4ab7734a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:42.167506 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e1bcf-61d8-4f69-9493-26de4ab7734a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:42.167785 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e1bcf-61d8-4f69-9493-26de4ab7734a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:42.168053 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e1bcf-61d8-4f69-9493-26de4ab7734a None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:42.168834 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e1bcf-61d8-4f69-9493-26de4ab7734a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:42.169199 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e1bcf-61d8-4f69-9493-26de4ab7734a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:42.170633 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e1bcf-61d8-4f69-9493-26de4ab7734a None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:42.187526 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932e307-6a55-4d4e-9f05-2b3df81dcd99 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:42.188290 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 272/570] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:26:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:42.189231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e1bcf-61d8-4f69-9493-26de4ab7734a None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:42.194358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:42.220716 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6d0fe-79e3-4067-860b-a99cfbbfb3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:42.221395 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6d0fe-79e3-4067-860b-a99cfbbfb3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:42.221673 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6d0fe-79e3-4067-860b-a99cfbbfb3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:42.221940 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6d0fe-79e3-4067-860b-a99cfbbfb3e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:42.222720 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6d0fe-79e3-4067-860b-a99cfbbfb3e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:42.223049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6d0fe-79e3-4067-860b-a99cfbbfb3e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:42.224404 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6d0fe-79e3-4067-860b-a99cfbbfb3e6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:42.225728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:42.233088 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 299/571] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 13:26:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:42.233885 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6d0fe-79e3-4067-860b-a99cfbbfb3e6 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:42.294312 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e1bcf-61d8-4f69-9493-26de4ab7734a None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:42.327367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d80099-e05d-4aa0-8a74-fa042454497c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:42.328227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d80099-e05d-4aa0-8a74-fa042454497c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:42.328511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d80099-e05d-4aa0-8a74-fa042454497c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:42.328786 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d80099-e05d-4aa0-8a74-fa042454497c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:42.331907 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6d0fe-79e3-4067-860b-a99cfbbfb3e6 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:42.338891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d80099-e05d-4aa0-8a74-fa042454497c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:42.340318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d80099-e05d-4aa0-8a74-fa042454497c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:42.358125 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-24d80099-e05d-4aa0-8a74-fa042454497c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:42.358125 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:42.358125 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:42.358125 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:42.358125 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:42.358125 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:42.358125 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:42.358125 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:42.358125 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:42.358125 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:42.358125 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:42.358125 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:42.358125 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:42.358125 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:42.358125 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:42.359109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:42.359109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:42.359109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:42.359109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:42.359109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:42.359109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:42.359109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:42.359109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:42.359109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:42.359109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:42.359109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:42.359109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:42.359109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:42.359109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:42.359109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:42.359109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:42.359109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:42.360006 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:42.360006 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:42.360006 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:42.360006 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:42.360006 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 273/572] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:42.360303 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d80099-e05d-4aa0-8a74-fa042454497c None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:42.370265 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e158f79-b359-43bc-b377-46a9403c1284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:42.371079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e158f79-b359-43bc-b377-46a9403c1284 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:42.371396 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e158f79-b359-43bc-b377-46a9403c1284 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:42.371670 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e158f79-b359-43bc-b377-46a9403c1284 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:42.380159 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e158f79-b359-43bc-b377-46a9403c1284 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:42.381650 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e158f79-b359-43bc-b377-46a9403c1284 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:42.395630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-4e158f79-b359-43bc-b377-46a9403c1284 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:26:42.395630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:42.395630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:42.395630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:42.395630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:42.395630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:42.395630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:42.395630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:42.395630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:42.395630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:42.395630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:42.395630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:42.395630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:26:42.395630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:26:42.395630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:26:42.395630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:26:42.396690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:42.396690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:42.396690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:26:42.396690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:42.396690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:26:42.396690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:42.396690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:42.396690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:42.396690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:42.396690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:42.396690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:42.396690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:42.396690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:42.396690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:42.396690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:42.396690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:42.396690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:42.396690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:42.397606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:42.397606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:42.397606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:26:42.397606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:26:42.397606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:26:42.397606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:26:42.397606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:26:42.397606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:26:42.397606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:26:42.397606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:42.397606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 300/573] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 2 13:26:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:42.397606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e158f79-b359-43bc-b377-46a9403c1284 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:42.420752 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:42.455955 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:42.466031 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d80099-e05d-4aa0-8a74-fa042454497c None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:42.500224 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e158f79-b359-43bc-b377-46a9403c1284 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:42.501124 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea5c8b-7133-42da-80f3-416cca19cca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:42.501770 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea5c8b-7133-42da-80f3-416cca19cca1 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:42.502046 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea5c8b-7133-42da-80f3-416cca19cca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:42.502303 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea5c8b-7133-42da-80f3-416cca19cca1 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:42.503104 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea5c8b-7133-42da-80f3-416cca19cca1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:42.503408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea5c8b-7133-42da-80f3-416cca19cca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:42.504800 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea5c8b-7133-42da-80f3-416cca19cca1 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:42.512544 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 274/574] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 13:26:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:42.513441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea5c8b-7133-42da-80f3-416cca19cca1 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:42.538768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ef49c-50ad-475f-9f8e-e170d32a1662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:42.539456 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ef49c-50ad-475f-9f8e-e170d32a1662 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:42.539739 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ef49c-50ad-475f-9f8e-e170d32a1662 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:42.540012 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ef49c-50ad-475f-9f8e-e170d32a1662 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:42.540845 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ef49c-50ad-475f-9f8e-e170d32a1662 None admin] RBAC: Adding query filter params (role.id=9dc761b84aa745ad920c76ddf9fb0b9e, scope.project.id=af45a1ec7c94408bb638c55fb43fa961, user.id=8cd0e37b0404419bb5752228bd809be4) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:42.541157 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ef49c-50ad-475f-9f8e-e170d32a1662 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:42.542610 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ef49c-50ad-475f-9f8e-e170d32a1662 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:42.548604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 301/575] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:26:42 2022] GET /identity/v3/role_assignments?user.id=8cd0e37b0404419bb5752228bd809be4&scope.project.id=af45a1ec7c94408bb638c55fb43fa961&role.id=9dc761b84aa745ad920c76ddf9fb0b9e => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:42.549401 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ef49c-50ad-475f-9f8e-e170d32a1662 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:42.643633 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea5c8b-7133-42da-80f3-416cca19cca1 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:42.664396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:42.683290 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca21bd-872b-4d1c-9ec7-ca3560889726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:42.684113 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca21bd-872b-4d1c-9ec7-ca3560889726 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:42.684390 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca21bd-872b-4d1c-9ec7-ca3560889726 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:42.684722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca21bd-872b-4d1c-9ec7-ca3560889726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:42.689176 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ef49c-50ad-475f-9f8e-e170d32a1662 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:42.696932 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca21bd-872b-4d1c-9ec7-ca3560889726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:42.698408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca21bd-872b-4d1c-9ec7-ca3560889726 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:42.712414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:42.718628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-d8ca21bd-872b-4d1c-9ec7-ca3560889726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:42.718628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:42.718628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:42.718628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:42.718628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:42.718628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:42.718628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:42.718628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:42.718628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:42.718628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:42.718628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:42.718628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:42.718628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:42.718628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:42.718628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:42.719599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:42.719599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:42.719599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:42.719599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:42.719599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:42.719599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:42.719599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:42.719599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:42.719599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:42.719599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:42.719599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:42.719599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:42.719599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:42.719599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:42.719599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:42.719599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:42.719599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:42.720466 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:42.720466 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:42.720466 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:42.720466 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:42.720466 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 275/576] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:42.720743 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca21bd-872b-4d1c-9ec7-ca3560889726 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:42.732202 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b44817-235b-484a-bd4c-3d7103e918d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:42.732895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b44817-235b-484a-bd4c-3d7103e918d3 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:42.733728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b44817-235b-484a-bd4c-3d7103e918d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:42.733728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b44817-235b-484a-bd4c-3d7103e918d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:42.734176 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b44817-235b-484a-bd4c-3d7103e918d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:42.734483 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b44817-235b-484a-bd4c-3d7103e918d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:42.735933 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b44817-235b-484a-bd4c-3d7103e918d3 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:42.749419 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 302/577] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:42.750594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b44817-235b-484a-bd4c-3d7103e918d3 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:42.845041 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca21bd-872b-4d1c-9ec7-ca3560889726 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:42.852502 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b44817-235b-484a-bd4c-3d7103e918d3 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:42.878289 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06070eef-30f9-45cd-932f-9380d9c6b015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:42.879002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06070eef-30f9-45cd-932f-9380d9c6b015 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:42.879281 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06070eef-30f9-45cd-932f-9380d9c6b015 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:42.879558 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06070eef-30f9-45cd-932f-9380d9c6b015 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:42.880381 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06070eef-30f9-45cd-932f-9380d9c6b015 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:42.880685 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06070eef-30f9-45cd-932f-9380d9c6b015 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:42.882102 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06070eef-30f9-45cd-932f-9380d9c6b015 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:42.887154 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888ee3c-ad48-4c1f-85a4-b9828881b98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:42.888185 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888ee3c-ad48-4c1f-85a4-b9828881b98e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:42.888462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888ee3c-ad48-4c1f-85a4-b9828881b98e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:42.888732 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888ee3c-ad48-4c1f-85a4-b9828881b98e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:42.899750 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888ee3c-ad48-4c1f-85a4-b9828881b98e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:42.905653 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 276/578] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 2 13:26:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:42.905805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888ee3c-ad48-4c1f-85a4-b9828881b98e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:42.905894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06070eef-30f9-45cd-932f-9380d9c6b015 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:42.923811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-f888ee3c-ad48-4c1f-85a4-b9828881b98e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:42.923811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:42.923811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:42.923811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:42.923811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:42.923811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:42.923811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:42.923811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:42.923811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:42.923811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:42.923811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:42.923811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:42.923811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:42.923811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:42.923811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:42.924774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:42.924774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:42.924774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:42.924774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:42.924774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:42.924774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:42.924774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:42.924774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:42.924774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:42.924774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:42.924774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:42.924774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:42.924774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:42.924774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:42.924774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:42.924774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:42.924774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:42.925680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:42.925680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:42.925680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:42.925680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:42.925680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 303/579] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:42.925957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888ee3c-ad48-4c1f-85a4-b9828881b98e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:42.944064 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:42.958162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:43.023495 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06070eef-30f9-45cd-932f-9380d9c6b015 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:43.031709 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888ee3c-ad48-4c1f-85a4-b9828881b98e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:43.062287 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08eeafb-a42b-4a60-8ec8-702945f3e466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:43.063267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08eeafb-a42b-4a60-8ec8-702945f3e466 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:43.063685 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08eeafb-a42b-4a60-8ec8-702945f3e466 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:43.063960 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08eeafb-a42b-4a60-8ec8-702945f3e466 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:43.064679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08eeafb-a42b-4a60-8ec8-702945f3e466 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:43.064985 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08eeafb-a42b-4a60-8ec8-702945f3e466 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:43.066366 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08eeafb-a42b-4a60-8ec8-702945f3e466 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:43.067507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c654c-f5ac-42b4-93ec-31169ab1503b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:43.068424 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c654c-f5ac-42b4-93ec-31169ab1503b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:43.068700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c654c-f5ac-42b4-93ec-31169ab1503b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:43.069077 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c654c-f5ac-42b4-93ec-31169ab1503b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:43.076833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c654c-f5ac-42b4-93ec-31169ab1503b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:43.082795 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 277/580] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:43.082945 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c654c-f5ac-42b4-93ec-31169ab1503b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:43.083027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08eeafb-a42b-4a60-8ec8-702945f3e466 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:43.099442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-748c654c-f5ac-42b4-93ec-31169ab1503b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:26:43.099442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:43.099442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:43.099442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:43.099442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:43.099442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:43.099442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:43.099442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:43.099442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:43.099442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:43.099442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:43.099442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:43.099442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:26:43.099442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:26:43.099442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:26:43.099442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:26:43.100433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:43.100433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:43.100433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:26:43.100433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:43.100433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:26:43.100433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:43.100433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:43.100433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:43.100433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:43.100433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:43.100433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:43.100433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:43.100433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:43.100433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:43.100433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:43.100433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:43.100433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:43.100433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:43.101378 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:43.101378 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:43.101378 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:26:43.101378 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:26:43.101378 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:26:43.101378 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:26:43.101378 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:26:43.101378 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:26:43.101378 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:26:43.101378 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:43.101378 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 304/581] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:43.102922 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c654c-f5ac-42b4-93ec-31169ab1503b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:43.175421 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:43.188524 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08eeafb-a42b-4a60-8ec8-702945f3e466 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:43.199561 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:43.215527 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c654c-f5ac-42b4-93ec-31169ab1503b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:43.227645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59ec8d-e2fc-46c9-a593-9694af167041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:43.228452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59ec8d-e2fc-46c9-a593-9694af167041 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:43.228728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59ec8d-e2fc-46c9-a593-9694af167041 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:43.229353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59ec8d-e2fc-46c9-a593-9694af167041 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:43.241548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d59ec8d-e2fc-46c9-a593-9694af167041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:43.243041 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d59ec8d-e2fc-46c9-a593-9694af167041 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:43.256370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0ea5f-c1d1-4c4f-98b2-1fd5a1c85b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:43.257042 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ea5f-c1d1-4c4f-98b2-1fd5a1c85b4d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:43.257319 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ea5f-c1d1-4c4f-98b2-1fd5a1c85b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:43.257590 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ea5f-c1d1-4c4f-98b2-1fd5a1c85b4d None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:43.258306 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0ea5f-c1d1-4c4f-98b2-1fd5a1c85b4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:43.258631 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0ea5f-c1d1-4c4f-98b2-1fd5a1c85b4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:43.259971 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-4d59ec8d-e2fc-46c9-a593-9694af167041 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:43.259971 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:43.259971 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:43.259971 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:43.259971 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:43.259971 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:43.259971 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:43.259971 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:43.259971 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:43.259971 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:43.259971 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:43.259971 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:43.259971 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:43.259971 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:43.259971 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:43.260845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:43.260845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:43.260845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:43.260845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:43.260845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:43.260845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:43.260845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:43.260845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:43.260845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:43.260845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:43.260845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:43.260845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:43.260845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:43.260845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:43.260845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:43.260845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:43.260845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:43.261728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:43.261728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:43.261728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:43.261728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:43.261955 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0ea5f-c1d1-4c4f-98b2-1fd5a1c85b4d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:43.266011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 278/582] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:43.266911 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59ec8d-e2fc-46c9-a593-9694af167041 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:43.273881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 305/583] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:43.274820 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0ea5f-c1d1-4c4f-98b2-1fd5a1c85b4d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:43.375786 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59ec8d-e2fc-46c9-a593-9694af167041 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:43.382394 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0ea5f-c1d1-4c4f-98b2-1fd5a1c85b4d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:43.412376 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fb5a1-04b3-42f6-ba0f-cb5e7012b7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:43.416893 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fb5a1-04b3-42f6-ba0f-cb5e7012b7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:43.416893 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fb5a1-04b3-42f6-ba0f-cb5e7012b7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:43.416893 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fb5a1-04b3-42f6-ba0f-cb5e7012b7b3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:43.421201 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c53a4-3057-4289-a371-61c736d9cba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:43.421878 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c53a4-3057-4289-a371-61c736d9cba8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:43.422154 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c53a4-3057-4289-a371-61c736d9cba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:43.422422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c53a4-3057-4289-a371-61c736d9cba8 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:43.423285 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c53a4-3057-4289-a371-61c736d9cba8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:43.423586 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c53a4-3057-4289-a371-61c736d9cba8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:43.423746 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93fb5a1-04b3-42f6-ba0f-cb5e7012b7b3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:43.425165 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93fb5a1-04b3-42f6-ba0f-cb5e7012b7b3 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:43.425268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c53a4-3057-4289-a371-61c736d9cba8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:43.428830 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:43.441384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-d93fb5a1-04b3-42f6-ba0f-cb5e7012b7b3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:26:43.441384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:43.441384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:43.441384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:43.441384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:43.441384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:43.441384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:43.441384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:43.441384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:43.441384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:43.441384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:43.441384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:43.441384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:26:43.441384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:26:43.441384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:26:43.441384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:26:43.442396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:43.442396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:43.442396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:26:43.442396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:43.442396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:26:43.442396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:43.442396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:43.442396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:43.442396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:43.442396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:43.442396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:43.442396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:43.442396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:43.442396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:43.442396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:43.442396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:43.442396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:43.442396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:43.443742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:43.443742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:43.443742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:26:43.443742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:26:43.443742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:26:43.443742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:26:43.443742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:26:43.443742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:26:43.443742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:26:43.443742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:43.443742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 279/584] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:43.443742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fb5a1-04b3-42f6-ba0f-cb5e7012b7b3 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:43.453440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 306/585] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Jun 2 13:26:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:43.453440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c53a4-3057-4289-a371-61c736d9cba8 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:43.465332 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:43.545625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fb5a1-04b3-42f6-ba0f-cb5e7012b7b3 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:43.557504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c53a4-3057-4289-a371-61c736d9cba8 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:43.581971 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d99f3-7ce6-46e5-b5e9-9c411a14cb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:43.583062 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d99f3-7ce6-46e5-b5e9-9c411a14cb1b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:43.583526 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d99f3-7ce6-46e5-b5e9-9c411a14cb1b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:43.583948 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d99f3-7ce6-46e5-b5e9-9c411a14cb1b None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:43.584717 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d99f3-7ce6-46e5-b5e9-9c411a14cb1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:43.585022 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d99f3-7ce6-46e5-b5e9-9c411a14cb1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:43.586357 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d99f3-7ce6-46e5-b5e9-9c411a14cb1b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:43.595713 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f655302-8325-45f5-8edb-00445aed1d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:43.596499 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f655302-8325-45f5-8edb-00445aed1d44 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:43.596779 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f655302-8325-45f5-8edb-00445aed1d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:43.597049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f655302-8325-45f5-8edb-00445aed1d44 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:43.600190 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 280/586] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:43.601317 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d99f3-7ce6-46e5-b5e9-9c411a14cb1b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:43.605818 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f655302-8325-45f5-8edb-00445aed1d44 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:43.607408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f655302-8325-45f5-8edb-00445aed1d44 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:43.622244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-0f655302-8325-45f5-8edb-00445aed1d44 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:26:43.622244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:43.622244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:43.622244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:43.622244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:43.622244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:43.622244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:43.622244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:43.622244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:43.622244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:43.622244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:43.622244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:43.622244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:26:43.622244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:26:43.622244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:26:43.622244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:26:43.623218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:43.623218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:43.623218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:26:43.623218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:43.623218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:26:43.623218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:43.623218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:43.623218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:43.623218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:43.623218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:43.623218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:43.623218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:43.623218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:43.623218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:43.623218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:43.623218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:43.623218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:43.623218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:43.624134 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:43.624134 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:43.624134 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:26:43.624134 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:26:43.624134 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:26:43.624134 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:26:43.624134 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:26:43.624134 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:26:43.624134 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:26:43.624134 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:43.624134 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 307/587] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 13:26:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:43.625208 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f655302-8325-45f5-8edb-00445aed1d44 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:43.675583 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:43.709153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:43.719407 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d99f3-7ce6-46e5-b5e9-9c411a14cb1b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:43.743586 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f655302-8325-45f5-8edb-00445aed1d44 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:43.753554 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ff9b7-8945-4680-b0cb-8d7037e239ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:43.754242 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ff9b7-8945-4680-b0cb-8d7037e239ef None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:43.754523 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ff9b7-8945-4680-b0cb-8d7037e239ef None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:43.754825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ff9b7-8945-4680-b0cb-8d7037e239ef None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:43.755657 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ff9b7-8945-4680-b0cb-8d7037e239ef None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:43.755968 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ff9b7-8945-4680-b0cb-8d7037e239ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:43.757392 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ff9b7-8945-4680-b0cb-8d7037e239ef None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:43.774920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 281/588] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Jun 2 13:26:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:43.775753 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ff9b7-8945-4680-b0cb-8d7037e239ef None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:43.787900 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d66d3-87fb-4209-90c8-70e66fd47308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:43.788739 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d66d3-87fb-4209-90c8-70e66fd47308 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:43.789020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d66d3-87fb-4209-90c8-70e66fd47308 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:43.789345 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d66d3-87fb-4209-90c8-70e66fd47308 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:43.800392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d66d3-87fb-4209-90c8-70e66fd47308 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:43.801830 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d66d3-87fb-4209-90c8-70e66fd47308 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:43.820606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-072d66d3-87fb-4209-90c8-70e66fd47308 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:43.820606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:43.820606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:43.820606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:43.820606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:43.820606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:43.820606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:43.820606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:43.820606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:43.820606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:43.820606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:43.820606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:43.820606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:43.820606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:43.820606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:43.821562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:43.821562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:43.821562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:43.821562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:43.821562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:43.821562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:43.821562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:43.821562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:43.821562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:43.821562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:43.821562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:43.821562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:43.821562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:43.821562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:43.821562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:43.821562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:43.821562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:43.822437 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:43.822437 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:43.822437 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:43.822437 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:43.822437 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 308/589] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:43.822856 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d66d3-87fb-4209-90c8-70e66fd47308 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:43.882778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ff9b7-8945-4680-b0cb-8d7037e239ef None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:43.900363 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:43.918062 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca35e3-ddf2-4959-9480-ce1c3e91bf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:43.919006 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca35e3-ddf2-4959-9480-ce1c3e91bf77 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:43.919281 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca35e3-ddf2-4959-9480-ce1c3e91bf77 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:43.919580 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca35e3-ddf2-4959-9480-ce1c3e91bf77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:43.925800 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d66d3-87fb-4209-90c8-70e66fd47308 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:43.926423 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca35e3-ddf2-4959-9480-ce1c3e91bf77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:43.927944 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca35e3-ddf2-4959-9480-ce1c3e91bf77 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:43.942638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-54ca35e3-ddf2-4959-9480-ce1c3e91bf77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:43.942638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:43.942638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:43.942638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:43.942638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:43.942638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:43.942638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:43.942638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:43.942638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:43.942638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:43.942638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:43.942638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:43.942638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:26:43.942638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:26:43.942638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:26:43.943711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:26:43.943711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:43.943711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:43.943711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:43.943711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:43.943711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:43.943711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:43.943711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:43.943711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:43.943711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:43.943711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:43.943711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:43.943711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:43.943711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:43.943711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:43.943711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:43.943711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:43.944625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:26:43.944625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:26:43.944625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:26:43.944625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:26:43.944625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:26:43.944625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:26:43.944625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:43.944625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:43.944625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 282/590] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:43.945148 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca35e3-ddf2-4959-9480-ce1c3e91bf77 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:43.957048 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:43.971225 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8905260-eba7-450a-94f5-b63a8fc7ca62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:43.971917 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8905260-eba7-450a-94f5-b63a8fc7ca62 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:43.972188 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8905260-eba7-450a-94f5-b63a8fc7ca62 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:43.972455 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8905260-eba7-450a-94f5-b63a8fc7ca62 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:43.973284 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8905260-eba7-450a-94f5-b63a8fc7ca62 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:43.973584 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8905260-eba7-450a-94f5-b63a8fc7ca62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:43.975030 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8905260-eba7-450a-94f5-b63a8fc7ca62 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:43.996016 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 309/591] 10.222.0.18 () {56 vars in 1139 bytes} [Thu Jun 2 13:26:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:43.996016 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8905260-eba7-450a-94f5-b63a8fc7ca62 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:44.054689 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca35e3-ddf2-4959-9480-ce1c3e91bf77 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:44.090265 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56257228-f563-4b2a-969d-15d45d40e1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:44.091167 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56257228-f563-4b2a-969d-15d45d40e1cc None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:44.091444 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56257228-f563-4b2a-969d-15d45d40e1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:44.091715 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56257228-f563-4b2a-969d-15d45d40e1cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:44.097146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8905260-eba7-450a-94f5-b63a8fc7ca62 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:44.104092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56257228-f563-4b2a-969d-15d45d40e1cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:44.105544 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56257228-f563-4b2a-969d-15d45d40e1cc None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:44.123990 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-56257228-f563-4b2a-969d-15d45d40e1cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:44.123990 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:44.123990 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:44.123990 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:44.123990 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:44.123990 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:44.123990 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:44.123990 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:44.123990 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:44.123990 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:44.123990 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:44.123990 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:44.123990 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:44.123990 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:44.123990 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:44.125061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:44.125061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:44.125061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:44.125061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:44.125061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:44.125061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:44.125061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:44.125061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:44.125061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:44.125061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:44.125061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:44.125061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:44.125061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:44.125061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:44.125061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:44.125061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:44.125061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:44.125983 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:44.125983 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:44.125983 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:44.125983 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:44.125983 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 283/592] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:44.126386 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56257228-f563-4b2a-969d-15d45d40e1cc None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:44.140258 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a64ed-0c67-4e80-b46a-fffd5d34b9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:44.141199 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a64ed-0c67-4e80-b46a-fffd5d34b9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:44.141479 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a64ed-0c67-4e80-b46a-fffd5d34b9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:44.141747 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a64ed-0c67-4e80-b46a-fffd5d34b9d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:44.142467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a64ed-0c67-4e80-b46a-fffd5d34b9d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:44.142955 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a64ed-0c67-4e80-b46a-fffd5d34b9d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:44.144693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a64ed-0c67-4e80-b46a-fffd5d34b9d3 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:44.158993 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 310/593] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:44.160120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a64ed-0c67-4e80-b46a-fffd5d34b9d3 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:44.165550 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:44.207724 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:44.236868 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56257228-f563-4b2a-969d-15d45d40e1cc None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:44.269997 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a64ed-0c67-4e80-b46a-fffd5d34b9d3 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:44.272706 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f02b80-62f4-462f-9470-eb10b8330cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:44.273378 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f02b80-62f4-462f-9470-eb10b8330cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:44.273652 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f02b80-62f4-462f-9470-eb10b8330cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:44.273925 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f02b80-62f4-462f-9470-eb10b8330cd4 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:44.274734 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f02b80-62f4-462f-9470-eb10b8330cd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:44.275041 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f02b80-62f4-462f-9470-eb10b8330cd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:44.276458 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f02b80-62f4-462f-9470-eb10b8330cd4 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:44.294547 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 284/594] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:26:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:44.294547 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f02b80-62f4-462f-9470-eb10b8330cd4 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:44.310350 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84d090-4d9a-407c-95f6-12697fe0237b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:44.311196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84d090-4d9a-407c-95f6-12697fe0237b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:44.311475 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84d090-4d9a-407c-95f6-12697fe0237b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:44.311743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84d090-4d9a-407c-95f6-12697fe0237b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:44.323158 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f84d090-4d9a-407c-95f6-12697fe0237b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:44.324602 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f84d090-4d9a-407c-95f6-12697fe0237b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:44.342349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-9f84d090-4d9a-407c-95f6-12697fe0237b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:44.342349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:44.342349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:44.342349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:44.342349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:44.342349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:44.342349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:44.342349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:44.342349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:44.342349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:44.342349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:44.342349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:44.342349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:44.342349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:44.342349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:44.343462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:44.343462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:44.343462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:44.343462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:44.343462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:44.343462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:44.343462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:44.343462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:44.343462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:44.343462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:44.343462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:44.343462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:44.343462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:44.343462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:44.343462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:44.343462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:44.343462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:44.344930 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:44.344930 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:44.344930 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:44.344930 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:44.344930 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 311/595] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:44.344930 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84d090-4d9a-407c-95f6-12697fe0237b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:44.388519 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:44.399587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f02b80-62f4-462f-9470-eb10b8330cd4 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:44.434077 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca66fd7-5b61-47eb-9fa3-7c4454e42e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:44.435050 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca66fd7-5b61-47eb-9fa3-7c4454e42e75 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:44.435351 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca66fd7-5b61-47eb-9fa3-7c4454e42e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:44.435623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca66fd7-5b61-47eb-9fa3-7c4454e42e75 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:44.436345 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca66fd7-5b61-47eb-9fa3-7c4454e42e75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:44.436697 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca66fd7-5b61-47eb-9fa3-7c4454e42e75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:44.438053 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca66fd7-5b61-47eb-9fa3-7c4454e42e75 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:44.446967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:44.450001 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 285/596] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:44.450970 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca66fd7-5b61-47eb-9fa3-7c4454e42e75 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:44.464155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84d090-4d9a-407c-95f6-12697fe0237b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:44.505709 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29032b45-65a1-4b60-bd77-e3179a5adaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:44.506414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29032b45-65a1-4b60-bd77-e3179a5adaf4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:44.506738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29032b45-65a1-4b60-bd77-e3179a5adaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:44.507004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29032b45-65a1-4b60-bd77-e3179a5adaf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:44.515308 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29032b45-65a1-4b60-bd77-e3179a5adaf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:44.516954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29032b45-65a1-4b60-bd77-e3179a5adaf4 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:44.531832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-29032b45-65a1-4b60-bd77-e3179a5adaf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:44.531832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:44.531832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:44.531832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:44.531832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:44.531832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:44.531832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:44.531832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:44.531832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:44.531832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:44.531832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:44.531832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:44.531832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:26:44.531832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:26:44.531832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:26:44.532744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:26:44.532744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:44.532744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:44.532744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:44.532744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:44.532744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:44.532744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:44.532744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:44.532744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:44.532744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:44.532744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:44.532744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:44.532744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:44.532744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:44.532744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:44.532744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:44.532744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:44.533633 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:26:44.533633 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:26:44.533633 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:26:44.533633 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:26:44.533633 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:26:44.533633 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:26:44.533633 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:44.533633 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:44.533633 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 312/597] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:44.534269 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29032b45-65a1-4b60-bd77-e3179a5adaf4 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:44.565320 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca66fd7-5b61-47eb-9fa3-7c4454e42e75 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:44.603071 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8203db-dd14-43bd-89bd-266880567191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:44.603984 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8203db-dd14-43bd-89bd-266880567191 None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:44.604265 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8203db-dd14-43bd-89bd-266880567191 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:44.604538 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8203db-dd14-43bd-89bd-266880567191 None admin] PATH_INFO: `/v3/projects/af45a1ec7c94408bb638c55fb43fa961/users/5a0061e2927843cf86769d2beab18743/roles/9dc761b84aa745ad920c76ddf9fb0b9e` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:44.622020 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8203db-dd14-43bd-89bd-266880567191 None admin] RBAC: Authorizing `identity:create_grant(project_id=af45a1ec7c94408bb638c55fb43fa961, user_id=5a0061e2927843cf86769d2beab18743, role_id=9dc761b84aa745ad920c76ddf9fb0b9e)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:44.624332 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8203db-dd14-43bd-89bd-266880567191 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:44.641488 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29032b45-65a1-4b60-bd77-e3179a5adaf4 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:44.642497 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:44.659578 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 286/598] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 13:26:44 2022] PUT /identity/v3/projects/af45a1ec7c94408bb638c55fb43fa961/users/5a0061e2927843cf86769d2beab18743/roles/9dc761b84aa745ad920c76ddf9fb0b9e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:26:44.659578 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8203db-dd14-43bd-89bd-266880567191 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:44.694751 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853cd4a1-3892-4225-9ec2-a6bb869ae2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:44.695445 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cd4a1-3892-4225-9ec2-a6bb869ae2ec None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:44.695728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cd4a1-3892-4225-9ec2-a6bb869ae2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:44.695991 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cd4a1-3892-4225-9ec2-a6bb869ae2ec None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:44.696726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853cd4a1-3892-4225-9ec2-a6bb869ae2ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:44.697028 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853cd4a1-3892-4225-9ec2-a6bb869ae2ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:44.698432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853cd4a1-3892-4225-9ec2-a6bb869ae2ec None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:44.716654 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 313/599] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:44.717803 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853cd4a1-3892-4225-9ec2-a6bb869ae2ec None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:44.736049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:44.795711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8203db-dd14-43bd-89bd-266880567191 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:44.839505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853cd4a1-3892-4225-9ec2-a6bb869ae2ec None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:44.844218 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f15a5-c0e0-4f19-8614-fd19b8caab99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:44.845049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f15a5-c0e0-4f19-8614-fd19b8caab99 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:44.845326 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f15a5-c0e0-4f19-8614-fd19b8caab99 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:44.845594 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f15a5-c0e0-4f19-8614-fd19b8caab99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:44.855111 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f15a5-c0e0-4f19-8614-fd19b8caab99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:44.856628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f15a5-c0e0-4f19-8614-fd19b8caab99 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:44.871369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-d53f15a5-c0e0-4f19-8614-fd19b8caab99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:44.871369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:44.871369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:44.871369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:44.871369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:44.871369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:44.871369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:44.871369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:44.871369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:44.871369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:44.871369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:44.871369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:44.871369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:26:44.871369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:26:44.871369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:26:44.872470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:26:44.872470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:44.872470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:44.872470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:44.872470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:44.872470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:44.872470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:44.872470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:44.872470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:44.872470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:44.872470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:44.872470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:44.872470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:44.872470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:44.872470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:44.872470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:44.872470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:44.873343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:26:44.873343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:26:44.873343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:26:44.873343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:26:44.873343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:26:44.873343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:26:44.873343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:44.873343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:44.873343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 287/600] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:44.873803 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f15a5-c0e0-4f19-8614-fd19b8caab99 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:44.883117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92cbff-e097-46db-b87f-40ea35cde8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:44.883794 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92cbff-e097-46db-b87f-40ea35cde8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:44.884070 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92cbff-e097-46db-b87f-40ea35cde8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:44.884335 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92cbff-e097-46db-b87f-40ea35cde8b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:44.885383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92cbff-e097-46db-b87f-40ea35cde8b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:44.885507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92cbff-e097-46db-b87f-40ea35cde8b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:44.886860 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92cbff-e097-46db-b87f-40ea35cde8b5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:44.904963 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 314/601] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:26:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:44.906349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cec83-d9af-4c55-984a-2de3eb01c64c None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:44.906897 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cec83-d9af-4c55-984a-2de3eb01c64c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:44.907025 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cec83-d9af-4c55-984a-2de3eb01c64c None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:44.908324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 315/602] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:44.909721 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cec83-d9af-4c55-984a-2de3eb01c64c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:44.948966 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:44.994821 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f15a5-c0e0-4f19-8614-fd19b8caab99 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:44.995627 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:45.041116 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cec83-d9af-4c55-984a-2de3eb01c64c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:45.041562 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c5cfe-97a2-4894-8c21-17f37053632d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:45.042385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c5cfe-97a2-4894-8c21-17f37053632d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:45.042713 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c5cfe-97a2-4894-8c21-17f37053632d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:45.043126 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c5cfe-97a2-4894-8c21-17f37053632d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:45.053302 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c5cfe-97a2-4894-8c21-17f37053632d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:45.054707 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c5cfe-97a2-4894-8c21-17f37053632d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:45.069319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-af0c5cfe-97a2-4894-8c21-17f37053632d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:45.069319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:45.069319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:45.069319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:45.069319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:45.069319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:45.069319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:45.069319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:45.069319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:45.069319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:45.069319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:45.069319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:45.069319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:26:45.069319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:26:45.069319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:26:45.070215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:26:45.070215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:45.070215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:45.070215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:45.070215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:45.070215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:45.070215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:45.070215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:45.070215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:45.070215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:45.070215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:45.070215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:45.070215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:45.070215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:45.070215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:45.070215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:45.070215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:45.071452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:26:45.071452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:26:45.071452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:26:45.071452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:26:45.071452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:26:45.071452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:26:45.071452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:45.071452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:45.071452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 288/603] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:45.071452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c5cfe-97a2-4894-8c21-17f37053632d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:45.085265 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae65193-5ee2-4d96-b791-94f39fca8d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:45.085909 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae65193-5ee2-4d96-b791-94f39fca8d65 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:45.086205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae65193-5ee2-4d96-b791-94f39fca8d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:45.086474 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae65193-5ee2-4d96-b791-94f39fca8d65 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:45.087296 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae65193-5ee2-4d96-b791-94f39fca8d65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:45.087600 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae65193-5ee2-4d96-b791-94f39fca8d65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:45.089048 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae65193-5ee2-4d96-b791-94f39fca8d65 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:45.100945 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 316/604] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:26:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:45.106767 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92146e7-a61b-4faa-a18e-ed891351d724 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:45.107056 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92146e7-a61b-4faa-a18e-ed891351d724 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:45.107332 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92146e7-a61b-4faa-a18e-ed891351d724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:45.123383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f92146e7-a61b-4faa-a18e-ed891351d724 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:45.124587 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f92146e7-a61b-4faa-a18e-ed891351d724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:45.176335 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c5cfe-97a2-4894-8c21-17f37053632d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:45.198884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 317/605] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:45.198884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92146e7-a61b-4faa-a18e-ed891351d724 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:45.202375 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:45.221096 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a40eaa-557e-48cb-82a4-aaeee0e1d21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:45.222122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a40eaa-557e-48cb-82a4-aaeee0e1d21f None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:45.222373 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a40eaa-557e-48cb-82a4-aaeee0e1d21f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:45.222715 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a40eaa-557e-48cb-82a4-aaeee0e1d21f None admin] PATH_INFO: `/v3/projects/af45a1ec7c94408bb638c55fb43fa961/users/22df4e0d98e34758963d3b1465a3a377/roles/9dc761b84aa745ad920c76ddf9fb0b9e` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:45.238150 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a40eaa-557e-48cb-82a4-aaeee0e1d21f None admin] RBAC: Authorizing `identity:create_grant(project_id=af45a1ec7c94408bb638c55fb43fa961, user_id=22df4e0d98e34758963d3b1465a3a377, role_id=9dc761b84aa745ad920c76ddf9fb0b9e)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:45.239651 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a40eaa-557e-48cb-82a4-aaeee0e1d21f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:45.252908 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 289/606] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 13:26:45 2022] PUT /identity/v3/projects/af45a1ec7c94408bb638c55fb43fa961/users/22df4e0d98e34758963d3b1465a3a377/roles/9dc761b84aa745ad920c76ddf9fb0b9e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:26:45.253626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a40eaa-557e-48cb-82a4-aaeee0e1d21f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:45.281842 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:45.332230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92146e7-a61b-4faa-a18e-ed891351d724 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:45.369677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a40eaa-557e-48cb-82a4-aaeee0e1d21f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:45.373693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521871d9-dc3c-45b0-b936-44c40f36de0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:45.374733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521871d9-dc3c-45b0-b936-44c40f36de0e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:45.375208 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521871d9-dc3c-45b0-b936-44c40f36de0e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:45.375724 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521871d9-dc3c-45b0-b936-44c40f36de0e None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:45.376719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521871d9-dc3c-45b0-b936-44c40f36de0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:45.377222 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521871d9-dc3c-45b0-b936-44c40f36de0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:45.379296 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521871d9-dc3c-45b0-b936-44c40f36de0e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:45.394338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 318/607] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:26:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:45.395846 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521871d9-dc3c-45b0-b936-44c40f36de0e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:45.408674 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b90bef-d164-4adf-96a7-2d7e92282a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:45.409720 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b90bef-d164-4adf-96a7-2d7e92282a81 None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:45.409919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b90bef-d164-4adf-96a7-2d7e92282a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:45.410193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b90bef-d164-4adf-96a7-2d7e92282a81 None admin] PATH_INFO: `/v3/projects/af45a1ec7c94408bb638c55fb43fa961/users/58b2f0101284461398a95538466002bd/roles/9dc761b84aa745ad920c76ddf9fb0b9e` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:45.427456 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b90bef-d164-4adf-96a7-2d7e92282a81 None admin] RBAC: Authorizing `identity:create_grant(project_id=af45a1ec7c94408bb638c55fb43fa961, user_id=58b2f0101284461398a95538466002bd, role_id=9dc761b84aa745ad920c76ddf9fb0b9e)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:45.428937 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b90bef-d164-4adf-96a7-2d7e92282a81 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:45.452006 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 290/608] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 13:26:45 2022] PUT /identity/v3/projects/af45a1ec7c94408bb638c55fb43fa961/users/58b2f0101284461398a95538466002bd/roles/9dc761b84aa745ad920c76ddf9fb0b9e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:26:45.453204 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b90bef-d164-4adf-96a7-2d7e92282a81 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:45.487592 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:45.539469 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521871d9-dc3c-45b0-b936-44c40f36de0e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:45.567336 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:45.589932 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df11e05-3e67-4f0b-a4de-c0fe42905207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:45.592093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df11e05-3e67-4f0b-a4de-c0fe42905207 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:45.592731 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df11e05-3e67-4f0b-a4de-c0fe42905207 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:45.593223 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df11e05-3e67-4f0b-a4de-c0fe42905207 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:45.607240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b90bef-d164-4adf-96a7-2d7e92282a81 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:45.611383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df11e05-3e67-4f0b-a4de-c0fe42905207 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:45.619740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-5df11e05-3e67-4f0b-a4de-c0fe42905207 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:45.619740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:45.619740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:45.619740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:45.619740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:45.619740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:45.619740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:45.619740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:45.619740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:45.619740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:45.619740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:45.619740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:45.619740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:45.619740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:45.619740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:45.619740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:45.620769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:45.620769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:45.620769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:45.620769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:45.620769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:45.620769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:45.620769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:45.620769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:45.620769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:45.620769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:45.620769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:45.620769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:45.620769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:45.620769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:45.620769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:45.620769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:45.621711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:45.621711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:45.621711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:45.621711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:45.621711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:45.621711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:45.621711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:45.621711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:45.621711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:45.621711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:45.621711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:45.621711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:45.625525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 319/609] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 13:26:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:45.638219 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df11e05-3e67-4f0b-a4de-c0fe42905207 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:45.685343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9cf3d-d132-431a-ab0c-654786243c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:45.686313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9cf3d-d132-431a-ab0c-654786243c9c None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:45.686604 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9cf3d-d132-431a-ab0c-654786243c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:45.686880 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9cf3d-d132-431a-ab0c-654786243c9c None admin] PATH_INFO: `/v3/projects/af45a1ec7c94408bb638c55fb43fa961/users/a072e8e01bc64c9b92579bb8f1d513a4/roles/9dc761b84aa745ad920c76ddf9fb0b9e` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:45.705690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9cf3d-d132-431a-ab0c-654786243c9c None admin] RBAC: Authorizing `identity:create_grant(project_id=af45a1ec7c94408bb638c55fb43fa961, user_id=a072e8e01bc64c9b92579bb8f1d513a4, role_id=9dc761b84aa745ad920c76ddf9fb0b9e)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:45.707353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9cf3d-d132-431a-ab0c-654786243c9c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:45.729722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 291/610] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 13:26:45 2022] PUT /identity/v3/projects/af45a1ec7c94408bb638c55fb43fa961/users/a072e8e01bc64c9b92579bb8f1d513a4/roles/9dc761b84aa745ad920c76ddf9fb0b9e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:26:45.786134 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df11e05-3e67-4f0b-a4de-c0fe42905207 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:45.827049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f168e2-81f8-478a-9de5-3ee4cc0fcf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:45.827791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f168e2-81f8-478a-9de5-3ee4cc0fcf9b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:45.828073 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f168e2-81f8-478a-9de5-3ee4cc0fcf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:45.828341 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f168e2-81f8-478a-9de5-3ee4cc0fcf9b None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:45.829241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f168e2-81f8-478a-9de5-3ee4cc0fcf9b None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:45.829544 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f168e2-81f8-478a-9de5-3ee4cc0fcf9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:45.831184 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f168e2-81f8-478a-9de5-3ee4cc0fcf9b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:45.841501 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 320/611] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 13:26:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:26:45.847569 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9cf3d-d132-431a-ab0c-654786243c9c None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:45.963059 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:46.009345 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9cf3d-d132-431a-ab0c-654786243c9c None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:46.048152 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a9a05-01b5-4b23-8c9f-29caceb0aec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:46.049098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a9a05-01b5-4b23-8c9f-29caceb0aec1 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:46.049385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a9a05-01b5-4b23-8c9f-29caceb0aec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:46.049774 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a9a05-01b5-4b23-8c9f-29caceb0aec1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:46.062448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a9a05-01b5-4b23-8c9f-29caceb0aec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:46.064031 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a9a05-01b5-4b23-8c9f-29caceb0aec1 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:46.085915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-ab0a9a05-01b5-4b23-8c9f-29caceb0aec1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:46.085915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:46.085915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:46.085915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:46.085915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:46.085915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:46.085915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:46.085915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:46.085915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:46.085915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:46.085915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:46.085915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:46.085915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:46.085915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:46.085915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:46.086918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:46.086918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:46.086918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:46.086918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:46.086918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:46.086918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:46.086918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:46.086918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:46.086918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:46.086918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:46.086918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:46.086918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:46.086918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:46.086918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:46.086918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:46.086918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:46.086918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:46.087860 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:46.087860 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:46.087860 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:46.087860 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:46.087860 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 292/612] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:46.092969 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f168e2-81f8-478a-9de5-3ee4cc0fcf9b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:46.174366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:46.261390 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f168e2-81f8-478a-9de5-3ee4cc0fcf9b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:46.302809 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476459e-4589-446d-b8f2-081bdedfb31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:46.303497 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476459e-4589-446d-b8f2-081bdedfb31f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:46.303777 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476459e-4589-446d-b8f2-081bdedfb31f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:46.304044 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476459e-4589-446d-b8f2-081bdedfb31f None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:46.304835 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476459e-4589-446d-b8f2-081bdedfb31f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:46.305137 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476459e-4589-446d-b8f2-081bdedfb31f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:46.306589 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476459e-4589-446d-b8f2-081bdedfb31f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:46.325686 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 321/613] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:46.331631 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a9a05-01b5-4b23-8c9f-29caceb0aec1 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:46.500089 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a9a05-01b5-4b23-8c9f-29caceb0aec1 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:46.525029 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:46.539223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70110dd4-6eb5-4eeb-919e-5df169ef79ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:46.540042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70110dd4-6eb5-4eeb-919e-5df169ef79ee None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:46.540326 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70110dd4-6eb5-4eeb-919e-5df169ef79ee None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:46.540595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70110dd4-6eb5-4eeb-919e-5df169ef79ee None admin] PATH_INFO: `/v3/users/swift` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:46.560209 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70110dd4-6eb5-4eeb-919e-5df169ef79ee None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:46.561675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70110dd4-6eb5-4eeb-919e-5df169ef79ee None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:46.579161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-70110dd4-6eb5-4eeb-919e-5df169ef79ee None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:26:46.579161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:46.579161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:46.579161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:46.579161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:46.579161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:46.579161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:46.579161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:46.579161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:46.579161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:46.579161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:46.579161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:46.579161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:26:46.579161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:26:46.579161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:26:46.579161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:26:46.582182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:46.582182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:46.582182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:26:46.582182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:46.582182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:26:46.582182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:46.582182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:46.582182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:46.582182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:46.582182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:46.582182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:46.582182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:46.582182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:46.582182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:46.582182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:46.582182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:46.582182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:46.582182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:46.584409 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:46.584409 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:46.584409 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:26:46.584409 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:26:46.584409 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:26:46.584409 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:26:46.584409 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:26:46.584409 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:26:46.584409 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:26:46.584409 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:46.584409 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 293/614] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:26:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:46.590767 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476459e-4589-446d-b8f2-081bdedfb31f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:46.759611 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476459e-4589-446d-b8f2-081bdedfb31f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:46.761875 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:46.795194 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b8d1e-a5c3-4c13-806a-3068c43f36d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:46.795879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b8d1e-a5c3-4c13-806a-3068c43f36d9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:46.796155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b8d1e-a5c3-4c13-806a-3068c43f36d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:46.796423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b8d1e-a5c3-4c13-806a-3068c43f36d9 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:46.797258 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b8d1e-a5c3-4c13-806a-3068c43f36d9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:46.797557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b8d1e-a5c3-4c13-806a-3068c43f36d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:46.799017 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b8d1e-a5c3-4c13-806a-3068c43f36d9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:46.822111 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 322/615] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Jun 2 13:26:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:46.823438 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70110dd4-6eb5-4eeb-919e-5df169ef79ee None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:46.979543 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70110dd4-6eb5-4eeb-919e-5df169ef79ee None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:47.055408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c46c04-e11f-4b2d-a298-7e2897a58072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:47.056660 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c46c04-e11f-4b2d-a298-7e2897a58072 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:47.057178 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c46c04-e11f-4b2d-a298-7e2897a58072 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:47.057637 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c46c04-e11f-4b2d-a298-7e2897a58072 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:47.078604 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c46c04-e11f-4b2d-a298-7e2897a58072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:47.081606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c46c04-e11f-4b2d-a298-7e2897a58072 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:47.109437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-d4c46c04-e11f-4b2d-a298-7e2897a58072 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:47.109437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:47.109437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:47.109437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:47.109437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:47.109437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:47.109437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:47.109437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:47.109437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:47.109437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:47.109437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:47.109437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:47.109437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:47.109437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:47.109437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:47.110414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:47.110414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:47.110414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:47.110414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:47.110414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:47.110414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:47.110414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:47.110414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:47.110414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:47.110414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:47.110414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:47.110414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:47.110414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:47.110414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:47.110414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:47.110414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:47.110414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:47.111325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:47.111325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:47.111325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:47.111325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:47.113332 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 294/616] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:47.123738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b8d1e-a5c3-4c13-806a-3068c43f36d9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:47.274231 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b8d1e-a5c3-4c13-806a-3068c43f36d9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:47.322866 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d2dd5-1519-4c15-89e4-f8f960bf6603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:47.323468 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d2dd5-1519-4c15-89e4-f8f960bf6603 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:47.323734 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d2dd5-1519-4c15-89e4-f8f960bf6603 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:47.324007 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d2dd5-1519-4c15-89e4-f8f960bf6603 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:47.324733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d2dd5-1519-4c15-89e4-f8f960bf6603 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:47.325160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d2dd5-1519-4c15-89e4-f8f960bf6603 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:47.326539 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d2dd5-1519-4c15-89e4-f8f960bf6603 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:47.341138 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 323/617] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:47.347442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c46c04-e11f-4b2d-a298-7e2897a58072 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:47.400919 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d040e9-259d-4ca1-b70c-61b7b13f09f9 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:47.401256 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d040e9-259d-4ca1-b70c-61b7b13f09f9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:47.401530 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d040e9-259d-4ca1-b70c-61b7b13f09f9 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:47.403544 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 324/618] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:47.409424 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e488ce-d3d8-43a3-b9d2-5b6c8252bcf0 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:47.409730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e488ce-d3d8-43a3-b9d2-5b6c8252bcf0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:47.410073 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e488ce-d3d8-43a3-b9d2-5b6c8252bcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:47.411276 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:47.431861 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-23e488ce-d3d8-43a3-b9d2-5b6c8252bcf0 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:47.433062 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-23e488ce-d3d8-43a3-b9d2-5b6c8252bcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:47.468192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:47.540122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c46c04-e11f-4b2d-a298-7e2897a58072 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:47.563976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 325/619] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:26:47.598934 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621a43f-9310-4934-8566-9e31a69406d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:47.599684 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621a43f-9310-4934-8566-9e31a69406d2 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:47.599962 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621a43f-9310-4934-8566-9e31a69406d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:47.600233 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621a43f-9310-4934-8566-9e31a69406d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:47.616347 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e488ce-d3d8-43a3-b9d2-5b6c8252bcf0 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:47.620253 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c621a43f-9310-4934-8566-9e31a69406d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:47.625818 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c621a43f-9310-4934-8566-9e31a69406d2 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:47.646359 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-c621a43f-9310-4934-8566-9e31a69406d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:47.646359 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:47.646359 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:47.646359 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:47.646359 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:47.646359 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:47.646359 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:47.646359 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:47.646359 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:47.646359 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:47.646359 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:47.646359 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:47.646359 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:26:47.646359 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:26:47.646359 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:26:47.647529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:26:47.647529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:47.647529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:47.647529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:47.647529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:47.647529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:47.647529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:47.647529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:47.647529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:47.647529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:47.647529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:47.647529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:47.647529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:47.647529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:47.647529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:47.647529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:47.647529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:47.648654 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:26:47.648654 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:26:47.648654 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:26:47.648654 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:26:47.648654 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:26:47.648654 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:26:47.648654 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:47.648654 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:47.650844 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 295/620] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:47.662095 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621a43f-9310-4934-8566-9e31a69406d2 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:47.765943 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621a43f-9310-4934-8566-9e31a69406d2 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:47.771110 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:47.785985 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e488ce-d3d8-43a3-b9d2-5b6c8252bcf0 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:47.831213 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d5160-dfce-443e-bc8a-627c043beea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:47.831898 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d5160-dfce-443e-bc8a-627c043beea5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:47.832176 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d5160-dfce-443e-bc8a-627c043beea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:47.832450 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d5160-dfce-443e-bc8a-627c043beea5 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:47.833245 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d5160-dfce-443e-bc8a-627c043beea5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:47.833549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d5160-dfce-443e-bc8a-627c043beea5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:47.835008 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d5160-dfce-443e-bc8a-627c043beea5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:47.841014 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6252f2d-e327-46ee-adec-31d30962b02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:47.841951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6252f2d-e327-46ee-adec-31d30962b02c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:47.842234 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6252f2d-e327-46ee-adec-31d30962b02c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:47.842507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6252f2d-e327-46ee-adec-31d30962b02c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:47.864117 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 296/621] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:26:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:47.867515 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d5160-dfce-443e-bc8a-627c043beea5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:47.869108 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6252f2d-e327-46ee-adec-31d30962b02c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:47.877208 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-b6252f2d-e327-46ee-adec-31d30962b02c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:47.877208 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:47.877208 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:47.877208 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:47.877208 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:47.877208 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:47.877208 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:47.877208 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:47.877208 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:47.877208 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:47.877208 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:47.877208 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:47.877208 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:47.877208 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:47.877208 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:47.877208 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:47.878257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:47.878257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:47.878257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:47.878257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:47.878257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:47.878257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:47.878257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:47.878257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:47.878257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:47.878257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:47.878257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:47.878257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:47.878257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:47.878257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:47.878257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:47.878257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:47.879120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:47.879120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:47.879120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:47.879120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:47.879120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:47.879120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:47.879120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:47.879120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:47.879120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:47.879120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:47.879120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:47.879120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:47.879120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 326/622] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 13:26:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:26:47.891400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6252f2d-e327-46ee-adec-31d30962b02c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:47.921750 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:48.004001 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d5160-dfce-443e-bc8a-627c043beea5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:48.072554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6252f2d-e327-46ee-adec-31d30962b02c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:48.084691 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19001776-aba0-4f97-a058-ee21f5d2d581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:48.085613 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19001776-aba0-4f97-a058-ee21f5d2d581 None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:48.085893 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19001776-aba0-4f97-a058-ee21f5d2d581 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:48.086166 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19001776-aba0-4f97-a058-ee21f5d2d581 None admin] PATH_INFO: `/v3/projects/af45a1ec7c94408bb638c55fb43fa961/users/8cd0e37b0404419bb5752228bd809be4/roles/9dc761b84aa745ad920c76ddf9fb0b9e` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:48.118298 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19001776-aba0-4f97-a058-ee21f5d2d581 None admin] RBAC: Authorizing `identity:create_grant(project_id=af45a1ec7c94408bb638c55fb43fa961, user_id=8cd0e37b0404419bb5752228bd809be4, role_id=9dc761b84aa745ad920c76ddf9fb0b9e)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:48.120459 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19001776-aba0-4f97-a058-ee21f5d2d581 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:48.123297 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3246f59-2ed9-4715-b830-3a00f83656a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:48.124145 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3246f59-2ed9-4715-b830-3a00f83656a2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:48.124568 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3246f59-2ed9-4715-b830-3a00f83656a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:48.126469 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3246f59-2ed9-4715-b830-3a00f83656a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:48.127409 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3246f59-2ed9-4715-b830-3a00f83656a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:48.127882 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3246f59-2ed9-4715-b830-3a00f83656a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:48.129787 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3246f59-2ed9-4715-b830-3a00f83656a2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:48.146066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 297/623] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 13:26:47 2022] PUT /identity/v3/projects/af45a1ec7c94408bb638c55fb43fa961/users/8cd0e37b0404419bb5752228bd809be4/roles/9dc761b84aa745ad920c76ddf9fb0b9e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:26:48.148466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 327/624] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 13:26:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:48.157710 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19001776-aba0-4f97-a058-ee21f5d2d581 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:48.159266 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:48.266411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494ade7-3b0a-4088-b97d-bcc3769ef216 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:48.267105 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494ade7-3b0a-4088-b97d-bcc3769ef216 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:48.267579 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494ade7-3b0a-4088-b97d-bcc3769ef216 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:48.269579 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 328/625] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:26:48.275648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009eff29-203d-4c16-8c76-32223346007f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:48.276717 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009eff29-203d-4c16-8c76-32223346007f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:48.277189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009eff29-203d-4c16-8c76-32223346007f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:48.286620 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19001776-aba0-4f97-a058-ee21f5d2d581 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:48.327479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb44f9-0a48-4e52-b725-aaf1f89da575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:48.328312 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb44f9-0a48-4e52-b725-aaf1f89da575 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:48.328592 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb44f9-0a48-4e52-b725-aaf1f89da575 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:48.328859 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb44f9-0a48-4e52-b725-aaf1f89da575 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:48.333656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-009eff29-203d-4c16-8c76-32223346007f None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:48.334927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-009eff29-203d-4c16-8c76-32223346007f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:48.356860 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb44f9-0a48-4e52-b725-aaf1f89da575 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:48.358369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb44f9-0a48-4e52-b725-aaf1f89da575 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:48.387252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-9abb44f9-0a48-4e52-b725-aaf1f89da575 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:48.387252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:48.387252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:48.387252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:48.387252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:48.387252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:48.387252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:48.387252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:48.387252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:48.387252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:48.387252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:48.387252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:48.387252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:48.387252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:48.387252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:48.388251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:48.388251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:48.388251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:48.388251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:48.388251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:48.388251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:48.388251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:48.388251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:48.388251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:48.388251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:48.388251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:48.388251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:48.388251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:48.388251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:48.388251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:48.388251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:48.388251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:48.389318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:48.389318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:48.389318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:48.389318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:48.389318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 298/626] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:48.392602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159f86d-3d64-4f7b-986a-68641dba1510 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:48.392602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159f86d-3d64-4f7b-986a-68641dba1510 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:48.392602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159f86d-3d64-4f7b-986a-68641dba1510 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:48.392901 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 299/627] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:48.394724 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159f86d-3d64-4f7b-986a-68641dba1510 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:48.451356 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 329/628] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:48.452981 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551952c3-752f-4da7-9b2e-a32613a20014 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:48.453269 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551952c3-752f-4da7-9b2e-a32613a20014 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:48.453542 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551952c3-752f-4da7-9b2e-a32613a20014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:48.460115 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:48.473748 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:48.475493 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-551952c3-752f-4da7-9b2e-a32613a20014 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:48.477901 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-551952c3-752f-4da7-9b2e-a32613a20014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:48.526699 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159f86d-3d64-4f7b-986a-68641dba1510 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:48.565527 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 330/629] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:48.565946 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc652d-d09c-4737-b15d-c7c8ad7c463e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:48.566425 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551952c3-752f-4da7-9b2e-a32613a20014 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:48.566721 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc652d-d09c-4737-b15d-c7c8ad7c463e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:48.567146 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc652d-d09c-4737-b15d-c7c8ad7c463e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:48.567422 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc652d-d09c-4737-b15d-c7c8ad7c463e None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:48.568294 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc652d-d09c-4737-b15d-c7c8ad7c463e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:48.568600 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc652d-d09c-4737-b15d-c7c8ad7c463e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:48.570034 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc652d-d09c-4737-b15d-c7c8ad7c463e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:48.594417 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 300/630] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:48.595985 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc652d-d09c-4737-b15d-c7c8ad7c463e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:48.712335 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551952c3-752f-4da7-9b2e-a32613a20014 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:48.713164 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc652d-d09c-4737-b15d-c7c8ad7c463e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:48.730515 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:48.750422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7240351-8922-431f-9753-f5b34cc956be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:48.750646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b2b9e-edfe-48f5-892f-62e093ff2a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:48.751292 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7240351-8922-431f-9753-f5b34cc956be None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:48.751396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b2b9e-edfe-48f5-892f-62e093ff2a32 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:48.751626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7240351-8922-431f-9753-f5b34cc956be None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:48.751733 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b2b9e-edfe-48f5-892f-62e093ff2a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:48.751899 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7240351-8922-431f-9753-f5b34cc956be None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:48.752077 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b2b9e-edfe-48f5-892f-62e093ff2a32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:48.753841 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:48.764425 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7240351-8922-431f-9753-f5b34cc956be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:48.765339 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b2b9e-edfe-48f5-892f-62e093ff2a32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:48.772492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-e7240351-8922-431f-9753-f5b34cc956be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:48.772492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:48.772492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:48.772492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:48.772492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:48.772492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:48.772492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:48.772492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:48.772492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:48.772492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:48.772492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:48.772492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:48.772492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:48.772492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:48.772492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:48.772492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:48.773447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:48.773447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:48.773447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:48.773447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:48.773447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:48.773447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:48.773447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:48.773447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:48.773447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:48.773447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:48.773447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:48.773447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:48.773447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:48.773447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:48.773447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:48.773447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:48.774287 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:48.774287 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:48.774287 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:48.774287 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:48.774287 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:48.774287 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:48.774287 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:48.774287 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:48.774287 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:48.774287 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:48.774287 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:48.774287 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:48.774974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-133b2b9e-edfe-48f5-892f-62e093ff2a32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:48.774974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:48.774974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:48.774974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:48.774974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:48.774974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:48.774974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:48.774974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:48.774974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:48.774974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:48.774974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:48.774974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:48.774974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:48.774974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:48.774974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:48.774974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:48.776570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:48.776570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:48.776570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:48.776570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:48.776570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:48.776570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:48.776570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:48.776570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:48.776570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:48.776570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:48.776570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:48.776570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:48.776570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:48.776570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:48.776570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:48.776570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:48.777769 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:48.777769 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:48.777769 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:48.777769 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:48.777769 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:48.777769 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:48.777769 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:48.777769 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:48.777769 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:48.777769 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:48.777769 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:48.777769 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:48.777769 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 301/631] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 13:26:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:48.777769 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b2b9e-edfe-48f5-892f-62e093ff2a32 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:48.779425 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 331/632] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 13:26:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:48.781016 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f649b2a-e682-48d3-b69a-0c678538c2ad None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:48.781372 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f649b2a-e682-48d3-b69a-0c678538c2ad None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:48.781718 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f649b2a-e682-48d3-b69a-0c678538c2ad None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:48.786705 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 332/633] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:48.787770 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f649b2a-e682-48d3-b69a-0c678538c2ad None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:48.893651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f649b2a-e682-48d3-b69a-0c678538c2ad None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:48.898453 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b2b9e-edfe-48f5-892f-62e093ff2a32 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:48.928231 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1be06c-982d-402d-a04d-e4dde555dd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:48.928914 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1be06c-982d-402d-a04d-e4dde555dd22 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:48.929191 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1be06c-982d-402d-a04d-e4dde555dd22 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:48.929462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1be06c-982d-402d-a04d-e4dde555dd22 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:48.930214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1be06c-982d-402d-a04d-e4dde555dd22 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:48.930513 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1be06c-982d-402d-a04d-e4dde555dd22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:48.931935 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1be06c-982d-402d-a04d-e4dde555dd22 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:48.935096 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4b1af-2467-457d-a535-ea92cb8ba317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:48.936145 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4b1af-2467-457d-a535-ea92cb8ba317 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:48.936736 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4b1af-2467-457d-a535-ea92cb8ba317 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:48.937146 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4b1af-2467-457d-a535-ea92cb8ba317 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:48.942623 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 333/634] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 13:26:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:48.942623 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1be06c-982d-402d-a04d-e4dde555dd22 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:48.949239 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4b1af-2467-457d-a535-ea92cb8ba317 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:48.951055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4b1af-2467-457d-a535-ea92cb8ba317 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:48.967193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-f2e4b1af-2467-457d-a535-ea92cb8ba317 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:26:48.967193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:48.967193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:48.967193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:48.967193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:48.967193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:48.967193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:48.967193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:48.967193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:48.967193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:48.967193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:48.967193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:48.967193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:26:48.967193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:26:48.967193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:26:48.967193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:26:48.968136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:48.968136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:48.968136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:26:48.968136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:48.968136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:26:48.968136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:48.968136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:48.968136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:48.968136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:48.968136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:48.968136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:48.968136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:48.968136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:48.968136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:48.968136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:48.968136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:48.968136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:48.968136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:48.969045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:48.969045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:48.969045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:26:48.969045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:26:48.969045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:26:48.969045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:26:48.969045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:26:48.969045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:26:48.969045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:26:48.969045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:48.969045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 302/635] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 2 13:26:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:48.969617 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa2be3-f320-4c0f-908e-e07b835f9c20 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:48.970209 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa2be3-f320-4c0f-908e-e07b835f9c20 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:48.970209 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa2be3-f320-4c0f-908e-e07b835f9c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:48.987729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-daaa2be3-f320-4c0f-908e-e07b835f9c20 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:48.988897 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-daaa2be3-f320-4c0f-908e-e07b835f9c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:49.006455 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:49.022189 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:49.052555 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1be06c-982d-402d-a04d-e4dde555dd22 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:49.074698 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 303/636] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:49.075899 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa2be3-f320-4c0f-908e-e07b835f9c20 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:49.100971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80e438-873d-42cb-b726-b966b95d900f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:49.101656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80e438-873d-42cb-b726-b966b95d900f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:49.101933 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80e438-873d-42cb-b726-b966b95d900f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:49.102200 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80e438-873d-42cb-b726-b966b95d900f None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:49.102979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80e438-873d-42cb-b726-b966b95d900f None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:49.103283 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80e438-873d-42cb-b726-b966b95d900f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:49.104646 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80e438-873d-42cb-b726-b966b95d900f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:49.113266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 334/637] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 13:26:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:49.114084 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80e438-873d-42cb-b726-b966b95d900f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:49.180052 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa2be3-f320-4c0f-908e-e07b835f9c20 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:49.216465 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cd43b-31c7-4036-a8b5-19f896d7463b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:49.217645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cd43b-31c7-4036-a8b5-19f896d7463b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:49.218092 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80e438-873d-42cb-b726-b966b95d900f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:49.218278 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cd43b-31c7-4036-a8b5-19f896d7463b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:49.218755 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cd43b-31c7-4036-a8b5-19f896d7463b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:49.229614 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cd43b-31c7-4036-a8b5-19f896d7463b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:49.231583 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cd43b-31c7-4036-a8b5-19f896d7463b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:49.234823 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:49.251487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-275cd43b-31c7-4036-a8b5-19f896d7463b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:49.251487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:49.251487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:49.251487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:49.251487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:49.251487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:49.251487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:49.251487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:49.251487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:49.251487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:49.251487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:49.251487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:49.251487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:49.251487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:49.251487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:49.252447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:49.252447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:49.252447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:49.252447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:49.252447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:49.252447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:49.252447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:49.252447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:49.252447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:49.252447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:49.252447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:49.252447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:49.252447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:49.252447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:49.252447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:49.252447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:49.252447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:49.254006 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:49.254006 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:49.254006 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:49.254006 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:49.254242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af4d13-cb91-488e-a500-b199e9ad5007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:49.254242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af4d13-cb91-488e-a500-b199e9ad5007 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:49.254386 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 304/638] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:49.254386 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cd43b-31c7-4036-a8b5-19f896d7463b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:49.257244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af4d13-cb91-488e-a500-b199e9ad5007 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:49.257542 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af4d13-cb91-488e-a500-b199e9ad5007 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:49.258403 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af4d13-cb91-488e-a500-b199e9ad5007 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:49.258741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af4d13-cb91-488e-a500-b199e9ad5007 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:49.260179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af4d13-cb91-488e-a500-b199e9ad5007 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:49.274355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:49.280511 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 335/639] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 2 13:26:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:49.281341 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af4d13-cb91-488e-a500-b199e9ad5007 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:49.367648 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cd43b-31c7-4036-a8b5-19f896d7463b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:49.388183 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af4d13-cb91-488e-a500-b199e9ad5007 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:49.403432 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb1ccb-0159-42e4-a09e-c28b10c611f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:49.404576 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb1ccb-0159-42e4-a09e-c28b10c611f9 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:49.404910 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb1ccb-0159-42e4-a09e-c28b10c611f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:49.405187 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb1ccb-0159-42e4-a09e-c28b10c611f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:49.417696 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb1ccb-0159-42e4-a09e-c28b10c611f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:49.425827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ef5e6-07dc-4921-9114-8383c04e38f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:49.425965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-71fb1ccb-0159-42e4-a09e-c28b10c611f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:49.425965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:49.425965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:49.425965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:49.425965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:49.425965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:49.425965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:49.425965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:49.425965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:49.425965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:49.425965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:49.425965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:49.425965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:49.425965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:49.425965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:49.425965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:49.426887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:49.426887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:49.426887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:49.426887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:49.426887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:49.426887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:49.426887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:49.426887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:49.426887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:49.426887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:49.426887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:49.426887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:49.426887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:49.426887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:49.426887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:49.426887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:49.432905 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:49.432905 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:49.432905 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:49.432905 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:49.432905 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:49.432905 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:49.432905 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:49.432905 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:49.432905 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:49.432905 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:49.432905 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:49.432905 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:49.433557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ef5e6-07dc-4921-9114-8383c04e38f3 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:49.433557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ef5e6-07dc-4921-9114-8383c04e38f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:49.433557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ef5e6-07dc-4921-9114-8383c04e38f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:49.433745 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 305/640] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 13:26:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:49.433745 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb1ccb-0159-42e4-a09e-c28b10c611f9 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:49.444536 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ef5e6-07dc-4921-9114-8383c04e38f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:49.446091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ef5e6-07dc-4921-9114-8383c04e38f3 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:49.464643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-9f9ef5e6-07dc-4921-9114-8383c04e38f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:49.464643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:49.464643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:49.464643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:49.464643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:49.464643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:49.464643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:49.464643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:49.464643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:49.464643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:49.464643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:49.464643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:49.464643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:49.464643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:49.464643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:49.465956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:49.465956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:49.465956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:49.465956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:49.465956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:49.465956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:49.465956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:49.465956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:49.465956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:49.465956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:49.465956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:49.465956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:49.465956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:49.465956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:49.465956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:49.465956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:49.465956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:49.467298 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:49.467298 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:49.467298 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:49.467298 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:49.467298 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 336/641] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:49.467298 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ef5e6-07dc-4921-9114-8383c04e38f3 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:49.497338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:49.525984 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:49.548802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb1ccb-0159-42e4-a09e-c28b10c611f9 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:49.575320 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ef5e6-07dc-4921-9114-8383c04e38f3 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:49.583973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e8197-af36-4643-bb2c-b73d7e4c4ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:49.584642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e8197-af36-4643-bb2c-b73d7e4c4ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:49.584919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e8197-af36-4643-bb2c-b73d7e4c4ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:49.585189 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e8197-af36-4643-bb2c-b73d7e4c4ae4 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:49.585906 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e8197-af36-4643-bb2c-b73d7e4c4ae4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:49.586208 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e8197-af36-4643-bb2c-b73d7e4c4ae4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:49.587609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e8197-af36-4643-bb2c-b73d7e4c4ae4 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:49.600156 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 306/642] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:49.605044 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e8197-af36-4643-bb2c-b73d7e4c4ae4 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:49.612150 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd1852-d74a-4a19-9737-262372bee86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:49.612885 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1852-d74a-4a19-9737-262372bee86c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:49.613228 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1852-d74a-4a19-9737-262372bee86c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:49.613589 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1852-d74a-4a19-9737-262372bee86c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:49.681816 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd1852-d74a-4a19-9737-262372bee86c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:49.683390 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd1852-d74a-4a19-9737-262372bee86c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:49.711547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:49.717266 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e8197-af36-4643-bb2c-b73d7e4c4ae4 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:49.752744 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680aba7-9031-4ca7-b1df-1009bb02c93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:49.753337 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680aba7-9031-4ca7-b1df-1009bb02c93e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:49.753618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680aba7-9031-4ca7-b1df-1009bb02c93e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:49.753874 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680aba7-9031-4ca7-b1df-1009bb02c93e None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:49.754701 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680aba7-9031-4ca7-b1df-1009bb02c93e None admin] RBAC: Adding query filter params (name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:49.755013 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680aba7-9031-4ca7-b1df-1009bb02c93e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:49.756459 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680aba7-9031-4ca7-b1df-1009bb02c93e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:49.761895 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:49.771037 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 307/643] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 13:26:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:49.772182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680aba7-9031-4ca7-b1df-1009bb02c93e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:49.791892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 337/644] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:49.791892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd1852-d74a-4a19-9737-262372bee86c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:49.880952 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680aba7-9031-4ca7-b1df-1009bb02c93e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:49.887560 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd1852-d74a-4a19-9737-262372bee86c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:49.914800 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:49.915710 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393c429-4345-43db-a7d2-db66071f35dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:49.916445 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393c429-4345-43db-a7d2-db66071f35dc None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:49.916876 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393c429-4345-43db-a7d2-db66071f35dc None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:49.917175 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393c429-4345-43db-a7d2-db66071f35dc None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:49.917934 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393c429-4345-43db-a7d2-db66071f35dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:49.918236 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393c429-4345-43db-a7d2-db66071f35dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:49.920060 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393c429-4345-43db-a7d2-db66071f35dc None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:49.924835 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baefbef-b183-4457-84ee-c5f1df446223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:49.925647 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baefbef-b183-4457-84ee-c5f1df446223 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:49.925919 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baefbef-b183-4457-84ee-c5f1df446223 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:49.926185 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baefbef-b183-4457-84ee-c5f1df446223 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:49.932058 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 308/645] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:49.934186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baefbef-b183-4457-84ee-c5f1df446223 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:49.935507 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393c429-4345-43db-a7d2-db66071f35dc None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:49.935689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baefbef-b183-4457-84ee-c5f1df446223 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:49.951086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-9baefbef-b183-4457-84ee-c5f1df446223 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:26:49.951086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:49.951086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:49.951086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:49.951086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:49.951086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:49.951086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:49.951086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:49.951086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:49.951086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:49.951086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:49.951086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:49.951086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:26:49.951086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:26:49.951086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:26:49.951086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:26:49.952053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:49.952053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:49.952053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:26:49.952053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:49.952053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:26:49.952053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:49.952053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:49.952053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:49.952053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:49.952053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:49.952053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:49.952053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:49.952053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:49.952053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:49.952053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:49.952053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:49.952053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:49.952053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:49.953149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:49.953149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:49.953149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:26:49.953149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:26:49.953149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:26:49.953149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:26:49.953149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:26:49.953149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:26:49.953149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:26:49.953149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:49.953149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 338/646] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:49.953149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baefbef-b183-4457-84ee-c5f1df446223 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:50.000143 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:50.047276 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393c429-4345-43db-a7d2-db66071f35dc None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:50.066178 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baefbef-b183-4457-84ee-c5f1df446223 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:50.081999 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce80faf-0e12-4d09-98bf-b4f88ecb4514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:50.082839 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce80faf-0e12-4d09-98bf-b4f88ecb4514 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:50.083113 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce80faf-0e12-4d09-98bf-b4f88ecb4514 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:50.083375 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce80faf-0e12-4d09-98bf-b4f88ecb4514 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:50.094016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce80faf-0e12-4d09-98bf-b4f88ecb4514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:50.095515 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce80faf-0e12-4d09-98bf-b4f88ecb4514 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:50.103307 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee621935-5d12-42fb-94f9-99b7dc90f564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:50.104332 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee621935-5d12-42fb-94f9-99b7dc90f564 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:50.104784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee621935-5d12-42fb-94f9-99b7dc90f564 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:50.105226 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee621935-5d12-42fb-94f9-99b7dc90f564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:50.113920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-6ce80faf-0e12-4d09-98bf-b4f88ecb4514 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:50.113920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:50.113920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:50.113920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:50.113920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:50.113920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:50.113920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:50.113920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:50.113920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:50.113920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:50.113920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:50.113920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:50.113920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:50.113920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:50.113920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:50.114847 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:50.114847 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:50.114847 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:50.114847 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:50.114847 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:50.114847 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:50.114847 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:50.114847 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:50.114847 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:50.114847 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:50.114847 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:50.114847 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:50.114847 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:50.114847 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:50.114847 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:50.114847 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:50.114847 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:50.120730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:50.120730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:50.120730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:50.120730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:50.120730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 309/647] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:50.120730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce80faf-0e12-4d09-98bf-b4f88ecb4514 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:50.121075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee621935-5d12-42fb-94f9-99b7dc90f564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:50.121671 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee621935-5d12-42fb-94f9-99b7dc90f564 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:50.147049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-ee621935-5d12-42fb-94f9-99b7dc90f564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:50.147049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:50.147049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:50.147049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:50.147049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:50.147049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:50.147049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:50.147049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:50.147049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:50.147049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:50.147049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:50.147049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:50.147049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:50.147049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:50.147049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:50.147989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:50.147989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:50.147989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:50.147989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:50.147989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:50.147989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:50.147989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:50.147989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:50.147989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:50.147989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:50.147989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:50.147989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:50.147989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:50.147989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:50.147989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:50.147989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:50.147989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:50.148884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:50.148884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:50.148884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:50.148884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:50.148884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 339/648] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:50.149161 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee621935-5d12-42fb-94f9-99b7dc90f564 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:50.196721 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:50.249719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce80faf-0e12-4d09-98bf-b4f88ecb4514 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:50.261791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee621935-5d12-42fb-94f9-99b7dc90f564 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:50.265989 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:50.287572 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d101e7-d5fe-4b4c-88dd-b16798a37452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:50.288424 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d101e7-d5fe-4b4c-88dd-b16798a37452 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:50.288668 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d101e7-d5fe-4b4c-88dd-b16798a37452 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:50.288937 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d101e7-d5fe-4b4c-88dd-b16798a37452 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:50.296902 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d101e7-d5fe-4b4c-88dd-b16798a37452 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:50.298384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d101e7-d5fe-4b4c-88dd-b16798a37452 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:50.305974 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510c0bb-25ae-4cdf-ab1a-eccf8a5c28d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:50.307292 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510c0bb-25ae-4cdf-ab1a-eccf8a5c28d6 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:50.307576 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510c0bb-25ae-4cdf-ab1a-eccf8a5c28d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:50.307854 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510c0bb-25ae-4cdf-ab1a-eccf8a5c28d6 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:50.308711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510c0bb-25ae-4cdf-ab1a-eccf8a5c28d6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:50.309019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510c0bb-25ae-4cdf-ab1a-eccf8a5c28d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:50.310798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510c0bb-25ae-4cdf-ab1a-eccf8a5c28d6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:50.312511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-f3d101e7-d5fe-4b4c-88dd-b16798a37452 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:26:50.312511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:50.312511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:50.312511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:50.312511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:50.312511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:50.312511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:50.312511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:50.312511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:50.312511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:50.312511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:50.312511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:50.312511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:26:50.312511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:26:50.312511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:26:50.312511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:26:50.313394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:50.313394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:50.313394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:26:50.313394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:50.313394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:26:50.313394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:50.313394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:50.313394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:50.313394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:50.313394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:50.313394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:50.313394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:50.313394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:50.313394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:50.313394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:50.313394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:50.313394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:50.313394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:50.319287 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:50.319287 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:50.319287 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:26:50.319287 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:26:50.319287 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:26:50.319287 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:26:50.319287 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:26:50.319287 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:26:50.319287 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:26:50.319287 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:50.319287 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 310/649] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:50.319287 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d101e7-d5fe-4b4c-88dd-b16798a37452 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:50.329462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 340/650] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Jun 2 13:26:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:50.330330 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510c0bb-25ae-4cdf-ab1a-eccf8a5c28d6 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:50.423631 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d101e7-d5fe-4b4c-88dd-b16798a37452 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:50.439597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:50.444654 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510c0bb-25ae-4cdf-ab1a-eccf8a5c28d6 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:50.465946 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8f8b7-10b6-417e-a1f8-58d40069be62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:50.467035 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8f8b7-10b6-417e-a1f8-58d40069be62 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:50.467508 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8f8b7-10b6-417e-a1f8-58d40069be62 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:50.468002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8f8b7-10b6-417e-a1f8-58d40069be62 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:50.469231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8f8b7-10b6-417e-a1f8-58d40069be62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:50.469724 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8f8b7-10b6-417e-a1f8-58d40069be62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:50.472049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8f8b7-10b6-417e-a1f8-58d40069be62 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:50.484689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc069cd-1b10-4652-b530-5d99e163622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:50.485668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc069cd-1b10-4652-b530-5d99e163622d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:50.486147 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc069cd-1b10-4652-b530-5d99e163622d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:50.486612 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc069cd-1b10-4652-b530-5d99e163622d None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:50.487187 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 311/651] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:50.487702 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc069cd-1b10-4652-b530-5d99e163622d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:50.488057 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8f8b7-10b6-417e-a1f8-58d40069be62 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:50.488360 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc069cd-1b10-4652-b530-5d99e163622d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:50.490050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc069cd-1b10-4652-b530-5d99e163622d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:50.504713 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 341/652] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:50.505717 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc069cd-1b10-4652-b530-5d99e163622d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:50.530719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:50.604465 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8f8b7-10b6-417e-a1f8-58d40069be62 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:50.620340 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc069cd-1b10-4652-b530-5d99e163622d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:50.643464 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe7d3a-2556-4792-aefe-7eaa2a62b039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:50.644153 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe7d3a-2556-4792-aefe-7eaa2a62b039 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:50.644433 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe7d3a-2556-4792-aefe-7eaa2a62b039 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:50.644695 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe7d3a-2556-4792-aefe-7eaa2a62b039 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:50.645528 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe7d3a-2556-4792-aefe-7eaa2a62b039 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:50.645818 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe7d3a-2556-4792-aefe-7eaa2a62b039 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:50.647261 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe7d3a-2556-4792-aefe-7eaa2a62b039 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:50.657487 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b12635-4d71-4b7d-889b-00447d0fcdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:50.658253 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b12635-4d71-4b7d-889b-00447d0fcdc9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:50.658531 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b12635-4d71-4b7d-889b-00447d0fcdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:50.658900 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b12635-4d71-4b7d-889b-00447d0fcdc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:50.664750 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 312/653] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Jun 2 13:26:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:50.665567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe7d3a-2556-4792-aefe-7eaa2a62b039 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:50.685465 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:50.726726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b12635-4d71-4b7d-889b-00447d0fcdc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:50.728316 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b12635-4d71-4b7d-889b-00447d0fcdc9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:50.753839 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:50.765352 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe7d3a-2556-4792-aefe-7eaa2a62b039 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:50.799194 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7f852-f1ca-4d7d-af0d-6528dc427465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:50.800124 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7f852-f1ca-4d7d-af0d-6528dc427465 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:50.800403 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7f852-f1ca-4d7d-af0d-6528dc427465 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:50.800671 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7f852-f1ca-4d7d-af0d-6528dc427465 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:50.807580 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7f852-f1ca-4d7d-af0d-6528dc427465 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:50.809019 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7f852-f1ca-4d7d-af0d-6528dc427465 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:50.823596 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-09f7f852-f1ca-4d7d-af0d-6528dc427465 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:26:50.823596 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:50.823596 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:50.823596 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:50.823596 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:50.823596 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:50.823596 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:50.823596 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:50.823596 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:50.823596 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:50.823596 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:50.823596 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:50.823596 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:26:50.823596 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:26:50.823596 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:26:50.823596 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:26:50.824585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:50.824585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:50.824585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:26:50.824585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:50.824585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:26:50.824585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:50.824585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:50.824585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:50.824585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:50.824585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:50.824585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:50.824585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:50.824585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:50.824585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:50.824585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:50.824585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:50.824585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:50.824585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:50.825613 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:50.825613 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:50.825613 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:26:50.825613 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:26:50.825613 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:26:50.825613 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:26:50.825613 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:26:50.825613 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:26:50.825613 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:26:50.825613 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:50.825613 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 313/654] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 13:26:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:50.825613 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7f852-f1ca-4d7d-af0d-6528dc427465 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:50.834101 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 342/655] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:50.835475 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c4d1d-891e-4671-b887-f5aa1177985b None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:50.835761 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c4d1d-891e-4671-b887-f5aa1177985b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:50.836031 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c4d1d-891e-4671-b887-f5aa1177985b None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:50.837311 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 343/656] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:50.838004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c4d1d-891e-4671-b887-f5aa1177985b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:50.897450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:50.931704 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7f852-f1ca-4d7d-af0d-6528dc427465 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:50.939746 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c4d1d-891e-4671-b887-f5aa1177985b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:50.966414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d373466-3bf7-44e1-a278-4046cd7419e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:50.967258 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d373466-3bf7-44e1-a278-4046cd7419e2 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:50.967535 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d373466-3bf7-44e1-a278-4046cd7419e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:50.967804 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d373466-3bf7-44e1-a278-4046cd7419e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:50.973288 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61021ff-96d8-443d-8a81-43636302c96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:50.973940 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61021ff-96d8-443d-8a81-43636302c96d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:50.974213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61021ff-96d8-443d-8a81-43636302c96d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:50.974477 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61021ff-96d8-443d-8a81-43636302c96d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:50.974923 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d373466-3bf7-44e1-a278-4046cd7419e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:50.976380 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d373466-3bf7-44e1-a278-4046cd7419e2 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:50.992742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-3d373466-3bf7-44e1-a278-4046cd7419e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:50.992742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:50.992742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:50.992742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:50.992742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:50.992742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:50.992742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:50.992742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:50.992742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:50.992742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:50.992742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:50.992742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:50.992742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:26:50.992742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:26:50.992742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:26:50.993781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:26:50.993781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:50.993781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:50.993781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:50.993781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:50.993781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:50.993781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:50.993781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:50.993781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:50.993781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:50.993781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:50.993781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:50.993781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:50.993781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:50.993781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:50.993781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:50.993781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:50.994907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:26:50.994907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:26:50.994907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:26:50.994907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:26:50.994907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:26:50.994907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:26:50.994907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:50.994907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:50.994907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 314/657] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:50.995646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d373466-3bf7-44e1-a278-4046cd7419e2 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:51.008306 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:51.047296 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61021ff-96d8-443d-8a81-43636302c96d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:51.048760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61021ff-96d8-443d-8a81-43636302c96d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:51.094336 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d373466-3bf7-44e1-a278-4046cd7419e2 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:51.103326 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:51.127891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb411e-10d6-4ca9-9ddd-43e30837ca76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:51.128556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb411e-10d6-4ca9-9ddd-43e30837ca76 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:51.128908 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb411e-10d6-4ca9-9ddd-43e30837ca76 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:51.129184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb411e-10d6-4ca9-9ddd-43e30837ca76 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:51.130008 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb411e-10d6-4ca9-9ddd-43e30837ca76 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:51.130311 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb411e-10d6-4ca9-9ddd-43e30837ca76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:51.131778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb411e-10d6-4ca9-9ddd-43e30837ca76 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:51.144653 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 344/658] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:51.145495 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61021ff-96d8-443d-8a81-43636302c96d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:51.156279 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 315/659] 10.222.0.18 () {56 vars in 1139 bytes} [Thu Jun 2 13:26:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:51.156279 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c3579-5266-409a-881d-334adf6e864c None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:51.156279 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c3579-5266-409a-881d-334adf6e864c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:51.156279 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c3579-5266-409a-881d-334adf6e864c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:51.171452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-333c3579-5266-409a-881d-334adf6e864c None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:51.172619 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-333c3579-5266-409a-881d-334adf6e864c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:51.234326 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:51.240055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 316/660] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:51.241012 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c3579-5266-409a-881d-334adf6e864c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:51.256780 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61021ff-96d8-443d-8a81-43636302c96d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:51.291056 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afc58a-3243-481f-9052-93f01b61dbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:51.291846 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afc58a-3243-481f-9052-93f01b61dbc9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:51.292118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afc58a-3243-481f-9052-93f01b61dbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:51.292382 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afc58a-3243-481f-9052-93f01b61dbc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:51.302232 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afc58a-3243-481f-9052-93f01b61dbc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:51.303694 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afc58a-3243-481f-9052-93f01b61dbc9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:51.320680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-a5afc58a-3243-481f-9052-93f01b61dbc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:51.320680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:51.320680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:51.320680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:51.320680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:51.320680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:51.320680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:51.320680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:51.320680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:51.320680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:51.320680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:51.320680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:51.320680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:51.320680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:51.320680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:51.322119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:51.322119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:51.322119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:51.322119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:51.322119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:51.322119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:51.322119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:51.322119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:51.322119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:51.322119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:51.322119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:51.322119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:51.322119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:51.322119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:51.322119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:51.322119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:51.322119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:51.323056 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:51.323056 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:51.323056 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:51.323056 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:51.326602 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 345/661] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:51.327340 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afc58a-3243-481f-9052-93f01b61dbc9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:51.339368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:51.339917 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c3579-5266-409a-881d-334adf6e864c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:51.374963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6b291-31fa-47bb-a9a9-c6341e1c05f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:51.375632 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6b291-31fa-47bb-a9a9-c6341e1c05f8 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:51.375909 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6b291-31fa-47bb-a9a9-c6341e1c05f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:51.376183 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6b291-31fa-47bb-a9a9-c6341e1c05f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:51.376966 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6b291-31fa-47bb-a9a9-c6341e1c05f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:51.377272 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6b291-31fa-47bb-a9a9-c6341e1c05f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:51.378721 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6b291-31fa-47bb-a9a9-c6341e1c05f8 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:51.390140 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 317/662] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:26:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:51.390963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6b291-31fa-47bb-a9a9-c6341e1c05f8 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:51.429131 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afc58a-3243-481f-9052-93f01b61dbc9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:51.451676 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:51.462278 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf738f-226d-454e-8fb5-1dbf73ffa97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:51.463108 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf738f-226d-454e-8fb5-1dbf73ffa97c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:51.463385 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf738f-226d-454e-8fb5-1dbf73ffa97c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:51.463651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf738f-226d-454e-8fb5-1dbf73ffa97c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:51.473959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf738f-226d-454e-8fb5-1dbf73ffa97c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:51.475430 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf738f-226d-454e-8fb5-1dbf73ffa97c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:51.493025 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-0cbf738f-226d-454e-8fb5-1dbf73ffa97c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:51.493025 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:51.493025 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:51.493025 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:51.493025 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:51.493025 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:51.493025 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:51.493025 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:51.493025 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:51.493025 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:51.493025 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:51.493025 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:51.493025 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:51.493025 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:51.493025 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:51.493939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:51.493939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:51.493939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:51.493939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:51.493939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:51.493939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:51.493939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:51.493939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:51.493939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:51.493939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:51.493939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:51.493939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:51.493939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:51.493939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:51.493939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:51.493939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:51.493939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:51.494986 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:51.494986 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:51.494986 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:51.494986 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:51.495216 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6b291-31fa-47bb-a9a9-c6341e1c05f8 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:51.495291 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 346/663] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:51.495291 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf738f-226d-454e-8fb5-1dbf73ffa97c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:51.528691 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3017bf1-ffaa-4aff-b95b-0ee37fc80f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:51.529377 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3017bf1-ffaa-4aff-b95b-0ee37fc80f6a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:51.529639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3017bf1-ffaa-4aff-b95b-0ee37fc80f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:51.529902 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3017bf1-ffaa-4aff-b95b-0ee37fc80f6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:51.558674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:51.597326 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf738f-226d-454e-8fb5-1dbf73ffa97c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:51.598947 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3017bf1-ffaa-4aff-b95b-0ee37fc80f6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:51.600429 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3017bf1-ffaa-4aff-b95b-0ee37fc80f6a None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:51.634426 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77679f14-3603-4aa7-9d28-f7902292da61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:51.635267 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77679f14-3603-4aa7-9d28-f7902292da61 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:51.635544 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77679f14-3603-4aa7-9d28-f7902292da61 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:51.635815 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77679f14-3603-4aa7-9d28-f7902292da61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:51.647912 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77679f14-3603-4aa7-9d28-f7902292da61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:51.656090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-77679f14-3603-4aa7-9d28-f7902292da61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:51.656090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:51.656090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:51.656090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:51.656090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:51.656090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:51.656090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:51.656090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:51.656090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:51.656090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:51.656090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:51.656090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:51.656090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:51.656090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:51.656090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:51.656090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:51.657032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:51.657032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:51.657032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:51.657032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:51.657032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:51.657032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:51.657032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:51.657032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:51.657032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:51.657032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:51.657032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:51.657032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:51.657032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:51.657032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:51.657032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:51.657032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:51.658121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:51.658121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:51.658121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:51.658121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:51.658121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:51.658121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:51.658121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:51.658121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:51.658121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:51.658121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:51.658121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:51.658121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:51.658121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 347/664] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 13:26:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:51.658121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77679f14-3603-4aa7-9d28-f7902292da61 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:51.662598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:51.706938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 318/665] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:51.707709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3017bf1-ffaa-4aff-b95b-0ee37fc80f6a None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:51.762154 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77679f14-3603-4aa7-9d28-f7902292da61 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:51.785008 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:51.797384 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b2cfd-e0a4-456e-aa21-53aedf8b8d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:51.798050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b2cfd-e0a4-456e-aa21-53aedf8b8d61 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:51.798339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b2cfd-e0a4-456e-aa21-53aedf8b8d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:51.798627 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b2cfd-e0a4-456e-aa21-53aedf8b8d61 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:51.799353 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b2cfd-e0a4-456e-aa21-53aedf8b8d61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:51.799657 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b2cfd-e0a4-456e-aa21-53aedf8b8d61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:51.801044 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b2cfd-e0a4-456e-aa21-53aedf8b8d61 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:51.807268 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3017bf1-ffaa-4aff-b95b-0ee37fc80f6a None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:51.813062 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 348/666] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:51.813869 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b2cfd-e0a4-456e-aa21-53aedf8b8d61 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:51.841609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb84502-1371-4e2e-86d9-a6e484ae4df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:51.842276 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb84502-1371-4e2e-86d9-a6e484ae4df3 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:51.842555 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb84502-1371-4e2e-86d9-a6e484ae4df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:51.842854 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb84502-1371-4e2e-86d9-a6e484ae4df3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:51.843694 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb84502-1371-4e2e-86d9-a6e484ae4df3 None admin] RBAC: Adding query filter params (role.id=9dc761b84aa745ad920c76ddf9fb0b9e, scope.project.id=af45a1ec7c94408bb638c55fb43fa961, user.id=5a0061e2927843cf86769d2beab18743) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:51.844006 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb84502-1371-4e2e-86d9-a6e484ae4df3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:51.845426 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb84502-1371-4e2e-86d9-a6e484ae4df3 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:51.851181 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 319/667] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:26:51 2022] GET /identity/v3/role_assignments?user.id=5a0061e2927843cf86769d2beab18743&scope.project.id=af45a1ec7c94408bb638c55fb43fa961&role.id=9dc761b84aa745ad920c76ddf9fb0b9e => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:51.851953 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb84502-1371-4e2e-86d9-a6e484ae4df3 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:51.886294 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:51.922002 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b2cfd-e0a4-456e-aa21-53aedf8b8d61 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:51.963401 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec33fe4-1781-478d-a02c-621a9f5609eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:51.964242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec33fe4-1781-478d-a02c-621a9f5609eb None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:51.964643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec33fe4-1781-478d-a02c-621a9f5609eb None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:51.965028 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec33fe4-1781-478d-a02c-621a9f5609eb None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:51.966208 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec33fe4-1781-478d-a02c-621a9f5609eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:51.966686 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec33fe4-1781-478d-a02c-621a9f5609eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:51.968794 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec33fe4-1781-478d-a02c-621a9f5609eb None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:51.985694 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 349/668] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:51.986621 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec33fe4-1781-478d-a02c-621a9f5609eb None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:51.999566 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb84502-1371-4e2e-86d9-a6e484ae4df3 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:52.037082 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:52.040861 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fc598-226d-461a-8d85-39921d477340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:52.041563 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fc598-226d-461a-8d85-39921d477340 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:52.041842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fc598-226d-461a-8d85-39921d477340 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:52.042115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fc598-226d-461a-8d85-39921d477340 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:52.042914 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fc598-226d-461a-8d85-39921d477340 None admin] RBAC: Adding query filter params (name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:52.043223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fc598-226d-461a-8d85-39921d477340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:52.044907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fc598-226d-461a-8d85-39921d477340 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:52.055951 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 320/669] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 13:26:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:52.055951 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fc598-226d-461a-8d85-39921d477340 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:52.107622 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec33fe4-1781-478d-a02c-621a9f5609eb None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:52.148563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa8a91-be8a-4aed-bd5b-9d78d5f28e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:52.149578 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa8a91-be8a-4aed-bd5b-9d78d5f28e2b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:52.149857 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa8a91-be8a-4aed-bd5b-9d78d5f28e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:52.150124 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa8a91-be8a-4aed-bd5b-9d78d5f28e2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:52.151650 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:52.161535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa8a91-be8a-4aed-bd5b-9d78d5f28e2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:52.163017 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa8a91-be8a-4aed-bd5b-9d78d5f28e2b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:52.168519 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fc598-226d-461a-8d85-39921d477340 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:52.180785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-d9aa8a91-be8a-4aed-bd5b-9d78d5f28e2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:52.180785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:52.180785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:52.180785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:52.180785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:52.180785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:52.180785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:52.180785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:52.180785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:52.180785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:52.180785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:52.180785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:52.180785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:52.180785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:52.180785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:52.181695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:52.181695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:52.181695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:52.181695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:52.181695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:52.181695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:52.181695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:52.181695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:52.181695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:52.181695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:52.181695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:52.181695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:52.181695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:52.181695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:52.181695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:52.181695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:52.181695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:52.182634 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:52.182634 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:52.182634 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:52.182634 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:52.182634 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 350/670] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:52.182924 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa8a91-be8a-4aed-bd5b-9d78d5f28e2b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:52.207577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ecc9b-732a-4e31-8d8e-7fab54cd52ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:52.208394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ecc9b-732a-4e31-8d8e-7fab54cd52ea None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:52.208677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ecc9b-732a-4e31-8d8e-7fab54cd52ea None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:52.208949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ecc9b-732a-4e31-8d8e-7fab54cd52ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:52.216140 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ecc9b-732a-4e31-8d8e-7fab54cd52ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:52.217544 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ecc9b-732a-4e31-8d8e-7fab54cd52ea None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:52.235255 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-431ecc9b-732a-4e31-8d8e-7fab54cd52ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:52.235255 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:52.235255 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:52.235255 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:52.235255 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:52.235255 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:52.235255 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:52.235255 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:52.235255 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:52.235255 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:52.235255 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:52.235255 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:52.235255 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:26:52.235255 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:26:52.235255 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:26:52.236182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:26:52.236182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:52.236182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:52.236182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:52.236182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:52.236182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:52.236182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:52.236182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:52.236182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:52.236182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:52.236182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:52.236182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:52.236182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:52.236182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:52.236182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:52.236182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:52.236182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:52.237045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:26:52.237045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:26:52.237045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:26:52.237045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:26:52.237045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:26:52.237045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:26:52.237045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:52.237045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:52.237045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 321/671] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:52.237520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ecc9b-732a-4e31-8d8e-7fab54cd52ea None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:52.305001 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:52.313214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa8a91-be8a-4aed-bd5b-9d78d5f28e2b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:52.351445 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b7fcd-3b69-420f-b9d3-a0d4bbff28dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:52.352335 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b7fcd-3b69-420f-b9d3-a0d4bbff28dd None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:52.352531 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b7fcd-3b69-420f-b9d3-a0d4bbff28dd None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:52.352778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b7fcd-3b69-420f-b9d3-a0d4bbff28dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:52.359857 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b7fcd-3b69-420f-b9d3-a0d4bbff28dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:52.361320 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b7fcd-3b69-420f-b9d3-a0d4bbff28dd None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:52.365121 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ecc9b-732a-4e31-8d8e-7fab54cd52ea None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:52.378943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-fb1b7fcd-3b69-420f-b9d3-a0d4bbff28dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:52.378943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:52.378943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:52.378943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:52.378943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:52.378943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:52.378943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:52.378943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:52.378943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:52.378943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:52.378943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:52.378943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:52.378943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:26:52.378943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:26:52.378943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:26:52.379989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:26:52.379989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:52.379989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:52.379989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:52.379989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:52.379989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:52.379989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:52.379989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:52.379989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:52.379989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:52.379989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:52.379989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:52.379989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:52.379989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:52.379989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:52.379989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:52.379989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:52.380878 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:26:52.380878 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:26:52.380878 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:26:52.380878 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:26:52.380878 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:26:52.380878 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:26:52.380878 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:52.380878 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:52.380878 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 351/672] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:52.381359 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b7fcd-3b69-420f-b9d3-a0d4bbff28dd None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:52.408213 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23570d4-e8a6-4e4e-b68c-70cc055d5bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:52.409067 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23570d4-e8a6-4e4e-b68c-70cc055d5bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:52.409462 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23570d4-e8a6-4e4e-b68c-70cc055d5bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:52.409632 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23570d4-e8a6-4e4e-b68c-70cc055d5bf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:52.421305 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23570d4-e8a6-4e4e-b68c-70cc055d5bf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:52.422841 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23570d4-e8a6-4e4e-b68c-70cc055d5bf8 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:52.425796 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:52.442666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-c23570d4-e8a6-4e4e-b68c-70cc055d5bf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:52.442666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:52.442666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:52.442666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:52.442666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:52.442666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:52.442666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:52.442666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:52.442666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:52.442666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:52.442666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:52.442666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:52.442666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:52.442666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:52.442666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:52.443602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:52.443602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:52.443602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:52.443602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:52.443602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:52.443602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:52.443602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:52.443602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:52.443602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:52.443602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:52.443602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:52.443602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:52.443602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:52.443602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:52.443602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:52.443602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:52.443602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:52.444500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:52.444500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:52.444500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:52.444500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:52.444500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 322/673] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:52.444780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23570d4-e8a6-4e4e-b68c-70cc055d5bf8 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:52.495895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b7fcd-3b69-420f-b9d3-a0d4bbff28dd None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:52.533445 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932d960-d0ee-4d1a-82b6-b504f38d4444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:52.534112 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932d960-d0ee-4d1a-82b6-b504f38d4444 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:52.534395 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932d960-d0ee-4d1a-82b6-b504f38d4444 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:52.534716 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932d960-d0ee-4d1a-82b6-b504f38d4444 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:52.535441 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c932d960-d0ee-4d1a-82b6-b504f38d4444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:52.535743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c932d960-d0ee-4d1a-82b6-b504f38d4444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:52.537133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c932d960-d0ee-4d1a-82b6-b504f38d4444 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:52.548980 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 352/674] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:52.549792 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932d960-d0ee-4d1a-82b6-b504f38d4444 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:52.558384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23570d4-e8a6-4e4e-b68c-70cc055d5bf8 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:52.568021 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:52.594903 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769b2be-b1f2-4538-88ef-1f2bbda567fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:52.595572 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769b2be-b1f2-4538-88ef-1f2bbda567fb None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:52.595849 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769b2be-b1f2-4538-88ef-1f2bbda567fb None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:52.596126 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769b2be-b1f2-4538-88ef-1f2bbda567fb None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:52.596917 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769b2be-b1f2-4538-88ef-1f2bbda567fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:52.597229 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769b2be-b1f2-4538-88ef-1f2bbda567fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:52.598672 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769b2be-b1f2-4538-88ef-1f2bbda567fb None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:52.611225 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 323/675] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:26:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:52.611844 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769b2be-b1f2-4538-88ef-1f2bbda567fb None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:52.669819 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932d960-d0ee-4d1a-82b6-b504f38d4444 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:52.688023 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:52.707168 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ae2a5-6014-4e32-ad57-2f120c2218a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:52.708640 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ae2a5-6014-4e32-ad57-2f120c2218a6 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:52.709146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ae2a5-6014-4e32-ad57-2f120c2218a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:52.709593 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ae2a5-6014-4e32-ad57-2f120c2218a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:52.710964 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ae2a5-6014-4e32-ad57-2f120c2218a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:52.711779 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ae2a5-6014-4e32-ad57-2f120c2218a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:52.713398 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ae2a5-6014-4e32-ad57-2f120c2218a6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:52.726481 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 353/676] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:26:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:52.727687 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ae2a5-6014-4e32-ad57-2f120c2218a6 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:52.738941 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769b2be-b1f2-4538-88ef-1f2bbda567fb None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:52.773634 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6306d-56cd-486f-afb4-60e59d128da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:52.774232 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6306d-56cd-486f-afb4-60e59d128da2 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:52.774511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6306d-56cd-486f-afb4-60e59d128da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:52.774815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6306d-56cd-486f-afb4-60e59d128da2 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:52.775539 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6306d-56cd-486f-afb4-60e59d128da2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:52.775845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6306d-56cd-486f-afb4-60e59d128da2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:52.777207 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6306d-56cd-486f-afb4-60e59d128da2 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:52.788702 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 324/677] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:52.789496 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6306d-56cd-486f-afb4-60e59d128da2 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:52.814114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:52.841136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ae2a5-6014-4e32-ad57-2f120c2218a6 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:52.875754 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0495729-1fa4-44d5-9249-d5a44f52cdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:52.876549 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0495729-1fa4-44d5-9249-d5a44f52cdc3 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:52.876828 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0495729-1fa4-44d5-9249-d5a44f52cdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:52.877097 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0495729-1fa4-44d5-9249-d5a44f52cdc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:52.883756 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0495729-1fa4-44d5-9249-d5a44f52cdc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:52.885193 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0495729-1fa4-44d5-9249-d5a44f52cdc3 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:52.895547 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6306d-56cd-486f-afb4-60e59d128da2 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:52.898876 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-e0495729-1fa4-44d5-9249-d5a44f52cdc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:52.898876 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:52.898876 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:52.898876 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:52.898876 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:52.898876 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:52.898876 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:52.898876 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:52.898876 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:52.898876 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:52.898876 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:52.898876 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:52.898876 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:26:52.898876 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:26:52.898876 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:26:52.899768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:26:52.899768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:52.899768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:52.899768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:52.899768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:52.899768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:52.899768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:52.899768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:52.899768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:52.899768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:52.899768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:52.899768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:52.899768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:52.899768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:52.899768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:52.899768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:52.899768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:52.900660 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:26:52.900660 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:26:52.900660 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:26:52.900660 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:26:52.900660 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:26:52.900660 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:26:52.900660 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:52.900660 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:52.900660 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 354/678] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:52.901565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0495729-1fa4-44d5-9249-d5a44f52cdc3 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:52.917735 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:52.941155 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900fda1-4df2-4786-9a80-f48ef98a250d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:52.941817 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900fda1-4df2-4786-9a80-f48ef98a250d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:52.942096 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900fda1-4df2-4786-9a80-f48ef98a250d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:52.942366 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900fda1-4df2-4786-9a80-f48ef98a250d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:52.943223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900fda1-4df2-4786-9a80-f48ef98a250d None admin] RBAC: Adding query filter params (role.id=9dc761b84aa745ad920c76ddf9fb0b9e, scope.project.id=af45a1ec7c94408bb638c55fb43fa961, user.id=58b2f0101284461398a95538466002bd) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:52.943536 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900fda1-4df2-4786-9a80-f48ef98a250d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:52.944955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900fda1-4df2-4786-9a80-f48ef98a250d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:52.951436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 325/679] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:26:52 2022] GET /identity/v3/role_assignments?user.id=58b2f0101284461398a95538466002bd&scope.project.id=af45a1ec7c94408bb638c55fb43fa961&role.id=9dc761b84aa745ad920c76ddf9fb0b9e => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:52.952625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900fda1-4df2-4786-9a80-f48ef98a250d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:53.017095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0495729-1fa4-44d5-9249-d5a44f52cdc3 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:53.059011 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab8b6b-31a7-43ca-a5a3-31ebc32cc264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:53.059694 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab8b6b-31a7-43ca-a5a3-31ebc32cc264 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:53.059971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab8b6b-31a7-43ca-a5a3-31ebc32cc264 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:53.060238 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab8b6b-31a7-43ca-a5a3-31ebc32cc264 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:53.061197 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab8b6b-31a7-43ca-a5a3-31ebc32cc264 None admin] RBAC: Adding query filter params (role.id=9dc761b84aa745ad920c76ddf9fb0b9e, scope.project.id=af45a1ec7c94408bb638c55fb43fa961, user.id=22df4e0d98e34758963d3b1465a3a377) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:53.061506 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab8b6b-31a7-43ca-a5a3-31ebc32cc264 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:53.063117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab8b6b-31a7-43ca-a5a3-31ebc32cc264 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:53.065529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:53.079409 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 355/680] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:26:52 2022] GET /identity/v3/role_assignments?user.id=22df4e0d98e34758963d3b1465a3a377&scope.project.id=af45a1ec7c94408bb638c55fb43fa961&role.id=9dc761b84aa745ad920c76ddf9fb0b9e => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:53.080169 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab8b6b-31a7-43ca-a5a3-31ebc32cc264 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:53.095880 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900fda1-4df2-4786-9a80-f48ef98a250d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:53.142359 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc696070-195b-4e07-827d-4b4d343224da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:53.144333 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc696070-195b-4e07-827d-4b4d343224da None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:53.144863 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc696070-195b-4e07-827d-4b4d343224da None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:53.145477 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc696070-195b-4e07-827d-4b4d343224da None admin] PATH_INFO: `/v3/users/swift` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:53.157231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc696070-195b-4e07-827d-4b4d343224da None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:53.159304 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc696070-195b-4e07-827d-4b4d343224da None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:53.177227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-cc696070-195b-4e07-827d-4b4d343224da None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:26:53.177227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:53.177227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:53.177227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:53.177227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:53.177227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:53.177227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:53.177227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:53.177227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:53.177227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:53.177227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:53.177227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:53.177227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:26:53.177227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:26:53.177227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:26:53.177227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:26:53.178285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:53.178285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:53.178285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:26:53.178285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:53.178285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:26:53.178285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:53.178285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:53.178285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:53.178285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:53.178285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:53.178285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:53.178285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:53.178285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:53.178285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:53.178285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:53.178285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:53.178285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:53.178285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:53.179732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:53.179732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:53.179732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:26:53.179732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:26:53.179732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:26:53.179732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:26:53.179732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:26:53.179732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:26:53.179732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:26:53.179732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:53.183568 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 326/681] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:26:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:53.195753 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc696070-195b-4e07-827d-4b4d343224da None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:53.256718 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:53.273036 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab8b6b-31a7-43ca-a5a3-31ebc32cc264 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:53.319288 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cb407-2a90-4966-a096-4000598f926e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:53.320456 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cb407-2a90-4966-a096-4000598f926e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:53.320834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cb407-2a90-4966-a096-4000598f926e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:53.321204 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cb407-2a90-4966-a096-4000598f926e None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:53.322137 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cb407-2a90-4966-a096-4000598f926e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:53.322544 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cb407-2a90-4966-a096-4000598f926e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:53.324825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cb407-2a90-4966-a096-4000598f926e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:53.338653 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc696070-195b-4e07-827d-4b4d343224da None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:53.344332 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 356/682] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:26:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:53.359484 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cb407-2a90-4966-a096-4000598f926e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:53.386301 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cd79b-79e1-46dc-993b-2cbee90b55ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:53.387333 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cd79b-79e1-46dc-993b-2cbee90b55ab None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:53.387946 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cd79b-79e1-46dc-993b-2cbee90b55ab None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:53.388382 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cd79b-79e1-46dc-993b-2cbee90b55ab None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:53.389487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cd79b-79e1-46dc-993b-2cbee90b55ab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:53.390061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cd79b-79e1-46dc-993b-2cbee90b55ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:53.391654 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cd79b-79e1-46dc-993b-2cbee90b55ab None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:53.411801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 327/683] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Jun 2 13:26:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:53.417585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cd79b-79e1-46dc-993b-2cbee90b55ab None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:53.435026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:53.484606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cb407-2a90-4966-a096-4000598f926e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:53.532531 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3a9e9-6f7a-4442-bc43-9972ec8fc861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:53.533212 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3a9e9-6f7a-4442-bc43-9972ec8fc861 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:53.533490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3a9e9-6f7a-4442-bc43-9972ec8fc861 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:53.533856 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3a9e9-6f7a-4442-bc43-9972ec8fc861 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:53.535063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3a9e9-6f7a-4442-bc43-9972ec8fc861 None admin] RBAC: Adding query filter params (role.id=9dc761b84aa745ad920c76ddf9fb0b9e, scope.project.id=af45a1ec7c94408bb638c55fb43fa961, user.id=a072e8e01bc64c9b92579bb8f1d513a4) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:53.535425 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3a9e9-6f7a-4442-bc43-9972ec8fc861 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:53.536418 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:53.537869 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3a9e9-6f7a-4442-bc43-9972ec8fc861 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:53.543050 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cd79b-79e1-46dc-993b-2cbee90b55ab None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:53.547414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 357/684] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:26:53 2022] GET /identity/v3/role_assignments?user.id=a072e8e01bc64c9b92579bb8f1d513a4&scope.project.id=af45a1ec7c94408bb638c55fb43fa961&role.id=9dc761b84aa745ad920c76ddf9fb0b9e => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:26:53.590307 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1cf7a-c5bd-4b3b-a602-de98181882d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:53.591524 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1cf7a-c5bd-4b3b-a602-de98181882d8 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:53.591810 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1cf7a-c5bd-4b3b-a602-de98181882d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:53.592138 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1cf7a-c5bd-4b3b-a602-de98181882d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:53.673199 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1cf7a-c5bd-4b3b-a602-de98181882d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:53.674835 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1cf7a-c5bd-4b3b-a602-de98181882d8 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:53.782996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:53.786867 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 328/685] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:26:53.793679 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3a9e9-6f7a-4442-bc43-9972ec8fc861 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:53.898275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3a9e9-6f7a-4442-bc43-9972ec8fc861 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:53.927185 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:53.941122 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e861d2-c860-4fd6-b6be-25f06dbfa37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:53.942013 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e861d2-c860-4fd6-b6be-25f06dbfa37a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:53.942295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e861d2-c860-4fd6-b6be-25f06dbfa37a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:53.942565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e861d2-c860-4fd6-b6be-25f06dbfa37a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:53.953882 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e861d2-c860-4fd6-b6be-25f06dbfa37a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:53.955365 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e861d2-c860-4fd6-b6be-25f06dbfa37a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:53.973726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-53e861d2-c860-4fd6-b6be-25f06dbfa37a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:53.973726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:53.973726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:53.973726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:53.973726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:53.973726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:53.973726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:53.973726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:53.973726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:53.973726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:53.973726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:53.973726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:53.973726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:53.973726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:53.973726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:53.974729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:53.974729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:53.974729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:53.974729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:53.974729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:53.974729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:53.974729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:53.974729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:53.974729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:53.974729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:53.974729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:53.974729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:53.974729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:53.974729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:53.974729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:53.974729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:53.974729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:53.975614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:53.975614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:53.975614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:53.975614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:53.975614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 358/686] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:53.981161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1cf7a-c5bd-4b3b-a602-de98181882d8 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:54.083946 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1cf7a-c5bd-4b3b-a602-de98181882d8 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:54.119441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93457778-3b27-4965-9534-5f131defc72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:54.120183 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93457778-3b27-4965-9534-5f131defc72f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:54.120465 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93457778-3b27-4965-9534-5f131defc72f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:54.120739 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93457778-3b27-4965-9534-5f131defc72f None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:54.121521 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93457778-3b27-4965-9534-5f131defc72f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:54.121901 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93457778-3b27-4965-9534-5f131defc72f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:54.123298 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93457778-3b27-4965-9534-5f131defc72f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:54.135912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 329/687] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:54.143375 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e861d2-c860-4fd6-b6be-25f06dbfa37a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:54.272860 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bab64-dca4-49c3-9679-decfb89c5f02 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:54.273303 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bab64-dca4-49c3-9679-decfb89c5f02 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:54.273592 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bab64-dca4-49c3-9679-decfb89c5f02 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:54.275896 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 330/688] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:54.283190 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b3707-ac38-4da1-8ff0-64faecab6aae None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:54.283473 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b3707-ac38-4da1-8ff0-64faecab6aae None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:54.283752 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b3707-ac38-4da1-8ff0-64faecab6aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:54.284434 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e861d2-c860-4fd6-b6be-25f06dbfa37a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:54.323426 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-bd7b3707-ac38-4da1-8ff0-64faecab6aae None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:54.324618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-bd7b3707-ac38-4da1-8ff0-64faecab6aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:54.350945 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89689026-a09e-409a-8daf-28a890d60a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:54.352007 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89689026-a09e-409a-8daf-28a890d60a59 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:54.352272 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89689026-a09e-409a-8daf-28a890d60a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:54.352544 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89689026-a09e-409a-8daf-28a890d60a59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:54.367840 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89689026-a09e-409a-8daf-28a890d60a59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:54.369326 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89689026-a09e-409a-8daf-28a890d60a59 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:54.408759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-89689026-a09e-409a-8daf-28a890d60a59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:54.408759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:54.408759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:54.408759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:54.408759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:54.408759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:54.408759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:54.408759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:54.408759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:54.408759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:54.408759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:54.408759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:54.408759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:26:54.408759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:26:54.408759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:26:54.411730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:26:54.411730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:54.411730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:54.411730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:54.411730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:54.411730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:54.411730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:54.411730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:54.411730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:54.411730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:54.411730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:54.411730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:54.411730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:54.411730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:54.411730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:54.411730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:54.411730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:54.414682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:26:54.414682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:26:54.414682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:26:54.414682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:26:54.414682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:26:54.414682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:26:54.414682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:54.414682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:54.414682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 359/689] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:54.416368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89689026-a09e-409a-8daf-28a890d60a59 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:54.453644 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:54.480541 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 331/690] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:54.484411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:54.509311 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b3707-ac38-4da1-8ff0-64faecab6aae None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:54.600981 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89689026-a09e-409a-8daf-28a890d60a59 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:54.661312 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c54e32-0f42-4e0e-8e8b-a34917ede0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:54.661983 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c54e32-0f42-4e0e-8e8b-a34917ede0aa None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:54.662259 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c54e32-0f42-4e0e-8e8b-a34917ede0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:54.662525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c54e32-0f42-4e0e-8e8b-a34917ede0aa None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:54.663350 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c54e32-0f42-4e0e-8e8b-a34917ede0aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:54.663654 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c54e32-0f42-4e0e-8e8b-a34917ede0aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:54.665081 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c54e32-0f42-4e0e-8e8b-a34917ede0aa None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:54.681790 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b3707-ac38-4da1-8ff0-64faecab6aae None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:54.695466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 360/691] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:26:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:54.696359 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c54e32-0f42-4e0e-8e8b-a34917ede0aa None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:54.747842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd9ffa-b762-4954-a774-3d069d6ee07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:54.748706 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd9ffa-b762-4954-a774-3d069d6ee07c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:54.748976 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd9ffa-b762-4954-a774-3d069d6ee07c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:54.749243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd9ffa-b762-4954-a774-3d069d6ee07c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:54.773571 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd9ffa-b762-4954-a774-3d069d6ee07c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:54.781780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-42dd9ffa-b762-4954-a774-3d069d6ee07c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:26:54.781780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:54.781780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:54.781780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:54.781780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:54.781780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:54.781780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:54.781780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:54.781780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:54.781780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:54.781780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:54.781780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:54.781780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:54.781780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:54.781780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:54.781780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:54.782709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:54.782709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:54.782709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:54.782709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:54.782709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:54.782709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:54.782709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:54.782709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:54.782709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:54.782709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:54.782709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:54.782709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:54.782709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:54.782709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:54.782709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:54.782709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:54.784226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:54.784226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:54.784226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:54.784226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:54.784226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:54.784226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:54.784226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:54.784226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:54.784226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:54.784226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:54.784226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:26:54.784226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:54.786624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 332/692] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:26:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:26:54.790236 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd9ffa-b762-4954-a774-3d069d6ee07c None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:54.876458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:54.888429 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:54.898121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c54e32-0f42-4e0e-8e8b-a34917ede0aa None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:54.958180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd9ffa-b762-4954-a774-3d069d6ee07c None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:54.963290 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db809ca3-8111-4643-a434-796032db8372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:54.963976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db809ca3-8111-4643-a434-796032db8372 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:54.964256 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db809ca3-8111-4643-a434-796032db8372 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:54.964532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db809ca3-8111-4643-a434-796032db8372 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:54.965409 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db809ca3-8111-4643-a434-796032db8372 None admin] RBAC: Adding query filter params (role.id=9dc761b84aa745ad920c76ddf9fb0b9e, scope.project.id=af45a1ec7c94408bb638c55fb43fa961, user.id=8cd0e37b0404419bb5752228bd809be4) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:54.965727 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db809ca3-8111-4643-a434-796032db8372 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:54.967284 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db809ca3-8111-4643-a434-796032db8372 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:54.974094 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 361/693] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:26:54 2022] GET /identity/v3/role_assignments?user.id=8cd0e37b0404419bb5752228bd809be4&scope.project.id=af45a1ec7c94408bb638c55fb43fa961&role.id=9dc761b84aa745ad920c76ddf9fb0b9e => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:54.993580 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afacb6e-ba8b-4e07-9fd8-88db144a64c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:54.994256 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afacb6e-ba8b-4e07-9fd8-88db144a64c4 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:54.994536 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afacb6e-ba8b-4e07-9fd8-88db144a64c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:54.994844 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afacb6e-ba8b-4e07-9fd8-88db144a64c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:54.995601 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afacb6e-ba8b-4e07-9fd8-88db144a64c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:54.995907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afacb6e-ba8b-4e07-9fd8-88db144a64c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:54.997356 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afacb6e-ba8b-4e07-9fd8-88db144a64c4 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:55.007548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 333/694] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:55.013342 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db809ca3-8111-4643-a434-796032db8372 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:55.134079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db809ca3-8111-4643-a434-796032db8372 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:55.176283 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b42e38-3727-45fb-87c7-b5c67a94bf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:55.177505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b42e38-3727-45fb-87c7-b5c67a94bf9b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:55.178024 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b42e38-3727-45fb-87c7-b5c67a94bf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:55.178501 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b42e38-3727-45fb-87c7-b5c67a94bf9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:55.196837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b42e38-3727-45fb-87c7-b5c67a94bf9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:55.198660 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b42e38-3727-45fb-87c7-b5c67a94bf9b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:55.228118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-b9b42e38-3727-45fb-87c7-b5c67a94bf9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:55.228118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:55.228118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:55.228118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:55.228118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:55.228118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:55.228118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:55.228118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:55.228118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:55.228118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:55.228118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:55.228118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:55.228118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:55.228118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:55.228118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:55.229091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:55.229091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:55.229091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:55.229091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:55.229091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:55.229091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:55.229091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:55.229091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:55.229091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:55.229091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:55.229091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:55.229091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:55.229091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:55.229091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:55.229091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:55.229091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:55.229091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:55.229970 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:55.229970 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:55.229970 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:55.229970 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:55.232116 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 362/695] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:55.237940 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afacb6e-ba8b-4e07-9fd8-88db144a64c4 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:55.378513 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afacb6e-ba8b-4e07-9fd8-88db144a64c4 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:55.389791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:55.414954 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e086149-7bc5-4368-a3a9-6cfa7b16a6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:55.415623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e086149-7bc5-4368-a3a9-6cfa7b16a6fe None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:55.415901 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e086149-7bc5-4368-a3a9-6cfa7b16a6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:55.416170 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e086149-7bc5-4368-a3a9-6cfa7b16a6fe None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:55.416888 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e086149-7bc5-4368-a3a9-6cfa7b16a6fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:55.417189 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e086149-7bc5-4368-a3a9-6cfa7b16a6fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:55.418640 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e086149-7bc5-4368-a3a9-6cfa7b16a6fe None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:55.431800 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 334/696] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:55.437651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b42e38-3727-45fb-87c7-b5c67a94bf9b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:55.454701 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:55.553427 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b42e38-3727-45fb-87c7-b5c67a94bf9b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:55.590541 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3435d4a-6973-4e80-b60d-c6c4dc588850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:55.591381 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3435d4a-6973-4e80-b60d-c6c4dc588850 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:55.591813 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3435d4a-6973-4e80-b60d-c6c4dc588850 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:55.592132 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3435d4a-6973-4e80-b60d-c6c4dc588850 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:55.599803 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3435d4a-6973-4e80-b60d-c6c4dc588850 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:55.601246 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3435d4a-6973-4e80-b60d-c6c4dc588850 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:55.616383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-a3435d4a-6973-4e80-b60d-c6c4dc588850 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:26:55.616383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:55.616383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:55.616383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:55.616383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:55.616383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:55.616383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:55.616383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:55.616383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:55.616383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:55.616383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:55.616383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:55.616383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:26:55.616383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:26:55.616383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:26:55.616383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:26:55.617370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:55.617370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:55.617370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:26:55.617370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:55.617370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:26:55.617370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:55.617370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:55.617370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:55.617370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:55.617370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:55.617370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:55.617370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:55.617370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:55.617370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:55.617370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:55.617370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:55.617370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:55.617370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:55.618307 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:55.618307 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:55.618307 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:26:55.618307 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:26:55.618307 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:26:55.618307 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:26:55.618307 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:26:55.618307 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:26:55.618307 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:26:55.618307 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:55.618307 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 363/697] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 2 13:26:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:55.625802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e086149-7bc5-4368-a3a9-6cfa7b16a6fe None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:55.713022 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27165b-2c45-4cfe-9183-bc053e1ea2ef None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:55.713451 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27165b-2c45-4cfe-9183-bc053e1ea2ef None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:55.713831 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27165b-2c45-4cfe-9183-bc053e1ea2ef None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:55.715768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 364/698] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:55.721216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e43904-17f6-4418-a207-bc92127c1ddc None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:55.721590 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e43904-17f6-4418-a207-bc92127c1ddc None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:55.721953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e43904-17f6-4418-a207-bc92127c1ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:55.743116 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e0e43904-17f6-4418-a207-bc92127c1ddc None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:55.746941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e0e43904-17f6-4418-a207-bc92127c1ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:55.748680 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e086149-7bc5-4368-a3a9-6cfa7b16a6fe None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:55.814253 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5fba3-dd07-47e7-9476-fd8c0c04c20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:55.815069 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5fba3-dd07-47e7-9476-fd8c0c04c20e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:55.815342 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5fba3-dd07-47e7-9476-fd8c0c04c20e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:55.815608 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5fba3-dd07-47e7-9476-fd8c0c04c20e None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:55.821894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5fba3-dd07-47e7-9476-fd8c0c04c20e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:55.822209 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5fba3-dd07-47e7-9476-fd8c0c04c20e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:55.823666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5fba3-dd07-47e7-9476-fd8c0c04c20e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:55.874078 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 335/699] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 2 13:26:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:55.882412 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5fba3-dd07-47e7-9476-fd8c0c04c20e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:55.887391 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:55.904777 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 365/700] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:55.922835 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:55.936485 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e43904-17f6-4418-a207-bc92127c1ddc None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:56.005984 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5fba3-dd07-47e7-9476-fd8c0c04c20e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:56.046969 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ffbc2-a5bd-4157-91ed-aa23d2390ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:56.048526 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ffbc2-a5bd-4157-91ed-aa23d2390ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:56.049231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ffbc2-a5bd-4157-91ed-aa23d2390ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:56.050786 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ffbc2-a5bd-4157-91ed-aa23d2390ce4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:56.107388 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e43904-17f6-4418-a207-bc92127c1ddc None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:56.147228 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90d31e-4735-486c-8853-d3aa2e698aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:56.148340 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90d31e-4735-486c-8853-d3aa2e698aca None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:56.148622 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90d31e-4735-486c-8853-d3aa2e698aca None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:56.148895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90d31e-4735-486c-8853-d3aa2e698aca None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:56.149557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90d31e-4735-486c-8853-d3aa2e698aca None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:56.151236 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90d31e-4735-486c-8853-d3aa2e698aca None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:56.168400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-6e90d31e-4735-486c-8853-d3aa2e698aca None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:26:56.168400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:56.168400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:26:56.168400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:26:56.168400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:26:56.168400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:26:56.168400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:26:56.168400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:26:56.168400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:26:56.168400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:56.168400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:26:56.168400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:56.168400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:56.168400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:56.168400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:56.168400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:56.170071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:56.170071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:56.170071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:56.170071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:56.170071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:56.170071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:56.170071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:56.170071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:26:56.170071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:26:56.170071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:26:56.170071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:26:56.170071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:56.170071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:56.170071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:56.170071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:56.170071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:56.171156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:56.171156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:56.171156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:56.171156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:56.171156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:56.171156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:56.171156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:56.171156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:56.171156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:56.171156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:56.171156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:56.171156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:26:56.171156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:26:56.171156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:26:56.171156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:56.171156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 366/701] 10.222.0.18 () {56 vars in 1129 bytes} [Thu Jun 2 13:26:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:26:56.181386 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90d31e-4735-486c-8853-d3aa2e698aca None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:56.204158 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ffbc2-a5bd-4157-91ed-aa23d2390ce4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:56.206251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ffbc2-a5bd-4157-91ed-aa23d2390ce4 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:56.244280 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:56.273550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:56.323341 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90d31e-4735-486c-8853-d3aa2e698aca None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:56.358636 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 336/702] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:26:56.360081 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acf23b-6dfc-48fc-94dc-728bef76f1ab None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:56.360371 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acf23b-6dfc-48fc-94dc-728bef76f1ab None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:56.360645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acf23b-6dfc-48fc-94dc-728bef76f1ab None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:56.366345 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 337/703] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:56.367300 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acf23b-6dfc-48fc-94dc-728bef76f1ab None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:56.370432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92875203-8434-4513-9cf6-2d22f1a00eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:56.372768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92875203-8434-4513-9cf6-2d22f1a00eeb None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:56.373234 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92875203-8434-4513-9cf6-2d22f1a00eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:56.373645 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92875203-8434-4513-9cf6-2d22f1a00eeb None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:56.374495 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92875203-8434-4513-9cf6-2d22f1a00eeb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:56.374975 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92875203-8434-4513-9cf6-2d22f1a00eeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:56.376514 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92875203-8434-4513-9cf6-2d22f1a00eeb None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:56.383500 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 367/704] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Jun 2 13:26:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:56.388650 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9a93b-08d3-4da2-840d-8929e0ba0f80 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:56.388650 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9a93b-08d3-4da2-840d-8929e0ba0f80 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:56.388650 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9a93b-08d3-4da2-840d-8929e0ba0f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:56.417359 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-71c9a93b-08d3-4da2-840d-8929e0ba0f80 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:56.418721 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-71c9a93b-08d3-4da2-840d-8929e0ba0f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:56.499355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acf23b-6dfc-48fc-94dc-728bef76f1ab None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:56.510700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 368/705] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:56.511634 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9a93b-08d3-4da2-840d-8929e0ba0f80 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:56.533246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:56.543647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cc03a-fb5b-4421-94c9-4ce1510254a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:56.545101 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cc03a-fb5b-4421-94c9-4ce1510254a6 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:56.545596 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cc03a-fb5b-4421-94c9-4ce1510254a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:56.546825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cc03a-fb5b-4421-94c9-4ce1510254a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:56.567894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3cc03a-fb5b-4421-94c9-4ce1510254a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:56.569295 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3cc03a-fb5b-4421-94c9-4ce1510254a6 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:56.596801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-2a3cc03a-fb5b-4421-94c9-4ce1510254a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:56.596801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:56.596801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:56.596801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:56.596801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:56.596801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:56.596801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:56.596801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:56.596801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:56.596801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:56.596801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:56.596801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:56.596801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:56.596801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:56.596801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:56.597832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:56.597832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:56.597832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:56.597832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:56.597832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:56.597832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:56.597832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:56.597832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:56.597832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:56.597832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:56.597832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:56.597832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:56.597832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:56.597832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:56.597832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:56.597832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:56.597832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:56.598778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:56.598778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:56.598778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:56.598778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:56.598778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 338/706] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:56.603924 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cc03a-fb5b-4421-94c9-4ce1510254a6 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:56.607475 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:56.669955 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9a93b-08d3-4da2-840d-8929e0ba0f80 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:56.709206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755711c-0ef2-4e24-81b7-2a97e3edd999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:56.710306 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755711c-0ef2-4e24-81b7-2a97e3edd999 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:56.710873 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755711c-0ef2-4e24-81b7-2a97e3edd999 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:56.711152 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755711c-0ef2-4e24-81b7-2a97e3edd999 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:56.712104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755711c-0ef2-4e24-81b7-2a97e3edd999 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:56.712408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755711c-0ef2-4e24-81b7-2a97e3edd999 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:56.714145 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755711c-0ef2-4e24-81b7-2a97e3edd999 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:56.722085 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 369/707] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Jun 2 13:26:56 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:56.723173 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755711c-0ef2-4e24-81b7-2a97e3edd999 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:56.736368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cc03a-fb5b-4421-94c9-4ce1510254a6 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:56.778913 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cc6a1-99e8-412f-8e9c-a393fd0207f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:56.780565 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cc6a1-99e8-412f-8e9c-a393fd0207f7 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:56.781118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cc6a1-99e8-412f-8e9c-a393fd0207f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:56.781613 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cc6a1-99e8-412f-8e9c-a393fd0207f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:56.798806 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705cc6a1-99e8-412f-8e9c-a393fd0207f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:56.801011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705cc6a1-99e8-412f-8e9c-a393fd0207f7 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:56.826250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-705cc6a1-99e8-412f-8e9c-a393fd0207f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:56.826250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:56.826250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:56.826250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:56.826250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:56.826250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:56.826250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:56.826250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:56.826250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:56.826250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:56.826250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:56.826250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:56.826250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:56.826250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:56.826250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:56.827757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:56.827757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:56.827757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:56.827757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:56.827757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:56.827757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:56.827757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:56.827757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:56.827757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:56.827757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:56.827757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:56.827757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:56.827757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:56.827757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:56.827757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:56.827757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:56.827757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:56.828671 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:56.828671 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:56.828671 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:56.828671 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:56.832289 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 339/708] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:56.833931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d16946-0a09-4063-8a56-7b9796cbe372 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:56.834405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d16946-0a09-4063-8a56-7b9796cbe372 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:56.834913 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d16946-0a09-4063-8a56-7b9796cbe372 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:56.836780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 340/709] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:56.839485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d16946-0a09-4063-8a56-7b9796cbe372 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:56.846125 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755711c-0ef2-4e24-81b7-2a97e3edd999 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:56.875509 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:56.889085 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbe253-cf03-4656-87b7-a4888c60ae85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:56.889778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbe253-cf03-4656-87b7-a4888c60ae85 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:56.890056 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbe253-cf03-4656-87b7-a4888c60ae85 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:56.890393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbe253-cf03-4656-87b7-a4888c60ae85 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:56.891156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbe253-cf03-4656-87b7-a4888c60ae85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:56.891509 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbe253-cf03-4656-87b7-a4888c60ae85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:56.892939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbe253-cf03-4656-87b7-a4888c60ae85 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:56.893694 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:56.914397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 370/710] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:56.916101 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86f318-299a-43f3-9391-9728e9aa4e56 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:56.916389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86f318-299a-43f3-9391-9728e9aa4e56 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:56.916665 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86f318-299a-43f3-9391-9728e9aa4e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:56.936126 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-db86f318-299a-43f3-9391-9728e9aa4e56 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:56.937323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-db86f318-299a-43f3-9391-9728e9aa4e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:56.985823 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d16946-0a09-4063-8a56-7b9796cbe372 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:57.019881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 371/711] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:57.020742 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86f318-299a-43f3-9391-9728e9aa4e56 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:57.033629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b965b-61ae-4940-817c-acefff66d169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:57.035025 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b965b-61ae-4940-817c-acefff66d169 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:57.035707 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b965b-61ae-4940-817c-acefff66d169 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:57.036131 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b965b-61ae-4940-817c-acefff66d169 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:57.037280 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b965b-61ae-4940-817c-acefff66d169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:57.037737 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b965b-61ae-4940-817c-acefff66d169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:57.040231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b965b-61ae-4940-817c-acefff66d169 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:57.056897 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 341/712] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:26:57.058055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b965b-61ae-4940-817c-acefff66d169 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:57.138894 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86f318-299a-43f3-9391-9728e9aa4e56 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:57.153536 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:57.164986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:57.174797 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b965b-61ae-4940-817c-acefff66d169 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:57.177889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf58448-cd7f-46e2-b343-7bf94a4504ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:57.178955 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf58448-cd7f-46e2-b343-7bf94a4504ec None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:57.179436 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf58448-cd7f-46e2-b343-7bf94a4504ec None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:57.179882 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf58448-cd7f-46e2-b343-7bf94a4504ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:57.188115 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf58448-cd7f-46e2-b343-7bf94a4504ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:57.189816 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf58448-cd7f-46e2-b343-7bf94a4504ec None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:57.205532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-2bf58448-cd7f-46e2-b343-7bf94a4504ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:57.205532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:57.205532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:57.205532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:57.205532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:57.205532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:57.205532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:57.205532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:57.205532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:57.205532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:57.205532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:57.205532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:57.205532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:26:57.205532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:26:57.205532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:26:57.206443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:26:57.206443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:57.206443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:57.206443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:57.206443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:57.206443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:57.206443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:57.206443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:57.206443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:57.206443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:57.206443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:57.206443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:57.206443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:57.206443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:57.206443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:57.206443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:57.206443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:57.207397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:26:57.207397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:26:57.207397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:26:57.207397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:26:57.207397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:26:57.207397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:26:57.207397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:57.207397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:26:57.214190 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadad4d1-3284-4580-bdc4-5d6b2ca5b700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:57.214190 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadad4d1-3284-4580-bdc4-5d6b2ca5b700 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:57.214190 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadad4d1-3284-4580-bdc4-5d6b2ca5b700 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:57.214190 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadad4d1-3284-4580-bdc4-5d6b2ca5b700 None admin] PATH_INFO: `/v3/services/network` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:57.214691 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadad4d1-3284-4580-bdc4-5d6b2ca5b700 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:57.214853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 372/713] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:57.216218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf58448-cd7f-46e2-b343-7bf94a4504ec None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:57.216455 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadad4d1-3284-4580-bdc4-5d6b2ca5b700 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:57.231679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-aadad4d1-3284-4580-bdc4-5d6b2ca5b700 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:26:57.231679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:57.231679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:26:57.231679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:26:57.231679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:26:57.231679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:26:57.231679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:26:57.231679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:26:57.231679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:26:57.231679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:57.231679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:26:57.231679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:57.231679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:57.231679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:57.231679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:57.231679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:57.231679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:57.232732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:57.232732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:57.232732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:57.232732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:57.232732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:57.232732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:57.232732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:26:57.232732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:26:57.232732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:26:57.232732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:26:57.232732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:57.232732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:57.232732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:57.232732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:57.232732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:57.232732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:57.233723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:57.233723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:57.233723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:57.233723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:57.233723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:57.233723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:57.233723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:57.233723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:57.233723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:57.233723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:57.233723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:26:57.233723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:26:57.233723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:26:57.233723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:57.233723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 342/714] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:57 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:57.234725 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadad4d1-3284-4580-bdc4-5d6b2ca5b700 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:57.331995 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf58448-cd7f-46e2-b343-7bf94a4504ec None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:57.340956 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadad4d1-3284-4580-bdc4-5d6b2ca5b700 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:57.370226 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077f6bb-d77b-45db-99e2-8e3133af3da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:57.371427 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077f6bb-d77b-45db-99e2-8e3133af3da2 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:57.372484 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077f6bb-d77b-45db-99e2-8e3133af3da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:57.373147 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077f6bb-d77b-45db-99e2-8e3133af3da2 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:57.374006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077f6bb-d77b-45db-99e2-8e3133af3da2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:57.376533 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077f6bb-d77b-45db-99e2-8e3133af3da2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:57.380213 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae99bc-a073-4ad1-9342-089fdc38e452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:57.380994 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae99bc-a073-4ad1-9342-089fdc38e452 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:57.381392 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae99bc-a073-4ad1-9342-089fdc38e452 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:57.381763 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae99bc-a073-4ad1-9342-089fdc38e452 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:57.382746 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae99bc-a073-4ad1-9342-089fdc38e452 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:57.383152 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae99bc-a073-4ad1-9342-089fdc38e452 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:57.384975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae99bc-a073-4ad1-9342-089fdc38e452 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:57.400965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 343/715] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:26:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:57.402080 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae99bc-a073-4ad1-9342-089fdc38e452 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:57.408157 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 373/716] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 13:26:57 2022] POST /identity/v3/users => generated 254 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:26:57.415773 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077f6bb-d77b-45db-99e2-8e3133af3da2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:57.435107 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:57.495706 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:57.542894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae99bc-a073-4ad1-9342-089fdc38e452 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:57.585157 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4719e57-af71-4e6b-a401-a98bbab6297f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:57.586211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4719e57-af71-4e6b-a401-a98bbab6297f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:57.586730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4719e57-af71-4e6b-a401-a98bbab6297f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:57.587197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4719e57-af71-4e6b-a401-a98bbab6297f None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:57.588767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4719e57-af71-4e6b-a401-a98bbab6297f None admin] RBAC: Adding query filter params (name=network) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:57.589302 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4719e57-af71-4e6b-a401-a98bbab6297f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:57.592423 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4719e57-af71-4e6b-a401-a98bbab6297f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:57.598963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 344/717] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 2 13:26:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:57.604468 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4719e57-af71-4e6b-a401-a98bbab6297f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:57.685665 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077f6bb-d77b-45db-99e2-8e3133af3da2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:57.709114 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:57.732977 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4719e57-af71-4e6b-a401-a98bbab6297f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:57.772898 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9be9f-9198-4a37-9e0b-2fe2e175d283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:57.773959 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9be9f-9198-4a37-9e0b-2fe2e175d283 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:57.774440 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9be9f-9198-4a37-9e0b-2fe2e175d283 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:57.774983 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9be9f-9198-4a37-9e0b-2fe2e175d283 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:57.775887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9be9f-9198-4a37-9e0b-2fe2e175d283 None admin] RBAC: Adding query filter params (type=network) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:57.776391 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9be9f-9198-4a37-9e0b-2fe2e175d283 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:57.778235 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6ed82-2209-4294-a690-32930ec98dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:57.778694 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9be9f-9198-4a37-9e0b-2fe2e175d283 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:57.779035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6ed82-2209-4294-a690-32930ec98dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:57.779317 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6ed82-2209-4294-a690-32930ec98dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:57.779593 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6ed82-2209-4294-a690-32930ec98dd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:57.780432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f6ed82-2209-4294-a690-32930ec98dd0 None admin] RBAC: Adding query filter params (role.id=6edd584a77084fa78240661ea76cddb5, scope.project.id=af45a1ec7c94408bb638c55fb43fa961, user.id=5a0061e2927843cf86769d2beab18743) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:57.780741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f6ed82-2209-4294-a690-32930ec98dd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:57.782172 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f6ed82-2209-4294-a690-32930ec98dd0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:57.787739 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 345/718] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 2 13:26:57 2022] GET /identity/v3/services?type=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:26:57.790628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 374/719] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:26:57 2022] GET /identity/v3/role_assignments?user.id=5a0061e2927843cf86769d2beab18743&scope.project.id=af45a1ec7c94408bb638c55fb43fa961&role.id=6edd584a77084fa78240661ea76cddb5 => generated 259 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:57.984958 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665c13a-d0df-4075-9695-809f5163148c None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:57.985499 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665c13a-d0df-4075-9695-809f5163148c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:57.985499 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665c13a-d0df-4075-9695-809f5163148c None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:57.987311 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 346/720] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:57.993335 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c691e-5649-4720-ba80-96ffbb1c904b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:57.993652 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c691e-5649-4720-ba80-96ffbb1c904b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:57.993895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c691e-5649-4720-ba80-96ffbb1c904b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:58.019607 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8e1c691e-5649-4720-ba80-96ffbb1c904b None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:58.021167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8e1c691e-5649-4720-ba80-96ffbb1c904b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:58.104971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 375/721] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:58.129376 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665c13a-d0df-4075-9695-809f5163148c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:58.249828 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665c13a-d0df-4075-9695-809f5163148c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:58.289562 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a179e-cc4f-42f9-a843-85d761220d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:58.290378 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a179e-cc4f-42f9-a843-85d761220d27 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:58.290680 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a179e-cc4f-42f9-a843-85d761220d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:58.290952 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a179e-cc4f-42f9-a843-85d761220d27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:58.309782 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a179e-cc4f-42f9-a843-85d761220d27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:58.325728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-f73a179e-cc4f-42f9-a843-85d761220d27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:26:58.325728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:58.325728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:58.325728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:58.325728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:58.325728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:58.325728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:58.325728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:58.325728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:58.325728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:58.325728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:58.325728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:58.325728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:58.325728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:58.325728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:58.325728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:58.326722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:58.326722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:58.326722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:58.326722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:58.326722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:58.326722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:58.326722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:58.326722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:58.326722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:58.326722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:58.326722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:58.326722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:58.326722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:58.326722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:58.326722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:58.326722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:58.327571 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:58.327571 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:58.327571 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:58.327571 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:58.327571 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:58.327571 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:58.327571 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:58.327571 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:58.327571 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:58.327571 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:58.327571 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:26:58.327571 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:58.327571 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 347/722] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:26:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:58.333018 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c691e-5649-4720-ba80-96ffbb1c904b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:58.373992 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:58.490426 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c691e-5649-4720-ba80-96ffbb1c904b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:58.538240 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e1c71-1ccf-4f29-96c6-8b5eb18e662e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:58.538880 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e1c71-1ccf-4f29-96c6-8b5eb18e662e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:58.539159 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e1c71-1ccf-4f29-96c6-8b5eb18e662e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:58.539517 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e1c71-1ccf-4f29-96c6-8b5eb18e662e None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:58.540270 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e1c71-1ccf-4f29-96c6-8b5eb18e662e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:58.540574 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e1c71-1ccf-4f29-96c6-8b5eb18e662e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:58.541941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e1c71-1ccf-4f29-96c6-8b5eb18e662e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:58.550823 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 376/723] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:58.559986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a179e-cc4f-42f9-a843-85d761220d27 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:58.575990 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:58.730783 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a179e-cc4f-42f9-a843-85d761220d27 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:58.792968 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6e044-2128-4d16-83f2-f3f625cd71d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:58.793974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6e044-2128-4d16-83f2-f3f625cd71d6 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:58.794283 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6e044-2128-4d16-83f2-f3f625cd71d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:58.794557 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6e044-2128-4d16-83f2-f3f625cd71d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:58.809704 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6e044-2128-4d16-83f2-f3f625cd71d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:58.811206 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6e044-2128-4d16-83f2-f3f625cd71d6 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:58.837623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-f1b6e044-2128-4d16-83f2-f3f625cd71d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:58.837623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:58.837623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:58.837623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:58.837623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:58.837623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:58.837623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:58.837623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:58.837623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:58.837623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:58.837623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:58.837623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:58.837623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:58.837623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:58.837623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:58.838607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:58.838607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:58.838607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:58.838607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:58.838607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:58.838607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:58.838607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:58.838607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:58.838607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:58.838607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:58.838607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:58.838607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:58.838607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:58.838607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:58.838607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:58.838607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:58.838607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:58.839919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:58.839919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:58.839919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:58.839919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:58.839919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 348/724] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:58.844978 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e1c71-1ccf-4f29-96c6-8b5eb18e662e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:58.968599 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:58.988916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e1c71-1ccf-4f29-96c6-8b5eb18e662e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:59.035265 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0d623-ab73-4a2e-9fc1-50f5aaa25e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:59.035940 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0d623-ab73-4a2e-9fc1-50f5aaa25e6e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:59.036216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0d623-ab73-4a2e-9fc1-50f5aaa25e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:59.036483 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0d623-ab73-4a2e-9fc1-50f5aaa25e6e None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:59.037200 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0d623-ab73-4a2e-9fc1-50f5aaa25e6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:59.037499 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0d623-ab73-4a2e-9fc1-50f5aaa25e6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:59.038888 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0d623-ab73-4a2e-9fc1-50f5aaa25e6e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:59.053689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 377/725] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:59.059101 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6e044-2128-4d16-83f2-f3f625cd71d6 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:59.138014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:59.197339 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6e044-2128-4d16-83f2-f3f625cd71d6 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:59.247358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5216621-554d-4050-9db1-d2d98be560c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:59.248285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5216621-554d-4050-9db1-d2d98be560c4 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:59.248564 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5216621-554d-4050-9db1-d2d98be560c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:59.248834 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5216621-554d-4050-9db1-d2d98be560c4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:59.262142 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5216621-554d-4050-9db1-d2d98be560c4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:59.263788 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5216621-554d-4050-9db1-d2d98be560c4 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:59.280823 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8285de-6e22-4f5b-8c95-4ce905099f77 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:59.281126 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8285de-6e22-4f5b-8c95-4ce905099f77 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:59.281376 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8285de-6e22-4f5b-8c95-4ce905099f77 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:59.282764 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 378/726] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:26:59.284950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-f5216621-554d-4050-9db1-d2d98be560c4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:26:59.284950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:59.284950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:59.284950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:59.284950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:59.284950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:59.284950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:59.284950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:59.284950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:59.284950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:59.284950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:59.284950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:59.284950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:26:59.284950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:26:59.284950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:26:59.284950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:26:59.285842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:59.285842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:59.285842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:26:59.285842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:59.285842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:26:59.285842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:59.285842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:59.285842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:59.285842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:59.285842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:59.285842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:59.285842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:59.285842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:59.285842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:59.285842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:59.285842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:59.285842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:59.285842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:59.287582 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:59.287582 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:59.287582 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:26:59.287582 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:26:59.287582 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:26:59.287582 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:26:59.287582 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:26:59.287582 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:26:59.287582 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:26:59.287582 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:26:59.287582 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 349/727] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:26:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:59.291827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3584a-c01d-4e0f-a425-80dd0bf9f150 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:59.292111 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3584a-c01d-4e0f-a425-80dd0bf9f150 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:59.292378 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3584a-c01d-4e0f-a425-80dd0bf9f150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:59.298456 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5216621-554d-4050-9db1-d2d98be560c4 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:59.331934 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-34f3584a-c01d-4e0f-a425-80dd0bf9f150 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:59.333071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-34f3584a-c01d-4e0f-a425-80dd0bf9f150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:59.415689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 379/728] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:26:59.439425 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3584a-c01d-4e0f-a425-80dd0bf9f150 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:59.470890 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5216621-554d-4050-9db1-d2d98be560c4 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:59.498958 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:59.515060 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41856fd1-e407-46cf-aafe-c87728acecdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:59.515787 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41856fd1-e407-46cf-aafe-c87728acecdc None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:59.516072 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41856fd1-e407-46cf-aafe-c87728acecdc None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:59.516349 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41856fd1-e407-46cf-aafe-c87728acecdc None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:59.517200 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41856fd1-e407-46cf-aafe-c87728acecdc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:59.517612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41856fd1-e407-46cf-aafe-c87728acecdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:59.519180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41856fd1-e407-46cf-aafe-c87728acecdc None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:59.547886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:59.568288 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 350/729] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Jun 2 13:26:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:59.572127 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3584a-c01d-4e0f-a425-80dd0bf9f150 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:59.573668 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41856fd1-e407-46cf-aafe-c87728acecdc None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:59.671904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717346e9-fa60-41da-a7c8-f959b79b7988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:59.672597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717346e9-fa60-41da-a7c8-f959b79b7988 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:59.672927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717346e9-fa60-41da-a7c8-f959b79b7988 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:59.673204 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717346e9-fa60-41da-a7c8-f959b79b7988 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:59.673951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717346e9-fa60-41da-a7c8-f959b79b7988 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:59.675362 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717346e9-fa60-41da-a7c8-f959b79b7988 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:59.689694 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41856fd1-e407-46cf-aafe-c87728acecdc None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:59.716652 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 380/730] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 13:26:59 2022] POST /identity/v3/services => generated 251 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:26:59.737662 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e41b1b-1d90-45fb-b5e2-78155be19ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:59.738414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e41b1b-1d90-45fb-b5e2-78155be19ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:59.738737 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e41b1b-1d90-45fb-b5e2-78155be19ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:59.739011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e41b1b-1d90-45fb-b5e2-78155be19ba8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:59.803080 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:59.813889 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e41b1b-1d90-45fb-b5e2-78155be19ba8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:59.815479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e41b1b-1d90-45fb-b5e2-78155be19ba8 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:59.922690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 351/731] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:59 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:26:59.928373 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717346e9-fa60-41da-a7c8-f959b79b7988 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:00.055726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717346e9-fa60-41da-a7c8-f959b79b7988 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:00.098238 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40db51d-c2d7-4cab-8e56-a5d2950373b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:00.099114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40db51d-c2d7-4cab-8e56-a5d2950373b6 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:00.099387 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40db51d-c2d7-4cab-8e56-a5d2950373b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:00.099654 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40db51d-c2d7-4cab-8e56-a5d2950373b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:00.101699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:00.113522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40db51d-c2d7-4cab-8e56-a5d2950373b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:00.115571 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40db51d-c2d7-4cab-8e56-a5d2950373b6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:00.133758 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-e40db51d-c2d7-4cab-8e56-a5d2950373b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:00.133758 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:00.133758 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:00.133758 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:00.133758 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:00.133758 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:00.133758 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:00.133758 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:00.133758 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:00.133758 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:00.133758 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:00.133758 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:00.133758 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:00.133758 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:00.133758 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:00.134797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:00.134797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:00.134797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:00.134797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:00.134797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:00.134797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:00.134797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:00.134797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:00.134797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:00.134797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:00.134797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:00.134797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:00.134797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:00.134797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:00.134797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:00.134797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:00.134797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:00.136087 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:00.136087 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:00.136087 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:00.136087 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:00.136087 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 381/732] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:00.140595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e41b1b-1d90-45fb-b5e2-78155be19ba8 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:00.218752 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:00.254299 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e41b1b-1d90-45fb-b5e2-78155be19ba8 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:00.304549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dae217-796a-4737-9bfd-e5e54ee8965a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:00.305262 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dae217-796a-4737-9bfd-e5e54ee8965a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:00.305540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dae217-796a-4737-9bfd-e5e54ee8965a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:00.305810 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dae217-796a-4737-9bfd-e5e54ee8965a None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:00.306555 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dae217-796a-4737-9bfd-e5e54ee8965a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:00.306884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dae217-796a-4737-9bfd-e5e54ee8965a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:00.308285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dae217-796a-4737-9bfd-e5e54ee8965a None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:00.327341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 352/733] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:00.333222 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40db51d-c2d7-4cab-8e56-a5d2950373b6 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:00.463514 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40db51d-c2d7-4cab-8e56-a5d2950373b6 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:00.503337 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf37cce-695e-4505-af2a-132ef7bf3152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:00.504055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf37cce-695e-4505-af2a-132ef7bf3152 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:00.504329 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf37cce-695e-4505-af2a-132ef7bf3152 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:00.504596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf37cce-695e-4505-af2a-132ef7bf3152 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:00.511628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf37cce-695e-4505-af2a-132ef7bf3152 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:00.513179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf37cce-695e-4505-af2a-132ef7bf3152 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:00.528781 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-0bf37cce-695e-4505-af2a-132ef7bf3152 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:00.528781 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:00.528781 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:00.528781 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:00.528781 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:00.528781 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:00.528781 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:00.528781 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:00.528781 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:00.528781 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:00.528781 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:00.528781 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:00.528781 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:27:00.528781 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:27:00.528781 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:27:00.529741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:27:00.529741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:00.529741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:00.529741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:00.529741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:00.529741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:00.529741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:00.529741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:00.529741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:00.529741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:00.529741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:00.529741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:00.529741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:00.529741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:00.529741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:00.529741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:00.529741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:00.531244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:27:00.531244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:27:00.531244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:27:00.531244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:27:00.531244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:27:00.531244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:27:00.531244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:00.531244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:00.531244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 382/734] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:27:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:00.539929 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dae217-796a-4737-9bfd-e5e54ee8965a None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:00.645697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36fcaa-8236-4753-8dab-8a57e80ca10a None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:00.646042 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36fcaa-8236-4753-8dab-8a57e80ca10a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:00.646229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36fcaa-8236-4753-8dab-8a57e80ca10a None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:00.648094 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 383/735] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:00.660202 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b884b-e7e7-4a94-84ed-00e33192f0fb None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:00.660664 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b884b-e7e7-4a94-84ed-00e33192f0fb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:00.660942 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b884b-e7e7-4a94-84ed-00e33192f0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:00.663532 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dae217-796a-4737-9bfd-e5e54ee8965a None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:00.699376 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b32b884b-e7e7-4a94-84ed-00e33192f0fb None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:00.700788 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b32b884b-e7e7-4a94-84ed-00e33192f0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:00.721497 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:00.729852 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d593f-d0e5-4aa9-860e-c09725e57c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:00.732375 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d593f-d0e5-4aa9-860e-c09725e57c5f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:00.733484 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d593f-d0e5-4aa9-860e-c09725e57c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:00.733755 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d593f-d0e5-4aa9-860e-c09725e57c5f None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:00.734552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d593f-d0e5-4aa9-860e-c09725e57c5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:00.734928 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d593f-d0e5-4aa9-860e-c09725e57c5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:00.736375 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d593f-d0e5-4aa9-860e-c09725e57c5f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:00.749580 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 353/736] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:27:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:00.751271 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4e560-fd06-4c57-b28b-d13fed6b7bf2 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:00.751918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4e560-fd06-4c57-b28b-d13fed6b7bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:00.752464 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4e560-fd06-4c57-b28b-d13fed6b7bf2 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:00.754180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 354/737] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:00.759163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4e560-fd06-4c57-b28b-d13fed6b7bf2 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:00.771606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:00.798279 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 384/738] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:27:00.799646 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca20c5c-5d64-4d64-9f38-0dba137e19d7 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:00.799947 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca20c5c-5d64-4d64-9f38-0dba137e19d7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:00.800209 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca20c5c-5d64-4d64-9f38-0dba137e19d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:00.817684 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-aca20c5c-5d64-4d64-9f38-0dba137e19d7 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:00.818434 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-aca20c5c-5d64-4d64-9f38-0dba137e19d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:00.882607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4e560-fd06-4c57-b28b-d13fed6b7bf2 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:00.893790 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 385/739] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:27:00.894670 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca20c5c-5d64-4d64-9f38-0dba137e19d7 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:00.919712 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f409f-a485-4a54-b2e9-1ecd541cb966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:00.920381 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f409f-a485-4a54-b2e9-1ecd541cb966 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:00.920653 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f409f-a485-4a54-b2e9-1ecd541cb966 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:00.920917 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f409f-a485-4a54-b2e9-1ecd541cb966 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:00.921739 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f409f-a485-4a54-b2e9-1ecd541cb966 None admin] RBAC: Adding query filter params (role.id=6edd584a77084fa78240661ea76cddb5, scope.project.id=af45a1ec7c94408bb638c55fb43fa961, user.id=8cd0e37b0404419bb5752228bd809be4) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:00.922047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f409f-a485-4a54-b2e9-1ecd541cb966 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:00.923522 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f409f-a485-4a54-b2e9-1ecd541cb966 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:00.929423 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 355/740] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:27:00 2022] GET /identity/v3/role_assignments?user.id=8cd0e37b0404419bb5752228bd809be4&scope.project.id=af45a1ec7c94408bb638c55fb43fa961&role.id=6edd584a77084fa78240661ea76cddb5 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:00.930512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d2604-b66b-4734-8984-89a492d458f1 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:00.930865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d2604-b66b-4734-8984-89a492d458f1 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:00.931139 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d2604-b66b-4734-8984-89a492d458f1 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:00.932554 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 356/741] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:00.933885 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d2604-b66b-4734-8984-89a492d458f1 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:01.008025 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca20c5c-5d64-4d64-9f38-0dba137e19d7 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:01.010794 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:01.018326 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:01.054469 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b2fb7-eaa5-4772-933b-8326b4b54827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:01.055580 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b2fb7-eaa5-4772-933b-8326b4b54827 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:01.055927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b2fb7-eaa5-4772-933b-8326b4b54827 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:01.056271 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b2fb7-eaa5-4772-933b-8326b4b54827 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:01.057091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b2fb7-eaa5-4772-933b-8326b4b54827 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:01.058612 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b2fb7-eaa5-4772-933b-8326b4b54827 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:01.073251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d2604-b66b-4734-8984-89a492d458f1 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:01.076552 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 386/742] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 13:27:00 2022] POST /identity/v3/services => generated 240 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:27:01.079168 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22332c20-a48c-4c21-ad3f-b3f9408384fc None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:01.079529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22332c20-a48c-4c21-ad3f-b3f9408384fc None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:01.079875 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22332c20-a48c-4c21-ad3f-b3f9408384fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:01.102560 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-22332c20-a48c-4c21-ad3f-b3f9408384fc None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:01.104417 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-22332c20-a48c-4c21-ad3f-b3f9408384fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:01.126017 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750790c9-2654-47cc-a8fd-f23722cef7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:01.127335 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750790c9-2654-47cc-a8fd-f23722cef7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:01.127941 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750790c9-2654-47cc-a8fd-f23722cef7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:01.128409 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750790c9-2654-47cc-a8fd-f23722cef7d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:01.144931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750790c9-2654-47cc-a8fd-f23722cef7d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:27:01.157341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-750790c9-2654-47cc-a8fd-f23722cef7d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:27:01.157341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:01.157341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:01.157341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:01.157341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:01.157341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:01.157341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:01.157341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:01.157341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:01.157341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:01.157341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:01.157341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:01.157341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:27:01.157341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:27:01.157341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:27:01.157341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:27:01.158389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:27:01.158389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:27:01.158389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:27:01.158389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:27:01.158389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:01.158389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:01.158389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:01.158389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:01.158389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:01.158389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:01.158389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:01.158389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:01.158389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:01.158389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:01.158389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:01.158389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:01.159275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:01.159275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:01.159275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:01.159275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:01.159275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:27:01.159275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:27:01.159275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:27:01.159275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:27:01.159275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:27:01.159275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:27:01.159275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:27:01.159275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:01.162962 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 357/743] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 13:27:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:01.169087 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750790c9-2654-47cc-a8fd-f23722cef7d5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:01.214999 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 387/744] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:01.252916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22332c20-a48c-4c21-ad3f-b3f9408384fc None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:01.298362 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750790c9-2654-47cc-a8fd-f23722cef7d5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:01.312523 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:01.344798 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6fcd1-9d82-4d8c-a80a-d4111fc42512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:01.346044 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6fcd1-9d82-4d8c-a80a-d4111fc42512 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:01.346466 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6fcd1-9d82-4d8c-a80a-d4111fc42512 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:01.346916 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6fcd1-9d82-4d8c-a80a-d4111fc42512 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:01.348885 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6fcd1-9d82-4d8c-a80a-d4111fc42512 None admin] RBAC: Adding query filter params (name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:01.349396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6fcd1-9d82-4d8c-a80a-d4111fc42512 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:01.356253 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6fcd1-9d82-4d8c-a80a-d4111fc42512 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:01.370457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 358/745] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 13:27:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:01.376587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6fcd1-9d82-4d8c-a80a-d4111fc42512 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:01.448241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:01.455532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22332c20-a48c-4c21-ad3f-b3f9408384fc None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:01.500216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7fe75-3d21-4419-8474-3f83267de3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:01.501044 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7fe75-3d21-4419-8474-3f83267de3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:01.501714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7fe75-3d21-4419-8474-3f83267de3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:01.501998 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7fe75-3d21-4419-8474-3f83267de3a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:01.517009 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7fe75-3d21-4419-8474-3f83267de3a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:27:01.518808 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6fcd1-9d82-4d8c-a80a-d4111fc42512 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:01.526167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-cdb7fe75-3d21-4419-8474-3f83267de3a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:27:01.526167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:01.526167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:01.526167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:01.526167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:01.526167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:01.526167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:01.526167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:01.526167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:01.526167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:01.526167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:01.526167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:01.526167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:27:01.526167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:27:01.526167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:27:01.526167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:27:01.527884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:27:01.527884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:27:01.527884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:27:01.527884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:27:01.527884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:01.527884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:01.527884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:01.527884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:01.527884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:01.527884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:01.527884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:01.527884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:01.527884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:01.527884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:01.527884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:01.527884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:01.528738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:01.528738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:01.528738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:01.528738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:01.528738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:27:01.528738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:27:01.528738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:27:01.528738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:27:01.528738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:27:01.528738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:27:01.528738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:27:01.528738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:01.528738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 388/746] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:27:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:01.534214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7fe75-3d21-4419-8474-3f83267de3a4 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:01.566548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84aed9e-7828-4ea9-98c8-4b4608a54d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:01.567433 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84aed9e-7828-4ea9-98c8-4b4608a54d0d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:01.567716 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84aed9e-7828-4ea9-98c8-4b4608a54d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:01.567986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84aed9e-7828-4ea9-98c8-4b4608a54d0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:01.585298 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84aed9e-7828-4ea9-98c8-4b4608a54d0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:01.586783 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84aed9e-7828-4ea9-98c8-4b4608a54d0d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:01.609116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-d84aed9e-7828-4ea9-98c8-4b4608a54d0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:01.609116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:01.609116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:01.609116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:01.609116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:01.609116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:01.609116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:01.609116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:01.609116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:01.609116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:01.609116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:01.609116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:01.609116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:01.609116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:01.609116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:01.610237 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:01.610237 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:01.610237 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:01.610237 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:01.610237 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:01.610237 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:01.610237 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:01.610237 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:01.610237 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:01.610237 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:01.610237 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:01.610237 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:01.610237 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:01.610237 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:01.610237 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:01.610237 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:01.610237 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:01.611344 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:01.611344 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:01.611344 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:01.611344 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:01.614660 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 359/747] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:01.617229 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84aed9e-7828-4ea9-98c8-4b4608a54d0d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:01.661837 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:01.712474 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7fe75-3d21-4419-8474-3f83267de3a4 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:01.775302 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d84f3-5fb5-4c81-86b0-7c98de4afd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:01.775995 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d84f3-5fb5-4c81-86b0-7c98de4afd7e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:01.776274 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d84f3-5fb5-4c81-86b0-7c98de4afd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:01.776546 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d84f3-5fb5-4c81-86b0-7c98de4afd7e None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:01.777759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d84f3-5fb5-4c81-86b0-7c98de4afd7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:01.778116 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d84f3-5fb5-4c81-86b0-7c98de4afd7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:01.779527 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d84f3-5fb5-4c81-86b0-7c98de4afd7e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:01.789284 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84aed9e-7828-4ea9-98c8-4b4608a54d0d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:01.798887 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 389/748] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:27:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:01.804580 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d84f3-5fb5-4c81-86b0-7c98de4afd7e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:01.825460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9c4fe-92f8-4472-8251-a355210272e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:01.826166 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9c4fe-92f8-4472-8251-a355210272e5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:01.826451 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9c4fe-92f8-4472-8251-a355210272e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:01.826765 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9c4fe-92f8-4472-8251-a355210272e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:01.827626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9c4fe-92f8-4472-8251-a355210272e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:01.827978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9c4fe-92f8-4472-8251-a355210272e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:01.829532 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9c4fe-92f8-4472-8251-a355210272e5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:01.843071 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 360/749] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:01.848549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9c4fe-92f8-4472-8251-a355210272e5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:01.849524 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:01.959798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d84f3-5fb5-4c81-86b0-7c98de4afd7e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:01.974918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:01.999374 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9c4fe-92f8-4472-8251-a355210272e5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:02.039446 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435a490-8563-4d1d-a234-d3f2624a2d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:02.040863 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435a490-8563-4d1d-a234-d3f2624a2d32 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:02.041645 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435a490-8563-4d1d-a234-d3f2624a2d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:02.042357 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435a490-8563-4d1d-a234-d3f2624a2d32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:02.044270 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7e1a2-1d10-4442-84dc-5e113f29d2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:02.045191 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7e1a2-1d10-4442-84dc-5e113f29d2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:02.045729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7e1a2-1d10-4442-84dc-5e113f29d2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:02.047223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7e1a2-1d10-4442-84dc-5e113f29d2f2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:02.062362 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7e1a2-1d10-4442-84dc-5e113f29d2f2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:02.065379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7e1a2-1d10-4442-84dc-5e113f29d2f2 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:02.066530 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435a490-8563-4d1d-a234-d3f2624a2d32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:02.068454 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435a490-8563-4d1d-a234-d3f2624a2d32 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:02.095962 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-0fa7e1a2-1d10-4442-84dc-5e113f29d2f2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:27:02.095962 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:02.095962 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:02.095962 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:02.095962 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:02.095962 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:02.095962 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:02.095962 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:02.095962 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:02.095962 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:02.095962 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:02.095962 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:02.095962 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:27:02.095962 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:27:02.095962 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:27:02.095962 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:27:02.097115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:02.097115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:02.097115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:27:02.097115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:02.097115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:27:02.097115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:02.097115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:02.097115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:02.097115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:02.097115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:02.097115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:02.097115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:02.097115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:02.097115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:02.097115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:02.097115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:02.097115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:02.097115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:02.098245 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:02.098245 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:02.098245 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:27:02.098245 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:27:02.098245 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:27:02.098245 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:27:02.098245 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:27:02.098245 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:27:02.098245 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:27:02.098245 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:02.105951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-a435a490-8563-4d1d-a234-d3f2624a2d32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:02.105951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:02.105951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:02.105951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:02.105951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:02.105951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:02.105951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:02.105951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:02.105951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:02.105951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:02.105951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:02.105951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:02.105951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:02.105951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:02.105951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:02.107140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:02.107140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:02.107140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:02.107140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:02.107140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:02.107140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:02.107140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:02.107140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:02.107140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:02.107140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:02.107140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:02.107140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:02.107140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:02.107140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:02.107140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:02.107140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:02.107140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:02.108199 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:02.108199 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:02.108199 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:02.108199 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:02.109701 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 361/750] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 2 13:27:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:02.111264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 390/751] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:02.115164 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7e1a2-1d10-4442-84dc-5e113f29d2f2 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:02.116636 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435a490-8563-4d1d-a234-d3f2624a2d32 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:02.259469 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:02.288392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435a490-8563-4d1d-a234-d3f2624a2d32 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:02.298201 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7e1a2-1d10-4442-84dc-5e113f29d2f2 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:02.351257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525f641-5b49-41dd-a5a5-30456ef7d59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:02.351858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525f641-5b49-41dd-a5a5-30456ef7d59c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:02.352136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525f641-5b49-41dd-a5a5-30456ef7d59c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:02.352409 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525f641-5b49-41dd-a5a5-30456ef7d59c None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:02.353630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525f641-5b49-41dd-a5a5-30456ef7d59c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:02.353939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525f641-5b49-41dd-a5a5-30456ef7d59c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:02.355352 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525f641-5b49-41dd-a5a5-30456ef7d59c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:02.358593 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaba107-6386-460f-ab4a-b371ffeb248e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:02.359299 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaba107-6386-460f-ab4a-b371ffeb248e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:02.359576 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaba107-6386-460f-ab4a-b371ffeb248e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:02.359855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaba107-6386-460f-ab4a-b371ffeb248e None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:02.360691 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaba107-6386-460f-ab4a-b371ffeb248e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:02.360999 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaba107-6386-460f-ab4a-b371ffeb248e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:02.362428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaba107-6386-460f-ab4a-b371ffeb248e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:02.381188 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 391/752] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:02.386402 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525f641-5b49-41dd-a5a5-30456ef7d59c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:02.388459 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 362/753] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Jun 2 13:27:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:02.394046 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaba107-6386-460f-ab4a-b371ffeb248e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:02.398873 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:02.533049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525f641-5b49-41dd-a5a5-30456ef7d59c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:02.591565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:02.599828 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef7e83-bbd3-4f09-9853-aee2b144218a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:02.600788 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef7e83-bbd3-4f09-9853-aee2b144218a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:02.601191 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef7e83-bbd3-4f09-9853-aee2b144218a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:02.601616 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef7e83-bbd3-4f09-9853-aee2b144218a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:02.610048 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef7e83-bbd3-4f09-9853-aee2b144218a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:02.611778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef7e83-bbd3-4f09-9853-aee2b144218a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:02.619433 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaba107-6386-460f-ab4a-b371ffeb248e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:02.637507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-74ef7e83-bbd3-4f09-9853-aee2b144218a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:27:02.637507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:02.637507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:02.637507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:02.637507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:02.637507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:02.637507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:02.637507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:02.637507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:02.637507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:02.637507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:02.637507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:02.637507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:27:02.637507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:27:02.637507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:27:02.637507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:27:02.638805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:02.638805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:02.638805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:27:02.638805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:02.638805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:27:02.638805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:02.638805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:02.638805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:02.638805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:02.638805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:02.638805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:02.638805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:02.638805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:02.638805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:02.638805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:02.638805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:02.638805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:02.638805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:02.639979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:02.639979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:02.639979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:27:02.639979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:27:02.639979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:27:02.639979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:27:02.639979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:27:02.639979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:27:02.639979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:27:02.639979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:02.642505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 392/754] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 2 13:27:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:02.647704 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef7e83-bbd3-4f09-9853-aee2b144218a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:02.715187 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43036ca-be9d-468a-a842-0593b3bb0f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:02.715985 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43036ca-be9d-468a-a842-0593b3bb0f54 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:02.716346 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43036ca-be9d-468a-a842-0593b3bb0f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:02.716610 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43036ca-be9d-468a-a842-0593b3bb0f54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:02.765834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef7e83-bbd3-4f09-9853-aee2b144218a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:02.812502 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dcf012-d9a8-4c58-be26-d6ab93a25a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:02.813185 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcf012-d9a8-4c58-be26-d6ab93a25a4d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:02.813463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcf012-d9a8-4c58-be26-d6ab93a25a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:02.813726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcf012-d9a8-4c58-be26-d6ab93a25a4d None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:02.814560 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcf012-d9a8-4c58-be26-d6ab93a25a4d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:02.814892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcf012-d9a8-4c58-be26-d6ab93a25a4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:02.816317 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcf012-d9a8-4c58-be26-d6ab93a25a4d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:02.845589 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43036ca-be9d-468a-a842-0593b3bb0f54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:02.846752 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 393/755] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 2 13:27:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:02.847106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43036ca-be9d-468a-a842-0593b3bb0f54 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:02.848149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cb46a-78d1-4a82-b5b3-580550904851 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:02.848437 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cb46a-78d1-4a82-b5b3-580550904851 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:02.848706 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cb46a-78d1-4a82-b5b3-580550904851 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:02.849159 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:02.850990 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 394/756] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:02.855561 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cb46a-78d1-4a82-b5b3-580550904851 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:02.915702 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:02.963693 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 363/757] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:27:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:27:02.965171 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d65a2c-a1ea-45d3-ad9f-01efe42a28f1 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:02.965548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d65a2c-a1ea-45d3-ad9f-01efe42a28f1 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:02.965826 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d65a2c-a1ea-45d3-ad9f-01efe42a28f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:02.980018 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cb46a-78d1-4a82-b5b3-580550904851 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:02.983718 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-65d65a2c-a1ea-45d3-ad9f-01efe42a28f1 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:02.984919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-65d65a2c-a1ea-45d3-ad9f-01efe42a28f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:03.018410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6107488-5823-4d1c-bec3-49400cd87f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:03.019640 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6107488-5823-4d1c-bec3-49400cd87f2f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:03.020119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6107488-5823-4d1c-bec3-49400cd87f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:03.020611 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6107488-5823-4d1c-bec3-49400cd87f2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:03.032356 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6107488-5823-4d1c-bec3-49400cd87f2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:03.034119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6107488-5823-4d1c-bec3-49400cd87f2f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:03.052146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-e6107488-5823-4d1c-bec3-49400cd87f2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:03.052146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:03.052146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:03.052146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:03.052146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:03.052146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:03.052146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:03.052146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:03.052146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:03.052146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:03.052146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:03.052146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:03.052146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:03.052146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:03.052146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:03.053555 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:03.053555 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:03.053555 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:03.053555 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:03.053555 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:03.053555 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:03.053555 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:03.053555 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:03.053555 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:03.053555 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:03.053555 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:03.053555 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:03.053555 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:03.053555 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:03.053555 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:03.053555 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:03.053555 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:03.054434 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:03.054434 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:03.054434 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:03.054434 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:03.061996 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 395/758] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:03.063340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 364/759] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:03.063559 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6107488-5823-4d1c-bec3-49400cd87f2f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:03.071576 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d65a2c-a1ea-45d3-ad9f-01efe42a28f1 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:03.122352 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:03.169534 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:03.172216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6107488-5823-4d1c-bec3-49400cd87f2f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:03.202154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d65a2c-a1ea-45d3-ad9f-01efe42a28f1 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:03.208533 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad508e-c2a3-494e-8dfa-b15ffd7b8a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:03.209626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad508e-c2a3-494e-8dfa-b15ffd7b8a1f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:03.210105 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad508e-c2a3-494e-8dfa-b15ffd7b8a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:03.210624 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad508e-c2a3-494e-8dfa-b15ffd7b8a1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:03.221706 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad508e-c2a3-494e-8dfa-b15ffd7b8a1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:03.223497 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad508e-c2a3-494e-8dfa-b15ffd7b8a1f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:03.239181 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2e1b0-ca95-46ef-b20e-54c618f20995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:03.239864 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2e1b0-ca95-46ef-b20e-54c618f20995 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:03.240146 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2e1b0-ca95-46ef-b20e-54c618f20995 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:03.240420 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2e1b0-ca95-46ef-b20e-54c618f20995 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:03.241146 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2e1b0-ca95-46ef-b20e-54c618f20995 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:03.241451 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2e1b0-ca95-46ef-b20e-54c618f20995 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:03.242907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2e1b0-ca95-46ef-b20e-54c618f20995 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:03.243938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-d9ad508e-c2a3-494e-8dfa-b15ffd7b8a1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:03.243938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:03.243938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:03.243938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:03.243938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:03.243938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:03.243938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:03.243938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:03.243938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:03.243938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:03.243938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:03.243938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:03.243938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:03.243938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:03.243938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:03.244765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:03.244765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:03.244765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:03.244765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:03.244765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:03.244765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:03.244765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:03.244765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:03.244765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:03.244765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:03.244765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:03.244765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:03.244765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:03.244765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:03.244765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:03.244765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:03.244765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:03.245652 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:03.245652 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:03.245652 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:03.245652 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:03.249083 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 396/760] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:03.250181 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad508e-c2a3-494e-8dfa-b15ffd7b8a1f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:03.260390 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 365/761] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:03.260390 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2e1b0-ca95-46ef-b20e-54c618f20995 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:03.356625 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad508e-c2a3-494e-8dfa-b15ffd7b8a1f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:03.360299 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:03.370813 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2e1b0-ca95-46ef-b20e-54c618f20995 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:03.393441 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f418afc-9547-44d6-8648-f29b9b9d4787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:03.394649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f418afc-9547-44d6-8648-f29b9b9d4787 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:03.395145 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f418afc-9547-44d6-8648-f29b9b9d4787 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:03.395709 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f418afc-9547-44d6-8648-f29b9b9d4787 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:03.396653 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f418afc-9547-44d6-8648-f29b9b9d4787 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:03.398238 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f418afc-9547-44d6-8648-f29b9b9d4787 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:03.407809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78f5bb-e1a3-4006-9d98-1ed48a75526a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:03.408485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78f5bb-e1a3-4006-9d98-1ed48a75526a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:03.408766 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78f5bb-e1a3-4006-9d98-1ed48a75526a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:03.409038 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78f5bb-e1a3-4006-9d98-1ed48a75526a None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:03.409896 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78f5bb-e1a3-4006-9d98-1ed48a75526a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:03.410198 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78f5bb-e1a3-4006-9d98-1ed48a75526a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:03.411600 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78f5bb-e1a3-4006-9d98-1ed48a75526a None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:03.414214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-3f418afc-9547-44d6-8648-f29b9b9d4787 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:27:03.414214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:03.414214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:27:03.414214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:27:03.414214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:27:03.414214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:27:03.414214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:27:03.414214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:03.414214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:27:03.414214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:03.414214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:27:03.414214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:03.414214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:03.414214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:03.414214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:03.414214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:03.417079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:03.417079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:03.417079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:03.417079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:03.417079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:03.417079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:03.417079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:03.417079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:27:03.417079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:27:03.417079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:27:03.417079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:27:03.417079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:03.417079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:03.417079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:03.417079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:03.417079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:03.418136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:03.418136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:03.418136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:03.418136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:03.418136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:03.418136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:03.418136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:03.418136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:03.418136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:03.418136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:03.418136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:03.418136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:27:03.418136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:03.418136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:27:03.418136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:03.419693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 397/762] 10.222.0.18 () {56 vars in 1129 bytes} [Thu Jun 2 13:27:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:03.420721 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f418afc-9547-44d6-8648-f29b9b9d4787 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:03.425758 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 366/763] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:03.426167 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78f5bb-e1a3-4006-9d98-1ed48a75526a None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:03.442260 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:03.534894 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f418afc-9547-44d6-8648-f29b9b9d4787 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:03.544744 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78f5bb-e1a3-4006-9d98-1ed48a75526a None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:03.569019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d95d3c-de1a-4336-b6cb-43512f1b6e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:03.569830 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d95d3c-de1a-4336-b6cb-43512f1b6e99 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:03.570114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d95d3c-de1a-4336-b6cb-43512f1b6e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:03.570383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d95d3c-de1a-4336-b6cb-43512f1b6e99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:03.577368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d95d3c-de1a-4336-b6cb-43512f1b6e99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:03.578850 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d95d3c-de1a-4336-b6cb-43512f1b6e99 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:03.580226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9b021-5ece-4da9-a368-41a81a939240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:03.580900 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9b021-5ece-4da9-a368-41a81a939240 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:03.581168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9b021-5ece-4da9-a368-41a81a939240 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:03.581434 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9b021-5ece-4da9-a368-41a81a939240 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:03.582135 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9b021-5ece-4da9-a368-41a81a939240 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:03.582439 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9b021-5ece-4da9-a368-41a81a939240 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:03.583809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9b021-5ece-4da9-a368-41a81a939240 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:03.588681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 367/764] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Jun 2 13:27:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:03.594509 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9b021-5ece-4da9-a368-41a81a939240 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:03.595366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-84d95d3c-de1a-4336-b6cb-43512f1b6e99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:03.595366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:03.595366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:03.595366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:03.595366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:03.595366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:03.595366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:03.595366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:03.595366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:03.595366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:03.595366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:03.595366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:03.595366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:27:03.595366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:27:03.595366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:27:03.596257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:27:03.596257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:03.596257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:03.596257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:03.596257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:03.596257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:03.596257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:03.596257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:03.596257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:03.596257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:03.596257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:03.596257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:03.596257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:03.596257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:03.596257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:03.596257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:03.596257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:03.602666 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:27:03.602666 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:27:03.602666 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:27:03.602666 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:27:03.602666 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:27:03.602666 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:27:03.602666 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:03.602666 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:03.602666 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 398/765] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:27:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:03.602666 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414cafb-296e-4933-bc78-e493ec8e33fc None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:03.602666 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414cafb-296e-4933-bc78-e493ec8e33fc None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:03.603273 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414cafb-296e-4933-bc78-e493ec8e33fc None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:03.603273 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 399/766] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:03.603273 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414cafb-296e-4933-bc78-e493ec8e33fc None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:03.621526 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:03.691421 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:03.711114 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9b021-5ece-4da9-a368-41a81a939240 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:03.716767 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414cafb-296e-4933-bc78-e493ec8e33fc None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:03.747820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef56be0-eb78-4e92-b256-90aef4382c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:03.748631 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef56be0-eb78-4e92-b256-90aef4382c6e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:03.748973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef56be0-eb78-4e92-b256-90aef4382c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:03.749257 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef56be0-eb78-4e92-b256-90aef4382c6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:03.756717 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef56be0-eb78-4e92-b256-90aef4382c6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:03.756938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fabb26-ca84-4c24-a830-828d369d1d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:03.757583 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fabb26-ca84-4c24-a830-828d369d1d4f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:03.757855 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fabb26-ca84-4c24-a830-828d369d1d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:03.758128 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fabb26-ca84-4c24-a830-828d369d1d4f None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:03.758237 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef56be0-eb78-4e92-b256-90aef4382c6e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:03.758868 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fabb26-ca84-4c24-a830-828d369d1d4f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:03.759175 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fabb26-ca84-4c24-a830-828d369d1d4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:03.760515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fabb26-ca84-4c24-a830-828d369d1d4f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:03.769830 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 400/767] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Jun 2 13:27:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:03.769830 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c434537-1f9f-4bf6-ac7d-c0cdc8d8e5b1 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:03.769830 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c434537-1f9f-4bf6-ac7d-c0cdc8d8e5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:03.769830 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c434537-1f9f-4bf6-ac7d-c0cdc8d8e5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:03.773063 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-8ef56be0-eb78-4e92-b256-90aef4382c6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:03.773063 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:03.773063 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:03.773063 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:03.773063 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:03.773063 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:03.773063 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:03.773063 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:03.773063 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:03.773063 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:03.773063 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:03.773063 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:03.773063 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:27:03.773063 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:27:03.773063 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:27:03.773921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:27:03.773921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:03.773921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:03.773921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:03.773921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:03.773921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:03.773921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:03.773921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:03.773921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:03.773921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:03.773921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:03.773921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:03.773921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:03.773921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:03.773921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:03.773921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:03.773921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:03.775947 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:27:03.775947 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:27:03.775947 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:27:03.775947 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:27:03.775947 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:27:03.775947 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:27:03.775947 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:03.775947 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:03.775947 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 368/768] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:27:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:03.775947 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef56be0-eb78-4e92-b256-90aef4382c6e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:03.791887 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0c434537-1f9f-4bf6-ac7d-c0cdc8d8e5b1 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:03.793057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0c434537-1f9f-4bf6-ac7d-c0cdc8d8e5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:03.853723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:03.859425 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 401/769] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:03.860293 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c434537-1f9f-4bf6-ac7d-c0cdc8d8e5b1 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:03.880922 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef56be0-eb78-4e92-b256-90aef4382c6e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:03.915090 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6728613-5a7a-432c-80bc-9d88504ee7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:03.915758 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6728613-5a7a-432c-80bc-9d88504ee7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:03.916034 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6728613-5a7a-432c-80bc-9d88504ee7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:03.916302 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6728613-5a7a-432c-80bc-9d88504ee7f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:03.917154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6728613-5a7a-432c-80bc-9d88504ee7f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:03.917480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6728613-5a7a-432c-80bc-9d88504ee7f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:03.918954 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6728613-5a7a-432c-80bc-9d88504ee7f0 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:03.934631 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 369/770] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:27:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:03.934631 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6728613-5a7a-432c-80bc-9d88504ee7f0 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:03.937042 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:03.968608 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c434537-1f9f-4bf6-ac7d-c0cdc8d8e5b1 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:04.003170 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32007196-5a5e-484d-af0c-96bd4ebb6675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:04.003831 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32007196-5a5e-484d-af0c-96bd4ebb6675 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:04.004113 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32007196-5a5e-484d-af0c-96bd4ebb6675 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:04.004380 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32007196-5a5e-484d-af0c-96bd4ebb6675 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:04.005151 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32007196-5a5e-484d-af0c-96bd4ebb6675 None admin] RBAC: Adding query filter params (interface=public, service_id=5c794df50b3f443d9ad43482d5c1ca41, region_id=RegionOne) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:04.005472 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32007196-5a5e-484d-af0c-96bd4ebb6675 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:04.006854 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32007196-5a5e-484d-af0c-96bd4ebb6675 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:04.014379 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 402/771] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jun 2 13:27:03 2022] GET /identity/v3/endpoints?service_id=5c794df50b3f443d9ad43482d5c1ca41&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:04.015621 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11428f65-5e7a-4db8-8cc8-646eb0493b54 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:04.015903 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11428f65-5e7a-4db8-8cc8-646eb0493b54 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:04.016172 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11428f65-5e7a-4db8-8cc8-646eb0493b54 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:04.017516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 403/772] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:04.018048 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11428f65-5e7a-4db8-8cc8-646eb0493b54 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:04.032509 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6728613-5a7a-432c-80bc-9d88504ee7f0 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:04.065733 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaa1ea-ddf6-4501-80f2-b2d08ddaa3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:04.066491 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaa1ea-ddf6-4501-80f2-b2d08ddaa3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:04.066810 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaa1ea-ddf6-4501-80f2-b2d08ddaa3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:04.067090 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaa1ea-ddf6-4501-80f2-b2d08ddaa3e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:04.067877 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddaa1ea-ddf6-4501-80f2-b2d08ddaa3e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:04.068194 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddaa1ea-ddf6-4501-80f2-b2d08ddaa3e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:04.069624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddaa1ea-ddf6-4501-80f2-b2d08ddaa3e5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:04.072185 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:04.081856 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 370/773] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:27:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:04.082655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaa1ea-ddf6-4501-80f2-b2d08ddaa3e5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:04.127131 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11428f65-5e7a-4db8-8cc8-646eb0493b54 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:04.162004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47b6c8-aecd-4ead-986d-8af585fbcb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:04.163067 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47b6c8-aecd-4ead-986d-8af585fbcb26 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:04.163349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47b6c8-aecd-4ead-986d-8af585fbcb26 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:04.163733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47b6c8-aecd-4ead-986d-8af585fbcb26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:04.165474 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:04.174340 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47b6c8-aecd-4ead-986d-8af585fbcb26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:27:04.181936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-2b47b6c8-aecd-4ead-986d-8af585fbcb26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:27:04.181936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:04.181936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:04.181936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:04.181936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:04.181936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:04.181936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:04.181936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:04.181936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:04.181936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:04.181936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:04.181936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:04.181936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:27:04.181936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:27:04.181936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:27:04.181936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:27:04.183075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:27:04.183075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:27:04.183075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:27:04.183075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:27:04.183075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:04.183075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:04.183075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:04.183075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:04.183075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:04.183075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:04.183075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:04.183075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:04.183075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:04.183075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:04.183075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:04.183075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:04.188967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:04.188967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:04.188967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:04.188967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:04.188967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:27:04.188967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:27:04.188967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:27:04.188967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:27:04.188967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:27:04.188967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:27:04.188967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:27:04.188967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:04.189611 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaa1ea-ddf6-4501-80f2-b2d08ddaa3e5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:04.189689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 404/774] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:27:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:04.189689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d48377-f133-4f56-aefe-3aecb44d8d64 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:04.189689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d48377-f133-4f56-aefe-3aecb44d8d64 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:04.189689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d48377-f133-4f56-aefe-3aecb44d8d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:04.201109 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-49d48377-f133-4f56-aefe-3aecb44d8d64 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:04.202323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-49d48377-f133-4f56-aefe-3aecb44d8d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:04.219181 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd83ff-040e-40bc-8456-3b025151f5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:04.220013 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd83ff-040e-40bc-8456-3b025151f5fd None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:04.220299 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd83ff-040e-40bc-8456-3b025151f5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:04.220575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd83ff-040e-40bc-8456-3b025151f5fd None admin] PATH_INFO: `/v3/projects/af45a1ec7c94408bb638c55fb43fa961/users/5a0061e2927843cf86769d2beab18743/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:04.222498 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd83ff-040e-40bc-8456-3b025151f5fd None admin] RBAC: Authorizing `identity:create_grant(project_id=af45a1ec7c94408bb638c55fb43fa961, user_id=5a0061e2927843cf86769d2beab18743, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:04.223949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd83ff-040e-40bc-8456-3b025151f5fd None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:04.237022 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 371/775] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 13:27:04 2022] PUT /identity/v3/projects/af45a1ec7c94408bb638c55fb43fa961/users/5a0061e2927843cf86769d2beab18743/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:27:04.237941 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd83ff-040e-40bc-8456-3b025151f5fd None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:04.289695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 405/776] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:04.290943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d48377-f133-4f56-aefe-3aecb44d8d64 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:04.311735 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:04.363500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd83ff-040e-40bc-8456-3b025151f5fd None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:04.400216 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7ae51-7938-4ffb-957a-12b81e5c403d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:04.400908 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7ae51-7938-4ffb-957a-12b81e5c403d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:04.401183 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7ae51-7938-4ffb-957a-12b81e5c403d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:04.401460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7ae51-7938-4ffb-957a-12b81e5c403d None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:04.402551 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7ae51-7938-4ffb-957a-12b81e5c403d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:04.404235 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7ae51-7938-4ffb-957a-12b81e5c403d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:04.410063 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 372/777] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 2 13:27:04 2022] GET /identity/v3/services => generated 772 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:04.411045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7ae51-7938-4ffb-957a-12b81e5c403d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:04.439954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d48377-f133-4f56-aefe-3aecb44d8d64 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:04.475749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:04.496300 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc28824-aae6-4473-b761-dd6e6a9e093c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:04.498033 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc28824-aae6-4473-b761-dd6e6a9e093c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:04.498501 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc28824-aae6-4473-b761-dd6e6a9e093c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:04.499212 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc28824-aae6-4473-b761-dd6e6a9e093c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:04.501285 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc28824-aae6-4473-b761-dd6e6a9e093c None admin] RBAC: Adding query filter params (role.id=9dc761b84aa745ad920c76ddf9fb0b9e, scope.project.id=af45a1ec7c94408bb638c55fb43fa961, user.id=cbf7d6db675047cbb3a3f16631c59622) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:04.501806 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc28824-aae6-4473-b761-dd6e6a9e093c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:04.503510 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc28824-aae6-4473-b761-dd6e6a9e093c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:04.512951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 406/778] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:27:04 2022] GET /identity/v3/role_assignments?user.id=cbf7d6db675047cbb3a3f16631c59622&scope.project.id=af45a1ec7c94408bb638c55fb43fa961&role.id=9dc761b84aa745ad920c76ddf9fb0b9e => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:04.515022 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc28824-aae6-4473-b761-dd6e6a9e093c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:04.534839 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7ae51-7938-4ffb-957a-12b81e5c403d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:04.558779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:04.581706 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59da0ec-0bda-4366-b874-c72df5bed01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:04.582610 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59da0ec-0bda-4366-b874-c72df5bed01c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:04.582745 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59da0ec-0bda-4366-b874-c72df5bed01c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:04.582945 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59da0ec-0bda-4366-b874-c72df5bed01c None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:04.583704 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59da0ec-0bda-4366-b874-c72df5bed01c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:04.584004 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59da0ec-0bda-4366-b874-c72df5bed01c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:04.585393 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59da0ec-0bda-4366-b874-c72df5bed01c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:04.595969 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 373/779] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:27:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:04.601894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59da0ec-0bda-4366-b874-c72df5bed01c None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:04.684900 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc28824-aae6-4473-b761-dd6e6a9e093c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:04.725019 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59da0ec-0bda-4366-b874-c72df5bed01c None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:04.743407 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3bbeb-9278-48ab-b360-d9c89e355bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:04.743407 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3bbeb-9278-48ab-b360-d9c89e355bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:04.743677 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3bbeb-9278-48ab-b360-d9c89e355bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:04.743749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3bbeb-9278-48ab-b360-d9c89e355bb9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:04.744759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3bbeb-9278-48ab-b360-d9c89e355bb9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:04.749721 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3bbeb-9278-48ab-b360-d9c89e355bb9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:04.769448 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-b7b3bbeb-9278-48ab-b360-d9c89e355bb9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:27:04.769448 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:04.769448 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:27:04.769448 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:27:04.769448 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:27:04.769448 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:27:04.769448 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:27:04.769448 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:04.769448 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:27:04.769448 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:04.769448 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:27:04.769448 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:04.769448 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:04.769448 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:04.769448 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:04.769448 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:04.769448 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:04.770672 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:04.770672 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:04.770672 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:04.770672 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:04.770672 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:04.770672 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:04.770672 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:27:04.770672 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:27:04.770672 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:27:04.770672 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:27:04.770672 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:04.770672 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:04.770672 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:04.770672 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:04.770672 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:04.770672 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:04.771535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:04.771535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:04.771535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:04.771535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:04.771535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:04.771535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:04.771535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:04.771535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:04.771535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:04.771535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:04.771535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:27:04.771535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:04.771535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:27:04.771535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:04.774907 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 407/780] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:27:04 2022] GET /identity/v3/services/network => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:04.782126 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3bbeb-9278-48ab-b360-d9c89e355bb9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:04.788515 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f21cf7-8878-424e-9052-a0f33b73be8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:04.789362 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f21cf7-8878-424e-9052-a0f33b73be8b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:04.789645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f21cf7-8878-424e-9052-a0f33b73be8b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:04.789919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f21cf7-8878-424e-9052-a0f33b73be8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:04.806197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f21cf7-8878-424e-9052-a0f33b73be8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:04.807725 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f21cf7-8878-424e-9052-a0f33b73be8b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:04.832540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-78f21cf7-8878-424e-9052-a0f33b73be8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:04.832540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:04.832540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:04.832540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:04.832540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:04.832540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:04.832540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:04.832540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:04.832540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:04.832540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:04.832540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:04.832540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:04.832540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:04.832540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:04.832540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:04.833514 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:04.833514 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:04.833514 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:04.833514 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:04.833514 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:04.833514 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:04.833514 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:04.833514 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:04.833514 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:04.833514 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:04.833514 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:04.833514 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:04.833514 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:04.833514 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:04.833514 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:04.833514 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:04.833514 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:04.834400 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:04.834400 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:04.834400 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:04.834400 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:04.834400 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 374/781] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:04.842541 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f21cf7-8878-424e-9052-a0f33b73be8b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:04.854423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:04.887510 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:04.947611 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f21cf7-8878-424e-9052-a0f33b73be8b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:04.976748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3bbeb-9278-48ab-b360-d9c89e355bb9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:04.986022 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd5121-dfe3-4146-8351-f1f96f4bbbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:04.986942 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd5121-dfe3-4146-8351-f1f96f4bbbe2 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:04.987313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd5121-dfe3-4146-8351-f1f96f4bbbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:04.987731 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd5121-dfe3-4146-8351-f1f96f4bbbe2 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:04.988547 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd5121-dfe3-4146-8351-f1f96f4bbbe2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:04.988944 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd5121-dfe3-4146-8351-f1f96f4bbbe2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:04.990436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd5121-dfe3-4146-8351-f1f96f4bbbe2 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:05.011594 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 375/782] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:05.019006 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd5121-dfe3-4146-8351-f1f96f4bbbe2 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:05.055027 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f394d-037e-4129-b132-ad5cc2547427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:05.056987 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f394d-037e-4129-b132-ad5cc2547427 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:05.057483 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f394d-037e-4129-b132-ad5cc2547427 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:05.061080 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f394d-037e-4129-b132-ad5cc2547427 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:05.062042 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f394d-037e-4129-b132-ad5cc2547427 None admin] RBAC: Adding query filter params (name=network) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:05.062497 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f394d-037e-4129-b132-ad5cc2547427 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:05.064151 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f394d-037e-4129-b132-ad5cc2547427 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:05.075483 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 408/783] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 2 13:27:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:05.081515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f394d-037e-4129-b132-ad5cc2547427 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:05.210982 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:05.220952 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd5121-dfe3-4146-8351-f1f96f4bbbe2 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:05.263477 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f394d-037e-4129-b132-ad5cc2547427 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:05.292378 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8068f2-0e25-47fe-8072-596b3b309066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:05.293227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8068f2-0e25-47fe-8072-596b3b309066 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:05.293502 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8068f2-0e25-47fe-8072-596b3b309066 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:05.293772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8068f2-0e25-47fe-8072-596b3b309066 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:05.299087 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:05.306996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8068f2-0e25-47fe-8072-596b3b309066 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:05.308448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8068f2-0e25-47fe-8072-596b3b309066 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:05.331011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-3f8068f2-0e25-47fe-8072-596b3b309066 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:27:05.331011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:05.331011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:05.331011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:05.331011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:05.331011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:05.331011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:05.331011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:05.331011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:05.331011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:05.331011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:05.331011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:05.331011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:27:05.331011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:27:05.331011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:27:05.331011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:27:05.331986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:05.331986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:05.331986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:27:05.331986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:05.331986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:27:05.331986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:05.331986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:05.331986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:05.331986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:05.331986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:05.331986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:05.331986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:05.331986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:05.331986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:05.331986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:05.331986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:05.331986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:05.331986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:05.332926 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:05.332926 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:05.332926 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:27:05.332926 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:27:05.332926 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:27:05.332926 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:27:05.332926 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:27:05.332926 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:27:05.332926 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:27:05.332926 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:05.333465 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 376/784] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:27:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:05.336560 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f6930-cc19-4a0a-a44e-2db9693b9403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:05.337238 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f6930-cc19-4a0a-a44e-2db9693b9403 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:05.337514 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f6930-cc19-4a0a-a44e-2db9693b9403 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:05.337785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f6930-cc19-4a0a-a44e-2db9693b9403 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:05.338501 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f6930-cc19-4a0a-a44e-2db9693b9403 None admin] RBAC: Adding query filter params (type=network) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:05.338833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f6930-cc19-4a0a-a44e-2db9693b9403 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:05.340376 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f6930-cc19-4a0a-a44e-2db9693b9403 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:05.344981 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8068f2-0e25-47fe-8072-596b3b309066 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:05.349665 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 409/785] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 2 13:27:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:05.352633 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f6930-cc19-4a0a-a44e-2db9693b9403 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:05.479391 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f6930-cc19-4a0a-a44e-2db9693b9403 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:05.514321 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c6763-1d0b-4e8d-a9a3-8c07d097108e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:05.514965 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c6763-1d0b-4e8d-a9a3-8c07d097108e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:05.515576 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c6763-1d0b-4e8d-a9a3-8c07d097108e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:05.515576 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c6763-1d0b-4e8d-a9a3-8c07d097108e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:05.516293 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c6763-1d0b-4e8d-a9a3-8c07d097108e None admin] RBAC: Adding query filter params (interface=public, service_id=e24d48a6cc424c2f8bac4bf850860cae, region_id=RegionOne) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:05.516603 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c6763-1d0b-4e8d-a9a3-8c07d097108e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:05.517977 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c6763-1d0b-4e8d-a9a3-8c07d097108e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:05.523761 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 410/786] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jun 2 13:27:05 2022] GET /identity/v3/endpoints?service_id=e24d48a6cc424c2f8bac4bf850860cae&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:05.531604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c6763-1d0b-4e8d-a9a3-8c07d097108e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:05.583500 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:05.612534 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8068f2-0e25-47fe-8072-596b3b309066 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:05.653233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c6763-1d0b-4e8d-a9a3-8c07d097108e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:05.692945 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f7a3c-3b32-4790-8103-6becf89428a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:05.693623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f7a3c-3b32-4790-8103-6becf89428a0 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:05.693899 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f7a3c-3b32-4790-8103-6becf89428a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:05.694165 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f7a3c-3b32-4790-8103-6becf89428a0 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:05.695021 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f7a3c-3b32-4790-8103-6becf89428a0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:05.695331 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f7a3c-3b32-4790-8103-6becf89428a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:05.696739 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f7a3c-3b32-4790-8103-6becf89428a0 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:05.710523 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea50e3a-dc5a-4f30-9cb9-26e0ff53d4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:05.711580 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea50e3a-dc5a-4f30-9cb9-26e0ff53d4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:05.712080 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea50e3a-dc5a-4f30-9cb9-26e0ff53d4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:05.712557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea50e3a-dc5a-4f30-9cb9-26e0ff53d4d7 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:05.713427 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea50e3a-dc5a-4f30-9cb9-26e0ff53d4d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:05.715371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea50e3a-dc5a-4f30-9cb9-26e0ff53d4d7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:05.722170 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 411/787] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 2 13:27:05 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:05.730540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 377/788] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Jun 2 13:27:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:05.736583 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea50e3a-dc5a-4f30-9cb9-26e0ff53d4d7 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:05.882408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea50e3a-dc5a-4f30-9cb9-26e0ff53d4d7 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:05.895756 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:05.939061 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b14e7c-f96d-4f5c-a166-7e59ffb55693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:05.940348 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b14e7c-f96d-4f5c-a166-7e59ffb55693 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:05.940836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b14e7c-f96d-4f5c-a166-7e59ffb55693 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:05.941304 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b14e7c-f96d-4f5c-a166-7e59ffb55693 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:05.958452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b14e7c-f96d-4f5c-a166-7e59ffb55693 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:05.959990 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b14e7c-f96d-4f5c-a166-7e59ffb55693 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:05.978956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-66b14e7c-f96d-4f5c-a166-7e59ffb55693 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:05.978956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:05.978956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:05.978956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:05.978956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:05.978956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:05.978956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:05.978956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:05.978956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:05.978956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:05.978956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:05.978956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:05.978956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:05.978956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:05.978956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:05.979889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:05.979889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:05.979889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:05.979889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:05.979889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:05.979889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:05.979889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:05.979889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:05.979889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:05.979889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:05.979889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:05.979889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:05.979889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:05.979889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:05.979889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:05.979889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:05.979889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:05.980925 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:05.980925 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:05.980925 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:05.980925 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:05.980925 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 412/789] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:05.987660 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f7a3c-3b32-4790-8103-6becf89428a0 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:06.005559 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:06.102521 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f7a3c-3b32-4790-8103-6becf89428a0 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:06.137388 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cbea5-d248-424b-b43a-dae0176d77ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:06.138074 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cbea5-d248-424b-b43a-dae0176d77ca None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:06.138356 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cbea5-d248-424b-b43a-dae0176d77ca None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:06.138729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cbea5-d248-424b-b43a-dae0176d77ca None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:06.139641 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894cbea5-d248-424b-b43a-dae0176d77ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:06.139947 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894cbea5-d248-424b-b43a-dae0176d77ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:06.141301 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894cbea5-d248-424b-b43a-dae0176d77ca None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:06.154018 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 378/790] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:06.159616 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b14e7c-f96d-4f5c-a166-7e59ffb55693 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:06.316906 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b14e7c-f96d-4f5c-a166-7e59ffb55693 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:06.361902 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438902db-f93a-4a09-a00c-e79459c7c3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:06.362746 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438902db-f93a-4a09-a00c-e79459c7c3ac None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:06.363018 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438902db-f93a-4a09-a00c-e79459c7c3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:06.363285 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438902db-f93a-4a09-a00c-e79459c7c3ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:06.375708 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438902db-f93a-4a09-a00c-e79459c7c3ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:06.377298 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438902db-f93a-4a09-a00c-e79459c7c3ac None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:06.395093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-438902db-f93a-4a09-a00c-e79459c7c3ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:06.395093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:06.395093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:06.395093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:06.395093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:06.395093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:06.395093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:06.395093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:06.395093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:06.395093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:06.395093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:06.395093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:06.395093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:27:06.395093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:27:06.395093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:27:06.396032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:27:06.396032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:06.396032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:06.396032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:06.396032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:06.396032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:06.396032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:06.396032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:06.396032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:06.396032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:06.396032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:06.396032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:06.396032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:06.396032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:06.396032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:06.396032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:06.396032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:06.396929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:27:06.396929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:27:06.396929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:27:06.396929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:27:06.396929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:27:06.396929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:27:06.396929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:06.396929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:06.396929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 413/791] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:27:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:06.404054 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cbea5-d248-424b-b43a-dae0176d77ca None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:06.486946 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:06.517304 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cbea5-d248-424b-b43a-dae0176d77ca None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:06.551695 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ff5df-20f7-432e-974b-3add1dd9ee50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:06.552366 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ff5df-20f7-432e-974b-3add1dd9ee50 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:06.552640 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ff5df-20f7-432e-974b-3add1dd9ee50 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:06.552906 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ff5df-20f7-432e-974b-3add1dd9ee50 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:06.553690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ff5df-20f7-432e-974b-3add1dd9ee50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:06.553992 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ff5df-20f7-432e-974b-3add1dd9ee50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:06.555438 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ff5df-20f7-432e-974b-3add1dd9ee50 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:06.568664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 379/792] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:27:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:06.576058 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438902db-f93a-4a09-a00c-e79459c7c3ac None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:06.608062 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:06.726338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438902db-f93a-4a09-a00c-e79459c7c3ac None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:06.774044 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85368c03-d812-416b-9965-939d2e4bda31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:06.774977 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85368c03-d812-416b-9965-939d2e4bda31 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:06.775253 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85368c03-d812-416b-9965-939d2e4bda31 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:06.775521 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85368c03-d812-416b-9965-939d2e4bda31 None admin] PATH_INFO: `/v3/projects/af45a1ec7c94408bb638c55fb43fa961/users/8cd0e37b0404419bb5752228bd809be4/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:06.779830 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85368c03-d812-416b-9965-939d2e4bda31 None admin] RBAC: Authorizing `identity:create_grant(project_id=af45a1ec7c94408bb638c55fb43fa961, user_id=8cd0e37b0404419bb5752228bd809be4, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:06.781275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85368c03-d812-416b-9965-939d2e4bda31 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:06.802806 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7df74-75d7-4025-a4a8-cfa98e565061 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:06.803364 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7df74-75d7-4025-a4a8-cfa98e565061 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:06.803364 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7df74-75d7-4025-a4a8-cfa98e565061 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:06.805062 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 380/793] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:06.811058 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de771b-4eb4-432a-b633-29f34af49af2 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:06.811623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de771b-4eb4-432a-b633-29f34af49af2 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:06.812089 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de771b-4eb4-432a-b633-29f34af49af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:06.812493 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 414/794] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 13:27:06 2022] PUT /identity/v3/projects/af45a1ec7c94408bb638c55fb43fa961/users/8cd0e37b0404419bb5752228bd809be4/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:27:06.843916 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-e6de771b-4eb4-432a-b633-29f34af49af2 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:06.845158 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e6de771b-4eb4-432a-b633-29f34af49af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:06.949354 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 381/795] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:06.990033 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85368c03-d812-416b-9965-939d2e4bda31 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:07.088619 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:07.119272 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85368c03-d812-416b-9965-939d2e4bda31 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:07.164232 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af6fd5-fe49-4b08-a5b9-dd423faf4d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:07.165085 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af6fd5-fe49-4b08-a5b9-dd423faf4d1e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:07.165363 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af6fd5-fe49-4b08-a5b9-dd423faf4d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:07.165632 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af6fd5-fe49-4b08-a5b9-dd423faf4d1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:07.187687 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af6fd5-fe49-4b08-a5b9-dd423faf4d1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:27:07.195626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-63af6fd5-fe49-4b08-a5b9-dd423faf4d1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:27:07.195626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:07.195626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:07.195626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:07.195626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:07.195626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:07.195626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:07.195626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:07.195626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:07.195626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:07.195626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:07.195626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:07.195626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:27:07.195626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:27:07.195626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:27:07.195626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:27:07.196529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:27:07.196529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:27:07.196529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:27:07.196529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:27:07.196529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:07.196529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:07.196529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:07.196529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:07.196529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:07.196529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:07.196529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:07.196529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:07.196529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:07.196529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:07.196529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:07.196529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:07.197525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:07.197525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:07.197525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:07.197525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:07.197525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:27:07.197525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:27:07.197525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:27:07.197525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:27:07.197525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:27:07.197525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:27:07.197525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:27:07.197525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:07.197525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 415/796] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:27:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:07.208055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de771b-4eb4-432a-b633-29f34af49af2 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:07.319512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:07.359277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de771b-4eb4-432a-b633-29f34af49af2 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:07.393919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cb72d-3bfc-40c2-b13c-59cb9e28e915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:07.395275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cb72d-3bfc-40c2-b13c-59cb9e28e915 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:07.396186 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cb72d-3bfc-40c2-b13c-59cb9e28e915 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:07.396469 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cb72d-3bfc-40c2-b13c-59cb9e28e915 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:07.397230 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cb72d-3bfc-40c2-b13c-59cb9e28e915 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:07.397546 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cb72d-3bfc-40c2-b13c-59cb9e28e915 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:07.399069 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cb72d-3bfc-40c2-b13c-59cb9e28e915 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:07.408694 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 382/797] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:27:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:07.414385 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af6fd5-fe49-4b08-a5b9-dd423faf4d1e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:07.441552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12843f7f-38a2-44c5-adec-42ec8678a5a9 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:07.441885 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12843f7f-38a2-44c5-adec-42ec8678a5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:07.442099 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12843f7f-38a2-44c5-adec-42ec8678a5a9 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:07.443744 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 383/798] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:27:07.448844 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974762e-ccba-4f3c-8e7f-6367207f8160 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:07.449126 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974762e-ccba-4f3c-8e7f-6367207f8160 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:07.449430 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974762e-ccba-4f3c-8e7f-6367207f8160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:07.470699 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-e974762e-ccba-4f3c-8e7f-6367207f8160 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:07.471898 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e974762e-ccba-4f3c-8e7f-6367207f8160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:07.581909 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 384/799] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:27:07.583267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd662d-1d26-44f5-a08a-52a37f8bec6c None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:07.583553 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd662d-1d26-44f5-a08a-52a37f8bec6c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:07.583826 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd662d-1d26-44f5-a08a-52a37f8bec6c None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:07.585065 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af6fd5-fe49-4b08-a5b9-dd423faf4d1e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:07.585481 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 385/800] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:07.590792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ae3ba-5025-4946-a059-8356db8e96b2 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:07.591322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ae3ba-5025-4946-a059-8356db8e96b2 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:07.591795 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ae3ba-5025-4946-a059-8356db8e96b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:07.620293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-1b0ae3ba-5025-4946-a059-8356db8e96b2 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:07.622212 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1b0ae3ba-5025-4946-a059-8356db8e96b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:07.629570 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05743ae9-5d1b-410a-94ca-1af251edd6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:07.630517 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05743ae9-5d1b-410a-94ca-1af251edd6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:07.630751 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05743ae9-5d1b-410a-94ca-1af251edd6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:07.633650 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05743ae9-5d1b-410a-94ca-1af251edd6c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:07.640661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:07.642956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05743ae9-5d1b-410a-94ca-1af251edd6c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:07.644412 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05743ae9-5d1b-410a-94ca-1af251edd6c7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:07.662414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-05743ae9-5d1b-410a-94ca-1af251edd6c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:07.662414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:07.662414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:07.662414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:07.662414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:07.662414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:07.662414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:07.662414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:07.662414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:07.662414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:07.662414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:07.662414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:07.662414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:07.662414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:07.662414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:07.663369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:07.663369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:07.663369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:07.663369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:07.663369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:07.663369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:07.663369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:07.663369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:07.663369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:07.663369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:07.663369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:07.663369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:07.663369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:07.663369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:07.663369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:07.663369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:07.663369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:07.664358 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:07.664358 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:07.664358 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:07.664358 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:07.666714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 416/801] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:07.668684 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05743ae9-5d1b-410a-94ca-1af251edd6c7 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:07.694465 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:07.715804 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 386/802] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:07.717175 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ae3ba-5025-4946-a059-8356db8e96b2 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:07.797210 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05743ae9-5d1b-410a-94ca-1af251edd6c7 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:07.838761 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd20cb-a5a0-4fdf-847e-a12bac5a2fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:07.839941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd20cb-a5a0-4fdf-847e-a12bac5a2fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:07.840538 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd20cb-a5a0-4fdf-847e-a12bac5a2fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:07.841029 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd20cb-a5a0-4fdf-847e-a12bac5a2fa3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:07.841881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd20cb-a5a0-4fdf-847e-a12bac5a2fa3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:07.842968 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ae3ba-5025-4946-a059-8356db8e96b2 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:07.844086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd20cb-a5a0-4fdf-847e-a12bac5a2fa3 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:07.857516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-d7dd20cb-a5a0-4fdf-847e-a12bac5a2fa3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:27:07.857516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:07.857516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:27:07.857516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:27:07.857516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:27:07.857516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:27:07.857516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:27:07.857516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:07.857516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:27:07.857516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:07.857516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:27:07.857516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:07.857516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:07.857516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:07.857516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:07.857516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:07.858505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:07.858505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:07.858505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:07.858505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:07.858505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:07.858505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:07.858505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:07.858505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:27:07.858505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:27:07.858505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:27:07.858505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:27:07.858505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:07.858505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:07.858505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:07.858505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:07.858505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:07.859389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:07.859389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:07.859389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:07.859389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:07.859389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:07.859389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:07.859389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:07.859389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:07.859389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:07.859389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:07.859389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:07.859389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:27:07.859389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:07.859389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:27:07.859389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:07.862415 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 417/803] 10.222.0.18 () {56 vars in 1129 bytes} [Thu Jun 2 13:27:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:07.863557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd20cb-a5a0-4fdf-847e-a12bac5a2fa3 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:07.884737 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274137ae-789d-4e27-b447-0643cb753ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:07.886446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274137ae-789d-4e27-b447-0643cb753ebb None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:07.887334 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274137ae-789d-4e27-b447-0643cb753ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:07.887927 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274137ae-789d-4e27-b447-0643cb753ebb None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:07.889137 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274137ae-789d-4e27-b447-0643cb753ebb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:07.889669 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274137ae-789d-4e27-b447-0643cb753ebb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:07.891247 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274137ae-789d-4e27-b447-0643cb753ebb None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:07.908016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 387/804] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:07.909109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274137ae-789d-4e27-b447-0643cb753ebb None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:07.936715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:07.964832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:07.984610 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd20cb-a5a0-4fdf-847e-a12bac5a2fa3 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:08.020577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629ebe9-56a8-42fa-820a-b8bb926e18e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:08.021594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629ebe9-56a8-42fa-820a-b8bb926e18e9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:08.021965 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629ebe9-56a8-42fa-820a-b8bb926e18e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:08.022395 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629ebe9-56a8-42fa-820a-b8bb926e18e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:08.035769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629ebe9-56a8-42fa-820a-b8bb926e18e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:27:08.043821 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274137ae-789d-4e27-b447-0643cb753ebb None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:08.046010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-0629ebe9-56a8-42fa-820a-b8bb926e18e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:27:08.046010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:08.046010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:08.046010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:08.046010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:08.046010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:08.046010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:08.046010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:08.046010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:08.046010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:08.046010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:08.046010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:08.046010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:27:08.046010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:27:08.046010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:27:08.046010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:27:08.047503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:27:08.047503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:27:08.047503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:27:08.047503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:27:08.047503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:08.047503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:08.047503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:08.047503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:08.047503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:08.047503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:08.047503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:08.047503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:08.047503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:08.047503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:08.047503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:08.047503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:08.048903 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:08.048903 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:08.048903 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:08.048903 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:08.048903 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:27:08.048903 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:27:08.048903 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:27:08.048903 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:27:08.048903 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:27:08.048903 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:27:08.048903 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:27:08.048903 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:08.052407 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 418/805] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 13:27:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:08.053310 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629ebe9-56a8-42fa-820a-b8bb926e18e9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:08.091643 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6e6a0-ba72-48eb-b609-685a25ee0e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:08.092649 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6e6a0-ba72-48eb-b609-685a25ee0e5b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:08.093109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6e6a0-ba72-48eb-b609-685a25ee0e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:08.093570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6e6a0-ba72-48eb-b609-685a25ee0e5b None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:08.094459 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6e6a0-ba72-48eb-b609-685a25ee0e5b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:08.094966 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6e6a0-ba72-48eb-b609-685a25ee0e5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:08.096541 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6e6a0-ba72-48eb-b609-685a25ee0e5b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:08.106663 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 388/806] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Jun 2 13:27:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:08.107936 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6e6a0-ba72-48eb-b609-685a25ee0e5b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:08.162812 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629ebe9-56a8-42fa-820a-b8bb926e18e9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:08.182043 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:08.203662 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce58fd2-ac8f-4202-a1c4-4b342af66082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:08.204612 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce58fd2-ac8f-4202-a1c4-4b342af66082 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:08.204965 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce58fd2-ac8f-4202-a1c4-4b342af66082 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:08.205304 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce58fd2-ac8f-4202-a1c4-4b342af66082 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:08.213944 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce58fd2-ac8f-4202-a1c4-4b342af66082 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:08.215950 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce58fd2-ac8f-4202-a1c4-4b342af66082 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:08.228601 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6e6a0-ba72-48eb-b609-685a25ee0e5b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:08.231895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-4ce58fd2-ac8f-4202-a1c4-4b342af66082 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:27:08.231895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:08.231895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:08.231895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:08.231895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:08.231895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:08.231895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:08.231895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:08.231895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:08.231895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:08.231895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:08.231895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:08.231895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:27:08.231895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:27:08.231895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:27:08.231895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:27:08.232956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:08.232956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:08.232956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:27:08.232956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:08.232956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:27:08.232956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:08.232956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:08.232956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:08.232956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:08.232956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:08.232956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:08.232956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:08.232956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:08.232956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:08.232956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:08.232956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:08.232956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:08.232956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:08.233892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:08.233892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:08.233892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:27:08.233892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:27:08.233892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:27:08.233892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:27:08.233892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:27:08.233892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:27:08.233892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:27:08.233892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:08.237858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 419/807] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 2 13:27:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:08.238751 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce58fd2-ac8f-4202-a1c4-4b342af66082 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:08.242370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:08.271390 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65303e-6c01-4db6-97bf-e1651ed26e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:08.272515 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65303e-6c01-4db6-97bf-e1651ed26e39 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:08.273046 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65303e-6c01-4db6-97bf-e1651ed26e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:08.273584 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65303e-6c01-4db6-97bf-e1651ed26e39 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:08.274781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65303e-6c01-4db6-97bf-e1651ed26e39 None admin] RBAC: Adding query filter params (name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:08.275285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65303e-6c01-4db6-97bf-e1651ed26e39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:08.277211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65303e-6c01-4db6-97bf-e1651ed26e39 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:08.287518 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 389/808] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 13:27:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:08.288740 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65303e-6c01-4db6-97bf-e1651ed26e39 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:08.352729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce58fd2-ac8f-4202-a1c4-4b342af66082 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:08.391994 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdd5ea-38e1-4fe0-969c-6439cd8a43b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:08.392689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdd5ea-38e1-4fe0-969c-6439cd8a43b1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:08.392969 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdd5ea-38e1-4fe0-969c-6439cd8a43b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:08.393249 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdd5ea-38e1-4fe0-969c-6439cd8a43b1 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:08.394089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cdd5ea-38e1-4fe0-969c-6439cd8a43b1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:08.394366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cdd5ea-38e1-4fe0-969c-6439cd8a43b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:08.396502 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cdd5ea-38e1-4fe0-969c-6439cd8a43b1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:08.409690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 420/809] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Jun 2 13:27:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:08.409690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdd5ea-38e1-4fe0-969c-6439cd8a43b1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:08.431647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65303e-6c01-4db6-97bf-e1651ed26e39 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:08.454404 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:08.480643 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04daca9d-489a-435a-8e61-f44aecd1bb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:08.481854 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04daca9d-489a-435a-8e61-f44aecd1bb04 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:08.482335 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04daca9d-489a-435a-8e61-f44aecd1bb04 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:08.482969 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04daca9d-489a-435a-8e61-f44aecd1bb04 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:08.484000 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04daca9d-489a-435a-8e61-f44aecd1bb04 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:08.484501 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04daca9d-489a-435a-8e61-f44aecd1bb04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:08.486288 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04daca9d-489a-435a-8e61-f44aecd1bb04 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:08.505407 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 390/810] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 2 13:27:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:08.506843 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04daca9d-489a-435a-8e61-f44aecd1bb04 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:08.523584 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdd5ea-38e1-4fe0-969c-6439cd8a43b1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:08.537119 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:08.561273 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4b691-7914-41f3-b577-d65604b2164d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:08.562086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4b691-7914-41f3-b577-d65604b2164d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:08.562366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4b691-7914-41f3-b577-d65604b2164d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:08.562654 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4b691-7914-41f3-b577-d65604b2164d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:08.573355 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4b691-7914-41f3-b577-d65604b2164d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:08.574951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4b691-7914-41f3-b577-d65604b2164d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:08.592465 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-8aa4b691-7914-41f3-b577-d65604b2164d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:08.592465 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:08.592465 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:08.592465 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:08.592465 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:08.592465 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:08.592465 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:08.592465 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:08.592465 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:08.592465 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:08.592465 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:08.592465 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:08.592465 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:08.592465 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:08.592465 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:08.593408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:08.593408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:08.593408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:08.593408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:08.593408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:08.593408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:08.593408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:08.593408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:08.593408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:08.593408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:08.593408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:08.593408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:08.593408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:08.593408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:08.593408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:08.593408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:08.593408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:08.594296 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:08.594296 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:08.594296 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:08.594296 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:08.594296 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 421/811] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:08.595369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4b691-7914-41f3-b577-d65604b2164d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:08.622240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04daca9d-489a-435a-8e61-f44aecd1bb04 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:08.663567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e12de0-6e1f-457d-862a-244d165c0a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:08.664248 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e12de0-6e1f-457d-862a-244d165c0a0e None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:08.664523 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e12de0-6e1f-457d-862a-244d165c0a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:08.664800 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e12de0-6e1f-457d-862a-244d165c0a0e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:08.665536 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e12de0-6e1f-457d-862a-244d165c0a0e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:08.666929 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e12de0-6e1f-457d-862a-244d165c0a0e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:08.688918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 391/812] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 2 13:27:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:27:08.692875 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb00d32-a33c-48f2-b82b-9ac79487a151 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:08.693387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb00d32-a33c-48f2-b82b-9ac79487a151 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:08.694105 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb00d32-a33c-48f2-b82b-9ac79487a151 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:08.701174 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 392/813] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:08.701174 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb00d32-a33c-48f2-b82b-9ac79487a151 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:08.711271 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:08.723171 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4b691-7914-41f3-b577-d65604b2164d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:08.770149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edaa8b9-a3b5-47a5-bb53-eaccb239563f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:08.771026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edaa8b9-a3b5-47a5-bb53-eaccb239563f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:08.771430 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edaa8b9-a3b5-47a5-bb53-eaccb239563f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:08.771803 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edaa8b9-a3b5-47a5-bb53-eaccb239563f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:08.806759 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:08.829114 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb00d32-a33c-48f2-b82b-9ac79487a151 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:08.857176 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edaa8b9-a3b5-47a5-bb53-eaccb239563f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:08.858853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edaa8b9-a3b5-47a5-bb53-eaccb239563f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:08.869184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e90fb5-15fb-4c90-b007-728509e1e9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:08.870479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e90fb5-15fb-4c90-b007-728509e1e9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:08.870957 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e90fb5-15fb-4c90-b007-728509e1e9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:08.871525 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e90fb5-15fb-4c90-b007-728509e1e9c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:08.872478 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e90fb5-15fb-4c90-b007-728509e1e9c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:08.872931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e90fb5-15fb-4c90-b007-728509e1e9c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:08.874471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e90fb5-15fb-4c90-b007-728509e1e9c8 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:08.887725 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 393/814] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:08.889326 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7eb9bb-b67f-4d5d-8d49-80a86a1dc93f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:08.889750 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7eb9bb-b67f-4d5d-8d49-80a86a1dc93f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:08.890162 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7eb9bb-b67f-4d5d-8d49-80a86a1dc93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:08.908357 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-8c7eb9bb-b67f-4d5d-8d49-80a86a1dc93f None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:08.909806 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8c7eb9bb-b67f-4d5d-8d49-80a86a1dc93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:08.966375 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:08.990673 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 422/815] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:27:08 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:27:08.991668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edaa8b9-a3b5-47a5-bb53-eaccb239563f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:09.010917 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 394/816] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:09.012135 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7eb9bb-b67f-4d5d-8d49-80a86a1dc93f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:09.107471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:09.115550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edaa8b9-a3b5-47a5-bb53-eaccb239563f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:09.140234 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7eb9bb-b67f-4d5d-8d49-80a86a1dc93f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:09.155880 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8875b29-02bc-4a1b-92ec-40e01dd328e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:09.157106 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8875b29-02bc-4a1b-92ec-40e01dd328e6 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:09.157682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8875b29-02bc-4a1b-92ec-40e01dd328e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:09.158127 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8875b29-02bc-4a1b-92ec-40e01dd328e6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:09.166297 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8875b29-02bc-4a1b-92ec-40e01dd328e6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:09.168286 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8875b29-02bc-4a1b-92ec-40e01dd328e6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:09.178928 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2492c-8dda-44a9-b64a-3b3ea314e79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:09.179742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2492c-8dda-44a9-b64a-3b3ea314e79d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:09.180022 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2492c-8dda-44a9-b64a-3b3ea314e79d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:09.180295 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2492c-8dda-44a9-b64a-3b3ea314e79d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:09.185577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-a8875b29-02bc-4a1b-92ec-40e01dd328e6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:27:09.185577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:09.185577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:09.185577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:09.185577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:09.185577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:09.185577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:09.185577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:09.185577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:09.185577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:09.185577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:09.185577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:09.185577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:27:09.185577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:27:09.185577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:27:09.185577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:27:09.186505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:09.186505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:09.186505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:27:09.186505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:09.186505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:27:09.186505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:09.186505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:09.186505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:09.186505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:09.186505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:09.186505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:09.186505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:09.186505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:09.186505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:09.186505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:09.186505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:09.186505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:09.186505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:09.187482 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:09.187482 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:09.187482 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:27:09.187482 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:27:09.187482 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:27:09.187482 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:27:09.187482 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:27:09.187482 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:27:09.187482 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:27:09.187482 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:09.194530 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2492c-8dda-44a9-b64a-3b3ea314e79d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:09.194530 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2492c-8dda-44a9-b64a-3b3ea314e79d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:09.194912 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 423/817] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 2 13:27:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:09.196123 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8875b29-02bc-4a1b-92ec-40e01dd328e6 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:09.212938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-bef2492c-8dda-44a9-b64a-3b3ea314e79d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:09.212938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:09.212938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:09.212938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:09.212938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:09.212938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:09.212938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:09.212938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:09.212938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:09.212938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:09.212938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:09.212938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:09.212938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:09.212938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:09.212938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:09.213887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:09.213887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:09.213887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:09.213887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:09.213887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:09.213887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:09.213887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:09.213887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:09.213887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:09.213887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:09.213887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:09.213887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:09.213887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:09.213887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:09.213887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:09.213887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:09.213887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:09.214806 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:09.214806 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:09.214806 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:09.214806 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:09.218912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 395/818] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:09.219934 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2492c-8dda-44a9-b64a-3b3ea314e79d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:09.251741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:09.305976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8875b29-02bc-4a1b-92ec-40e01dd328e6 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:09.333226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2492c-8dda-44a9-b64a-3b3ea314e79d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:09.340313 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5a9ba-ded0-4010-adb8-fd01c50a3118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:09.341677 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5a9ba-ded0-4010-adb8-fd01c50a3118 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:09.341965 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5a9ba-ded0-4010-adb8-fd01c50a3118 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:09.342244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5a9ba-ded0-4010-adb8-fd01c50a3118 None admin] PATH_INFO: `/v3/services/network` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:09.342938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5a9ba-ded0-4010-adb8-fd01c50a3118 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:09.345090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5a9ba-ded0-4010-adb8-fd01c50a3118 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:09.357086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-55f5a9ba-ded0-4010-adb8-fd01c50a3118 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:27:09.357086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:09.357086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:27:09.357086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:27:09.357086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:27:09.357086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:27:09.357086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:27:09.357086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:09.357086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:27:09.357086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:09.357086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:27:09.357086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:09.357086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:09.357086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:09.357086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:09.357086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:09.357086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:09.358089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:09.358089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:09.358089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:09.358089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:09.358089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:09.358089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:09.358089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:27:09.358089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:27:09.358089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:27:09.358089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:27:09.358089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:09.358089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:09.358089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:09.358089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:09.358089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:09.358089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:09.358959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:09.358959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:09.358959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:09.358959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:09.358959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:09.358959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:09.358959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:09.358959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:09.358959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:09.358959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:09.358959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:27:09.358959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:09.358959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:27:09.358959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:09.358959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 424/819] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:27:09 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:09.359745 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5a9ba-ded0-4010-adb8-fd01c50a3118 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:09.367803 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:09.380691 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5037d-fa20-4ced-9e24-77425f2f4bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:09.381382 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5037d-fa20-4ced-9e24-77425f2f4bef None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:09.381660 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5037d-fa20-4ced-9e24-77425f2f4bef None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:09.381933 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5037d-fa20-4ced-9e24-77425f2f4bef None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:09.382793 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5037d-fa20-4ced-9e24-77425f2f4bef None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:09.383100 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5037d-fa20-4ced-9e24-77425f2f4bef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:09.384605 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5037d-fa20-4ced-9e24-77425f2f4bef None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:09.402924 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 396/820] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Jun 2 13:27:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:09.404268 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449d97d-83f5-4824-9b25-0b7e72f56592 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:09.404555 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449d97d-83f5-4824-9b25-0b7e72f56592 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:09.404826 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449d97d-83f5-4824-9b25-0b7e72f56592 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:09.410042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 397/821] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:09.410042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449d97d-83f5-4824-9b25-0b7e72f56592 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:09.469490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5a9ba-ded0-4010-adb8-fd01c50a3118 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:09.483041 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:09.506594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc1c52-9992-4d31-9d25-85f7bd2be994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:09.507398 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc1c52-9992-4d31-9d25-85f7bd2be994 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:09.507732 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc1c52-9992-4d31-9d25-85f7bd2be994 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:09.508067 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc1c52-9992-4d31-9d25-85f7bd2be994 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:09.508786 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc1c52-9992-4d31-9d25-85f7bd2be994 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:09.509084 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc1c52-9992-4d31-9d25-85f7bd2be994 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:09.510442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc1c52-9992-4d31-9d25-85f7bd2be994 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:09.515020 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449d97d-83f5-4824-9b25-0b7e72f56592 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:09.523167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 425/822] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:09.523995 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc1c52-9992-4d31-9d25-85f7bd2be994 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:09.559865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421a347-d105-457f-9660-ae04198ebc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:09.560542 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421a347-d105-457f-9660-ae04198ebc07 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:09.560822 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421a347-d105-457f-9660-ae04198ebc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:09.561094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421a347-d105-457f-9660-ae04198ebc07 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:09.561795 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421a347-d105-457f-9660-ae04198ebc07 None admin] RBAC: Adding query filter params (name=network) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:09.562098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421a347-d105-457f-9660-ae04198ebc07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:09.563560 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421a347-d105-457f-9660-ae04198ebc07 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:09.568073 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 398/823] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 2 13:27:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:09.569263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaa298-ab02-4d00-b570-fdd884df7d12 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:09.569546 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaa298-ab02-4d00-b570-fdd884df7d12 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:09.569813 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaa298-ab02-4d00-b570-fdd884df7d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:09.588194 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-56eaa298-ab02-4d00-b570-fdd884df7d12 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:09.589376 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-56eaa298-ab02-4d00-b570-fdd884df7d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:09.640278 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:09.644405 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc1c52-9992-4d31-9d25-85f7bd2be994 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:09.665241 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 399/824] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:09.666276 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eaa298-ab02-4d00-b570-fdd884df7d12 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:09.690990 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7cec0-477c-4564-abeb-ec683d599c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:09.691894 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7cec0-477c-4564-abeb-ec683d599c46 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:09.692245 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7cec0-477c-4564-abeb-ec683d599c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:09.692591 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7cec0-477c-4564-abeb-ec683d599c46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:09.705016 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7cec0-477c-4564-abeb-ec683d599c46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:09.706557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7cec0-477c-4564-abeb-ec683d599c46 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:09.724853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-5fb7cec0-477c-4564-abeb-ec683d599c46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:09.724853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:09.724853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:09.724853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:09.724853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:09.724853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:09.724853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:09.724853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:09.724853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:09.724853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:09.724853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:09.724853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:09.724853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:09.724853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:09.724853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:09.725784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:09.725784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:09.725784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:09.725784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:09.725784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:09.725784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:09.725784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:09.725784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:09.725784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:09.725784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:09.725784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:09.725784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:09.725784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:09.725784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:09.725784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:09.725784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:09.725784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:09.726892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:09.726892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:09.726892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:09.726892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:09.726892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 426/825] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:09.727189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7cec0-477c-4564-abeb-ec683d599c46 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:09.752482 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:09.776716 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eaa298-ab02-4d00-b570-fdd884df7d12 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:09.812181 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75379461-4a89-44d5-8d48-1f416cb3198d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:09.812994 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75379461-4a89-44d5-8d48-1f416cb3198d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:09.813277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75379461-4a89-44d5-8d48-1f416cb3198d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:09.813544 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75379461-4a89-44d5-8d48-1f416cb3198d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:09.820368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75379461-4a89-44d5-8d48-1f416cb3198d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:09.821808 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75379461-4a89-44d5-8d48-1f416cb3198d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:09.832929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7cec0-477c-4564-abeb-ec683d599c46 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:09.835616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-75379461-4a89-44d5-8d48-1f416cb3198d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:09.835616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:09.835616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:09.835616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:09.835616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:09.835616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:09.835616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:09.835616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:09.835616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:09.835616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:09.835616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:09.835616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:09.835616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:27:09.835616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:27:09.835616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:27:09.836511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:27:09.836511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:09.836511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:09.836511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:09.836511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:09.836511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:09.836511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:09.836511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:09.836511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:09.836511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:09.836511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:09.836511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:09.836511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:09.836511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:09.836511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:09.836511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:09.836511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:09.837411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:27:09.837411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:27:09.837411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:27:09.837411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:27:09.837411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:27:09.837411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:27:09.837411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:09.837411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:09.837411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 400/826] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:27:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:09.838355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75379461-4a89-44d5-8d48-1f416cb3198d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:09.872753 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd884cf-ec14-49e4-a528-aa095d3843af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:09.873686 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd884cf-ec14-49e4-a528-aa095d3843af None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:09.874814 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd884cf-ec14-49e4-a528-aa095d3843af None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:09.875162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd884cf-ec14-49e4-a528-aa095d3843af None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:09.875947 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd884cf-ec14-49e4-a528-aa095d3843af None admin] RBAC: Adding query filter params (type=network) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:09.876324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd884cf-ec14-49e4-a528-aa095d3843af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:09.877778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd884cf-ec14-49e4-a528-aa095d3843af None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:09.878830 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:09.889165 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 427/827] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 2 13:27:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:09.889165 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd884cf-ec14-49e4-a528-aa095d3843af None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:09.948653 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75379461-4a89-44d5-8d48-1f416cb3198d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:09.986036 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e93cb-2da2-4bd9-9bca-6be839205fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:09.987005 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e93cb-2da2-4bd9-9bca-6be839205fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:09.987154 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:09.987437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e93cb-2da2-4bd9-9bca-6be839205fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:09.987797 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e93cb-2da2-4bd9-9bca-6be839205fc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:09.999062 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e93cb-2da2-4bd9-9bca-6be839205fc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:27:10.001430 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd884cf-ec14-49e4-a528-aa095d3843af None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:10.006647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-df4e93cb-2da2-4bd9-9bca-6be839205fc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:27:10.006647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:10.006647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:10.006647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:10.006647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:10.006647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:10.006647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:10.006647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:10.006647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:10.006647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:10.006647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:10.006647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:10.006647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:27:10.006647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:27:10.006647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:27:10.006647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:27:10.007599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:27:10.007599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:27:10.007599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:27:10.007599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:27:10.007599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:10.007599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:10.007599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:10.007599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:10.007599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:10.007599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:10.007599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:10.007599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:10.007599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:10.007599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:10.007599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:10.007599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:10.009086 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:10.009086 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:10.009086 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:10.009086 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:10.009086 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:27:10.009086 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:27:10.009086 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:27:10.009086 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:27:10.009086 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:27:10.009086 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:27:10.009086 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:27:10.009086 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:10.009086 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 401/828] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:27:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:10.009086 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e93cb-2da2-4bd9-9bca-6be839205fc6 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:10.045319 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57188b-f958-481d-9136-feccc30fc469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:10.046114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57188b-f958-481d-9136-feccc30fc469 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:10.046466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57188b-f958-481d-9136-feccc30fc469 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:10.046779 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57188b-f958-481d-9136-feccc30fc469 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:10.047512 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57188b-f958-481d-9136-feccc30fc469 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:10.047816 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57188b-f958-481d-9136-feccc30fc469 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:10.049209 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57188b-f958-481d-9136-feccc30fc469 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:10.061673 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 428/829] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:10.062494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57188b-f958-481d-9136-feccc30fc469 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:10.121507 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:10.127501 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e93cb-2da2-4bd9-9bca-6be839205fc6 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:10.172839 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57188b-f958-481d-9136-feccc30fc469 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:10.175169 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869772ce-1729-49b5-b0ad-13da40025a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:10.175902 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869772ce-1729-49b5-b0ad-13da40025a06 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:10.176186 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869772ce-1729-49b5-b0ad-13da40025a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:10.176458 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869772ce-1729-49b5-b0ad-13da40025a06 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:10.177241 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869772ce-1729-49b5-b0ad-13da40025a06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:10.177547 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869772ce-1729-49b5-b0ad-13da40025a06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:10.178996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869772ce-1729-49b5-b0ad-13da40025a06 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:10.191442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 402/830] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:27:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:10.192268 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869772ce-1729-49b5-b0ad-13da40025a06 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:10.216127 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7c426-3d8d-475f-ad18-9f2ea89b71c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:10.216730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7c426-3d8d-475f-ad18-9f2ea89b71c0 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:10.217018 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7c426-3d8d-475f-ad18-9f2ea89b71c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:10.217289 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7c426-3d8d-475f-ad18-9f2ea89b71c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:10.218038 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7c426-3d8d-475f-ad18-9f2ea89b71c0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:10.219490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7c426-3d8d-475f-ad18-9f2ea89b71c0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:10.240565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 429/831] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 2 13:27:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:27:10.241487 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7c426-3d8d-475f-ad18-9f2ea89b71c0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:10.252668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:10.334435 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869772ce-1729-49b5-b0ad-13da40025a06 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:10.382410 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003acec9-d027-46b9-8ae1-cb3ebaa889c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:10.383295 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003acec9-d027-46b9-8ae1-cb3ebaa889c0 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:10.383680 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003acec9-d027-46b9-8ae1-cb3ebaa889c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:10.384047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003acec9-d027-46b9-8ae1-cb3ebaa889c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:10.384907 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7c426-3d8d-475f-ad18-9f2ea89b71c0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:10.385039 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003acec9-d027-46b9-8ae1-cb3ebaa889c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:10.385416 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003acec9-d027-46b9-8ae1-cb3ebaa889c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:10.387144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003acec9-d027-46b9-8ae1-cb3ebaa889c0 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:10.403000 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 403/832] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:27:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:10.404300 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003acec9-d027-46b9-8ae1-cb3ebaa889c0 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:10.430941 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:10.434277 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad5a40-3d05-40e1-b335-4fb1c0cbc282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:10.435471 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad5a40-3d05-40e1-b335-4fb1c0cbc282 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:10.435926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad5a40-3d05-40e1-b335-4fb1c0cbc282 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:10.436333 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad5a40-3d05-40e1-b335-4fb1c0cbc282 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:10.446650 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad5a40-3d05-40e1-b335-4fb1c0cbc282 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:10.449370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad5a40-3d05-40e1-b335-4fb1c0cbc282 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:10.470163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-32ad5a40-3d05-40e1-b335-4fb1c0cbc282 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:10.470163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:10.470163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:10.470163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:10.470163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:10.470163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:10.470163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:10.470163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:10.470163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:10.470163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:10.470163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:10.470163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:10.470163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:27:10.470163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:27:10.470163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:27:10.471547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:27:10.471547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:10.471547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:10.471547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:10.471547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:10.471547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:10.471547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:10.471547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:10.471547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:10.471547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:10.471547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:10.471547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:10.471547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:10.471547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:10.471547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:10.471547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:10.471547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:10.472460 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:27:10.472460 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:27:10.472460 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:27:10.472460 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:27:10.472460 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:27:10.472460 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:27:10.472460 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:10.472460 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:10.472460 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 430/833] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:27:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:10.473438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad5a40-3d05-40e1-b335-4fb1c0cbc282 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:10.561633 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003acec9-d027-46b9-8ae1-cb3ebaa889c0 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:10.563650 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:10.599264 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfb5ea-0828-4421-8376-8a98dcdfa71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:10.600049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfb5ea-0828-4421-8376-8a98dcdfa71d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:10.600335 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfb5ea-0828-4421-8376-8a98dcdfa71d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:10.600609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfb5ea-0828-4421-8376-8a98dcdfa71d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:10.601439 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfb5ea-0828-4421-8376-8a98dcdfa71d None admin] RBAC: Adding query filter params (role.id=6edd584a77084fa78240661ea76cddb5, scope.project.id=af45a1ec7c94408bb638c55fb43fa961, user.id=5a0061e2927843cf86769d2beab18743) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:10.601747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfb5ea-0828-4421-8376-8a98dcdfa71d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:10.603211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfb5ea-0828-4421-8376-8a98dcdfa71d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:10.604680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad5a40-3d05-40e1-b335-4fb1c0cbc282 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:10.609641 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 404/834] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:27:10 2022] GET /identity/v3/role_assignments?user.id=5a0061e2927843cf86769d2beab18743&scope.project.id=af45a1ec7c94408bb638c55fb43fa961&role.id=6edd584a77084fa78240661ea76cddb5 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:10.610447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfb5ea-0828-4421-8376-8a98dcdfa71d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:10.663322 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449032e-e7b3-450f-a50c-3e44c911e55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:10.664250 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449032e-e7b3-450f-a50c-3e44c911e55e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:10.664533 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449032e-e7b3-450f-a50c-3e44c911e55e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:10.664811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449032e-e7b3-450f-a50c-3e44c911e55e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:10.681096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449032e-e7b3-450f-a50c-3e44c911e55e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:10.682679 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449032e-e7b3-450f-a50c-3e44c911e55e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:10.705406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-c449032e-e7b3-450f-a50c-3e44c911e55e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:10.705406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:10.705406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:10.705406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:10.705406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:10.705406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:10.705406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:10.705406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:10.705406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:10.705406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:10.705406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:10.705406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:10.705406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:10.705406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:10.705406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:10.706371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:10.706371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:10.706371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:10.706371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:10.706371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:10.706371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:10.706371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:10.706371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:10.706371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:10.706371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:10.706371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:10.706371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:10.706371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:10.706371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:10.706371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:10.706371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:10.706371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:10.707422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:10.707422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:10.707422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:10.707422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:10.710736 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 431/835] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:10.713224 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449032e-e7b3-450f-a50c-3e44c911e55e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:10.732253 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:10.761604 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfb5ea-0828-4421-8376-8a98dcdfa71d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:10.802358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f049a7-2cd5-487d-99d5-c597806ec4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:10.803123 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f049a7-2cd5-487d-99d5-c597806ec4cc None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:10.803372 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f049a7-2cd5-487d-99d5-c597806ec4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:10.803647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f049a7-2cd5-487d-99d5-c597806ec4cc None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:10.805118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f049a7-2cd5-487d-99d5-c597806ec4cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:10.805118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f049a7-2cd5-487d-99d5-c597806ec4cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:10.806219 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f049a7-2cd5-487d-99d5-c597806ec4cc None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:10.825655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 405/836] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:27:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:10.828149 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f049a7-2cd5-487d-99d5-c597806ec4cc None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:10.848357 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449032e-e7b3-450f-a50c-3e44c911e55e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:10.870895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:10.904984 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac42d1f-97c7-48e1-937f-8919d47bd55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:10.905808 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac42d1f-97c7-48e1-937f-8919d47bd55a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:10.906097 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac42d1f-97c7-48e1-937f-8919d47bd55a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:10.906370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac42d1f-97c7-48e1-937f-8919d47bd55a None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:10.907140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac42d1f-97c7-48e1-937f-8919d47bd55a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:10.907811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac42d1f-97c7-48e1-937f-8919d47bd55a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:10.910212 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac42d1f-97c7-48e1-937f-8919d47bd55a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:10.926241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 432/837] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:10.932866 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac42d1f-97c7-48e1-937f-8919d47bd55a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:10.956252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f049a7-2cd5-487d-99d5-c597806ec4cc None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:10.993657 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff233e42-f586-481f-9311-1bc915cd5d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:10.994614 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff233e42-f586-481f-9311-1bc915cd5d69 None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:10.995040 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff233e42-f586-481f-9311-1bc915cd5d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:10.995332 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff233e42-f586-481f-9311-1bc915cd5d69 None admin] PATH_INFO: `/v3/projects/af45a1ec7c94408bb638c55fb43fa961/users/cbf7d6db675047cbb3a3f16631c59622/roles/9dc761b84aa745ad920c76ddf9fb0b9e` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:11.007672 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:11.012080 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff233e42-f586-481f-9311-1bc915cd5d69 None admin] RBAC: Authorizing `identity:create_grant(project_id=af45a1ec7c94408bb638c55fb43fa961, user_id=cbf7d6db675047cbb3a3f16631c59622, role_id=9dc761b84aa745ad920c76ddf9fb0b9e)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:11.013778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff233e42-f586-481f-9311-1bc915cd5d69 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:11.031356 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 406/838] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 13:27:10 2022] PUT /identity/v3/projects/af45a1ec7c94408bb638c55fb43fa961/users/cbf7d6db675047cbb3a3f16631c59622/roles/9dc761b84aa745ad920c76ddf9fb0b9e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:27:11.063998 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac42d1f-97c7-48e1-937f-8919d47bd55a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:11.104214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5dff9-69ae-4ba8-a0b1-adfa8c4da8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:11.105059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5dff9-69ae-4ba8-a0b1-adfa8c4da8c7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:11.105339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5dff9-69ae-4ba8-a0b1-adfa8c4da8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:11.105654 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5dff9-69ae-4ba8-a0b1-adfa8c4da8c7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:11.110658 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd353688-81b4-4dba-84c5-37500930c108 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:11.110965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd353688-81b4-4dba-84c5-37500930c108 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:11.111331 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd353688-81b4-4dba-84c5-37500930c108 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:11.113338 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 407/839] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:11.115335 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5dff9-69ae-4ba8-a0b1-adfa8c4da8c7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:11.116831 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5dff9-69ae-4ba8-a0b1-adfa8c4da8c7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:11.119014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e39fee-942c-430f-8f7b-f0461a0bb450 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:11.119296 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e39fee-942c-430f-8f7b-f0461a0bb450 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:11.119572 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e39fee-942c-430f-8f7b-f0461a0bb450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:11.133614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-dfc5dff9-69ae-4ba8-a0b1-adfa8c4da8c7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:27:11.133614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:11.133614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:11.133614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:11.133614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:11.133614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:11.133614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:11.133614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:11.133614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:11.133614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:11.133614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:11.133614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:11.133614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:27:11.133614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:27:11.133614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:27:11.133614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:27:11.134648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:11.134648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:11.134648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:27:11.134648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:11.134648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:27:11.134648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:11.134648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:11.134648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:11.134648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:11.134648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:11.134648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:11.134648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:11.134648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:11.134648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:11.134648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:11.134648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:11.134648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:11.134648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:11.135599 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:11.135599 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:11.135599 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:27:11.135599 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:27:11.135599 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:27:11.135599 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:27:11.135599 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:27:11.135599 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:27:11.135599 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:27:11.135599 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:11.139669 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 433/840] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:27:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:11.141390 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5dff9-69ae-4ba8-a0b1-adfa8c4da8c7 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:11.142052 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-04e39fee-942c-430f-8f7b-f0461a0bb450 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:11.143370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-04e39fee-942c-430f-8f7b-f0461a0bb450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:11.182313 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:11.224294 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 408/841] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:27:11.247204 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e39fee-942c-430f-8f7b-f0461a0bb450 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:11.257564 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5dff9-69ae-4ba8-a0b1-adfa8c4da8c7 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:11.304682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab048992-133a-420e-8db4-04cea15ce8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:11.305378 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab048992-133a-420e-8db4-04cea15ce8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:11.305658 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab048992-133a-420e-8db4-04cea15ce8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:11.305933 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab048992-133a-420e-8db4-04cea15ce8e8 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:11.307344 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab048992-133a-420e-8db4-04cea15ce8e8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:11.307658 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab048992-133a-420e-8db4-04cea15ce8e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:11.309931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab048992-133a-420e-8db4-04cea15ce8e8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:11.335968 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 434/842] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Jun 2 13:27:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:11.337220 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab048992-133a-420e-8db4-04cea15ce8e8 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:11.367926 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e39fee-942c-430f-8f7b-f0461a0bb450 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:11.393825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:11.414195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b3399-321d-49f7-8cc3-848d82680676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:11.415448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b3399-321d-49f7-8cc3-848d82680676 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:11.415843 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b3399-321d-49f7-8cc3-848d82680676 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:11.416206 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b3399-321d-49f7-8cc3-848d82680676 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:11.417195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b3399-321d-49f7-8cc3-848d82680676 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:11.420124 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b3399-321d-49f7-8cc3-848d82680676 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:11.438355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-a51b3399-321d-49f7-8cc3-848d82680676 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:27:11.438355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:11.438355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:27:11.438355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:27:11.438355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:27:11.438355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:27:11.438355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:27:11.438355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:11.438355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:27:11.438355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:11.438355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:27:11.438355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:11.438355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:11.438355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:11.438355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:11.438355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:11.438355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:11.439446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:11.439446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:11.439446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:11.439446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:11.439446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:11.439446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:11.439446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:27:11.439446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:27:11.439446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:27:11.439446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:27:11.439446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:11.439446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:11.439446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:11.439446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:11.439446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:11.439446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:11.440267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:11.440267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:11.440267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:11.440267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:11.440267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:11.440267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:11.440267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:11.440267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:11.440267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:11.440267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:11.440267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:27:11.440267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:11.440267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:27:11.440267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:11.443489 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 409/843] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 13:27:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:11.450624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b3399-321d-49f7-8cc3-848d82680676 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:11.455759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:11.460050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab048992-133a-420e-8db4-04cea15ce8e8 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:11.499939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4f2ca-7835-4635-9755-82d9f7ef7b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:11.501497 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4f2ca-7835-4635-9755-82d9f7ef7b46 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:11.502114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4f2ca-7835-4635-9755-82d9f7ef7b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:11.502720 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4f2ca-7835-4635-9755-82d9f7ef7b46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:11.564861 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b3399-321d-49f7-8cc3-848d82680676 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:11.600264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4f2ca-7835-4635-9755-82d9f7ef7b46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:11.602233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4f2ca-7835-4635-9755-82d9f7ef7b46 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:11.607731 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79ad6c-b73b-46d8-a91e-10a53f5314e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:11.608448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79ad6c-b73b-46d8-a91e-10a53f5314e6 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:11.608695 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79ad6c-b73b-46d8-a91e-10a53f5314e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:11.608962 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79ad6c-b73b-46d8-a91e-10a53f5314e6 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:11.609670 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79ad6c-b73b-46d8-a91e-10a53f5314e6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:11.609974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79ad6c-b73b-46d8-a91e-10a53f5314e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:11.611429 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79ad6c-b73b-46d8-a91e-10a53f5314e6 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:11.621019 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 410/844] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 13:27:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:11.621896 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79ad6c-b73b-46d8-a91e-10a53f5314e6 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:11.687136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:11.722149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:11.735183 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 435/845] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:27:11 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 13:27:11.740479 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4f2ca-7835-4635-9755-82d9f7ef7b46 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:11.753018 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79ad6c-b73b-46d8-a91e-10a53f5314e6 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:11.790274 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eddf95-55f0-4ea3-8b30-9a98323d5bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:11.791439 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eddf95-55f0-4ea3-8b30-9a98323d5bfc None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:11.792093 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eddf95-55f0-4ea3-8b30-9a98323d5bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:11.792562 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eddf95-55f0-4ea3-8b30-9a98323d5bfc None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:11.793538 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eddf95-55f0-4ea3-8b30-9a98323d5bfc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:11.794112 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eddf95-55f0-4ea3-8b30-9a98323d5bfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:11.795710 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eddf95-55f0-4ea3-8b30-9a98323d5bfc None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:11.806609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 411/846] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 13:27:11 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:11.845833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4f2ca-7835-4635-9755-82d9f7ef7b46 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:11.895955 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139c07f-c422-4a2c-a0b6-239b3cc1196b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:11.896825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139c07f-c422-4a2c-a0b6-239b3cc1196b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:11.897102 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139c07f-c422-4a2c-a0b6-239b3cc1196b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:11.897367 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139c07f-c422-4a2c-a0b6-239b3cc1196b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:11.909879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139c07f-c422-4a2c-a0b6-239b3cc1196b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:11.911455 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139c07f-c422-4a2c-a0b6-239b3cc1196b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:11.931463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-1139c07f-c422-4a2c-a0b6-239b3cc1196b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:11.931463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:11.931463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:11.931463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:11.931463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:11.931463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:11.931463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:11.931463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:11.931463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:11.931463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:11.931463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:11.931463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:11.931463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:11.931463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:11.931463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:11.932423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:11.932423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:11.932423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:11.932423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:11.932423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:11.932423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:11.932423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:11.932423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:11.932423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:11.932423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:11.932423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:11.932423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:11.932423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:11.932423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:11.932423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:11.932423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:11.932423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:11.933338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:11.933338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:11.933338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:11.933338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:11.937857 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 436/847] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:11.939969 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eddf95-55f0-4ea3-8b30-9a98323d5bfc None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:12.055910 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eddf95-55f0-4ea3-8b30-9a98323d5bfc None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:12.070465 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:12.096530 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78399ee-89de-4547-b526-c1e9ece1875c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:12.097248 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78399ee-89de-4547-b526-c1e9ece1875c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:12.097529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78399ee-89de-4547-b526-c1e9ece1875c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:12.097801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78399ee-89de-4547-b526-c1e9ece1875c None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:12.098519 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78399ee-89de-4547-b526-c1e9ece1875c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:12.098856 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78399ee-89de-4547-b526-c1e9ece1875c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:12.100216 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78399ee-89de-4547-b526-c1e9ece1875c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:12.116398 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 412/848] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:12.118368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139c07f-c422-4a2c-a0b6-239b3cc1196b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:12.167442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:12.219829 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139c07f-c422-4a2c-a0b6-239b3cc1196b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:12.260492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d352522-0bec-48f5-9bfe-e06a09494bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:12.261307 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d352522-0bec-48f5-9bfe-e06a09494bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:12.261581 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d352522-0bec-48f5-9bfe-e06a09494bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:12.261982 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d352522-0bec-48f5-9bfe-e06a09494bb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:12.269737 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d352522-0bec-48f5-9bfe-e06a09494bb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:12.271220 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d352522-0bec-48f5-9bfe-e06a09494bb1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:12.286432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-4d352522-0bec-48f5-9bfe-e06a09494bb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:12.286432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:12.286432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:12.286432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:12.286432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:12.286432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:12.286432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:12.286432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:12.286432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:12.286432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:12.286432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:12.286432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:12.286432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:27:12.286432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:27:12.286432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:27:12.287442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:27:12.287442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:12.287442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:12.287442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:12.287442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:12.287442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:12.287442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:12.287442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:12.287442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:12.287442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:12.287442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:12.287442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:12.287442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:12.287442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:12.287442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:12.287442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:12.287442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:12.288363 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:27:12.288363 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:27:12.288363 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:27:12.288363 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:27:12.288363 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:27:12.288363 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:27:12.288363 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:12.288363 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:12.292696 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 437/849] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:27:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:12.294197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78399ee-89de-4547-b526-c1e9ece1875c None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:12.411217 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78399ee-89de-4547-b526-c1e9ece1875c None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:12.446328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92baa9-19c6-471a-87a6-0c6c8e03e524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:12.447025 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92baa9-19c6-471a-87a6-0c6c8e03e524 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:12.447303 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92baa9-19c6-471a-87a6-0c6c8e03e524 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:12.447574 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92baa9-19c6-471a-87a6-0c6c8e03e524 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:12.448356 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92baa9-19c6-471a-87a6-0c6c8e03e524 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:12.448659 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92baa9-19c6-471a-87a6-0c6c8e03e524 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:12.450332 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92baa9-19c6-471a-87a6-0c6c8e03e524 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:12.466681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 413/850] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:27:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:12.469253 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d352522-0bec-48f5-9bfe-e06a09494bb1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:12.573312 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d352522-0bec-48f5-9bfe-e06a09494bb1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:12.581306 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:12.609931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786b8dd-cc52-42ae-9eb8-fa9650d34571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:12.610624 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786b8dd-cc52-42ae-9eb8-fa9650d34571 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:12.610906 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786b8dd-cc52-42ae-9eb8-fa9650d34571 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:12.611306 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786b8dd-cc52-42ae-9eb8-fa9650d34571 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:12.612144 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786b8dd-cc52-42ae-9eb8-fa9650d34571 None admin] RBAC: Adding query filter params (role.id=6edd584a77084fa78240661ea76cddb5, scope.project.id=af45a1ec7c94408bb638c55fb43fa961, user.id=8cd0e37b0404419bb5752228bd809be4) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:12.612450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786b8dd-cc52-42ae-9eb8-fa9650d34571 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:12.613885 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786b8dd-cc52-42ae-9eb8-fa9650d34571 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:12.626709 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 438/851] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:27:12 2022] GET /identity/v3/role_assignments?user.id=8cd0e37b0404419bb5752228bd809be4&scope.project.id=af45a1ec7c94408bb638c55fb43fa961&role.id=6edd584a77084fa78240661ea76cddb5 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:13.099271 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b684a4-bdfd-4240-af48-48a0b52ee786 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:13.099901 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b684a4-bdfd-4240-af48-48a0b52ee786 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:13.099901 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b684a4-bdfd-4240-af48-48a0b52ee786 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:13.101473 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 414/852] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:13.107258 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d5dc8-f83d-45ce-a115-11557c24ce6d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:13.107827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d5dc8-f83d-45ce-a115-11557c24ce6d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:13.108325 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d5dc8-f83d-45ce-a115-11557c24ce6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:13.126073 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-932d5dc8-f83d-45ce-a115-11557c24ce6d None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:13.127615 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-932d5dc8-f83d-45ce-a115-11557c24ce6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:13.210683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 439/853] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:13.227286 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b684a4-bdfd-4240-af48-48a0b52ee786 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:13.259724 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:13.337141 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b684a4-bdfd-4240-af48-48a0b52ee786 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:13.372010 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b8dd3-0610-42e1-bf93-dce0aff68b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:13.372754 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b8dd3-0610-42e1-bf93-dce0aff68b78 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:13.373035 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b8dd3-0610-42e1-bf93-dce0aff68b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:13.373306 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b8dd3-0610-42e1-bf93-dce0aff68b78 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:13.373964 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b8dd3-0610-42e1-bf93-dce0aff68b78 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:13.375352 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b8dd3-0610-42e1-bf93-dce0aff68b78 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:13.388082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-006b8dd3-0610-42e1-bf93-dce0aff68b78 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:27:13.388082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:13.388082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:27:13.388082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:27:13.388082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:27:13.388082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:27:13.388082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:27:13.388082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:13.388082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:27:13.388082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:13.388082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:27:13.388082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:13.388082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:13.388082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:13.388082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:13.388082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:13.389118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:13.389118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:13.389118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:13.389118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:13.389118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:13.389118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:13.389118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:13.389118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:27:13.389118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:27:13.389118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:27:13.389118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:27:13.389118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:13.389118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:13.389118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:13.389118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:13.389118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:13.390032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:13.390032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:13.390032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:13.390032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:13.390032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:13.390032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:13.390032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:13.390032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:13.390032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:13.390032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:13.390032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:13.390032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:27:13.390032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:13.390032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:27:13.390032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:13.390032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 415/854] 10.222.0.18 () {56 vars in 1132 bytes} [Thu Jun 2 13:27:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:13.393436 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f33c11-5ed9-4d43-8832-3299a666cf36 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:13.393950 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f33c11-5ed9-4d43-8832-3299a666cf36 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:13.394645 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f33c11-5ed9-4d43-8832-3299a666cf36 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:13.395168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b8dd3-0610-42e1-bf93-dce0aff68b78 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:13.396784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 440/855] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:13.406215 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2301715-ca6e-42f9-b6d1-e3cf86b8b958 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:13.406529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2301715-ca6e-42f9-b6d1-e3cf86b8b958 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:13.406852 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2301715-ca6e-42f9-b6d1-e3cf86b8b958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:13.431497 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c2301715-ca6e-42f9-b6d1-e3cf86b8b958 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:13.432793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c2301715-ca6e-42f9-b6d1-e3cf86b8b958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:13.516190 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 441/856] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:13.528943 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b8dd3-0610-42e1-bf93-dce0aff68b78 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:13.530914 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:13.545753 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2301715-ca6e-42f9-b6d1-e3cf86b8b958 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:13.567613 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b6d07-f8f1-40b9-8488-ad85b074703a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:13.568292 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b6d07-f8f1-40b9-8488-ad85b074703a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:13.568571 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b6d07-f8f1-40b9-8488-ad85b074703a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:13.568841 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b6d07-f8f1-40b9-8488-ad85b074703a None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:13.569729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b6d07-f8f1-40b9-8488-ad85b074703a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:13.569964 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b6d07-f8f1-40b9-8488-ad85b074703a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:13.571429 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b6d07-f8f1-40b9-8488-ad85b074703a None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:13.577249 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 416/857] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 2 13:27:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:13.582824 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b6d07-f8f1-40b9-8488-ad85b074703a None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:13.585327 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:13.690229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2301715-ca6e-42f9-b6d1-e3cf86b8b958 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:13.703166 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b6d07-f8f1-40b9-8488-ad85b074703a None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:13.727772 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bef83-744d-41df-8fae-7e2c991f34b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:13.728791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bef83-744d-41df-8fae-7e2c991f34b1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:13.729324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bef83-744d-41df-8fae-7e2c991f34b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:13.729691 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bef83-744d-41df-8fae-7e2c991f34b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:13.740811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bef83-744d-41df-8fae-7e2c991f34b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:27:13.748989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-478bef83-744d-41df-8fae-7e2c991f34b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:27:13.748989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:13.748989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:13.748989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:13.748989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:13.748989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:13.748989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:13.748989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:13.748989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:13.748989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:13.748989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:13.748989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:13.748989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:27:13.748989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:27:13.748989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:27:13.748989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:27:13.750155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:27:13.750155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:27:13.750155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:27:13.750155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:27:13.750155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:13.750155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:13.750155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:13.750155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:13.750155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:13.750155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:13.750155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:13.750155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:13.750155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:13.750155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:13.750155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:13.750155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:13.751275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:13.751275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:13.751275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:13.751275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:13.751275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:27:13.751275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:27:13.751275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:27:13.751275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:27:13.751275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:27:13.751275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:27:13.751275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:27:13.751275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:13.752466 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e0e4d-417b-47e0-82d7-6cb27ae42015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:13.757961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e0e4d-417b-47e0-82d7-6cb27ae42015 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:13.758109 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 442/858] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 13:27:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:13.758205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e0e4d-417b-47e0-82d7-6cb27ae42015 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:13.758205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e0e4d-417b-47e0-82d7-6cb27ae42015 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:13.758205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e0e4d-417b-47e0-82d7-6cb27ae42015 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:13.758205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e0e4d-417b-47e0-82d7-6cb27ae42015 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:13.758205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e0e4d-417b-47e0-82d7-6cb27ae42015 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:13.759034 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bef83-744d-41df-8fae-7e2c991f34b1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:13.766329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 417/859] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 2 13:27:13 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:13.876495 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:13.889252 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bef83-744d-41df-8fae-7e2c991f34b1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:13.928178 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8f260-4fe5-46d3-9def-38ce6bd6caf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:13.929403 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8f260-4fe5-46d3-9def-38ce6bd6caf0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:13.929898 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8f260-4fe5-46d3-9def-38ce6bd6caf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:13.930385 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8f260-4fe5-46d3-9def-38ce6bd6caf0 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:13.931404 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8f260-4fe5-46d3-9def-38ce6bd6caf0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:13.931935 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8f260-4fe5-46d3-9def-38ce6bd6caf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:13.934074 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8f260-4fe5-46d3-9def-38ce6bd6caf0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:13.944279 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 443/860] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 13:27:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:13.951159 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e0e4d-417b-47e0-82d7-6cb27ae42015 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:13.982926 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:14.068167 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e0e4d-417b-47e0-82d7-6cb27ae42015 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:14.109023 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b4105-cb10-45f8-9418-687a0e19da52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:14.109835 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b4105-cb10-45f8-9418-687a0e19da52 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:14.110115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b4105-cb10-45f8-9418-687a0e19da52 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:14.110388 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b4105-cb10-45f8-9418-687a0e19da52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:14.121896 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b4105-cb10-45f8-9418-687a0e19da52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:14.123360 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b4105-cb10-45f8-9418-687a0e19da52 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:14.141385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-716b4105-cb10-45f8-9418-687a0e19da52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:14.141385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:14.141385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:14.141385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:14.141385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:14.141385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:14.141385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:14.141385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:14.141385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:14.141385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:14.141385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:14.141385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:14.141385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:14.141385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:14.141385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:14.142325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:14.142325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:14.142325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:14.142325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:14.142325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:14.142325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:14.142325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:14.142325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:14.142325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:14.142325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:14.142325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:14.142325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:14.142325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:14.142325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:14.142325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:14.142325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:14.142325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:14.143267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:14.143267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:14.143267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:14.143267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:14.143267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 418/861] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:14.156020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8f260-4fe5-46d3-9def-38ce6bd6caf0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:14.197703 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8fc3e-352a-43e9-81b4-3abefe11827e None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:14.198043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8fc3e-352a-43e9-81b4-3abefe11827e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:14.198256 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8fc3e-352a-43e9-81b4-3abefe11827e None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:14.200556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 419/862] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:14.205848 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230f03a-dd14-49e8-8a23-f02d1f06d6f0 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:14.206132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230f03a-dd14-49e8-8a23-f02d1f06d6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:14.206405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230f03a-dd14-49e8-8a23-f02d1f06d6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:14.229625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-9230f03a-dd14-49e8-8a23-f02d1f06d6f0 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:14.232249 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9230f03a-dd14-49e8-8a23-f02d1f06d6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:14.274065 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8f260-4fe5-46d3-9def-38ce6bd6caf0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:14.318663 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77302c40-a479-4d47-aa59-5ec3418535f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:14.319390 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77302c40-a479-4d47-aa59-5ec3418535f8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:14.319668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77302c40-a479-4d47-aa59-5ec3418535f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:14.319984 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77302c40-a479-4d47-aa59-5ec3418535f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:14.322827 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 420/863] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:14.323242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77302c40-a479-4d47-aa59-5ec3418535f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:14.323242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77302c40-a479-4d47-aa59-5ec3418535f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:14.323242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77302c40-a479-4d47-aa59-5ec3418535f8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:14.338646 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 444/864] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:14.344638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230f03a-dd14-49e8-8a23-f02d1f06d6f0 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:14.351796 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77302c40-a479-4d47-aa59-5ec3418535f8 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:14.354165 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:14.368506 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:14.459080 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230f03a-dd14-49e8-8a23-f02d1f06d6f0 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:14.480963 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77302c40-a479-4d47-aa59-5ec3418535f8 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:14.495378 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac86a8-b3af-46e3-90b8-9698f7f4b16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:14.496412 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac86a8-b3af-46e3-90b8-9698f7f4b16d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:14.496892 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac86a8-b3af-46e3-90b8-9698f7f4b16d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:14.497204 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac86a8-b3af-46e3-90b8-9698f7f4b16d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:14.505016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac86a8-b3af-46e3-90b8-9698f7f4b16d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:14.506586 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac86a8-b3af-46e3-90b8-9698f7f4b16d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:14.522675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-15ac86a8-b3af-46e3-90b8-9698f7f4b16d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:27:14.522675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:14.522675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:14.522675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:14.522675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:14.522675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:14.522675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:14.522675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:14.522675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:14.522675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:14.522675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:14.522675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:14.522675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:27:14.522675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:27:14.522675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:27:14.522675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:27:14.523767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:14.523767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:14.523767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:27:14.523767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:14.523767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:27:14.523767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:14.523767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:14.523767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:14.523767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:14.523767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:14.523767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:14.523767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:14.523767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:14.523767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:14.523767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:14.523767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:14.523767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:14.523767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:14.524719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:14.524719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:14.524719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:27:14.524719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:27:14.524719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:27:14.524719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:27:14.524719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:27:14.524719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:27:14.524719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:27:14.524719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:14.525285 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c6f38-a16b-4b47-a218-6ebaad6e3340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:14.525285 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c6f38-a16b-4b47-a218-6ebaad6e3340 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:14.525285 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c6f38-a16b-4b47-a218-6ebaad6e3340 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:14.525285 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c6f38-a16b-4b47-a218-6ebaad6e3340 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:14.525568 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 421/865] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 2 13:27:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:14.525637 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c6f38-a16b-4b47-a218-6ebaad6e3340 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:14.530799 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c6f38-a16b-4b47-a218-6ebaad6e3340 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:14.533142 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac86a8-b3af-46e3-90b8-9698f7f4b16d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:14.554805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 445/866] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 13:27:14 2022] POST /identity/v3/services => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:27:14.609831 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:14.666117 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac86a8-b3af-46e3-90b8-9698f7f4b16d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:14.722961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1eb89-f087-42f1-bc07-7bf37796d3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:14.723588 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1eb89-f087-42f1-bc07-7bf37796d3ca None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:14.723870 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1eb89-f087-42f1-bc07-7bf37796d3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:14.724146 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1eb89-f087-42f1-bc07-7bf37796d3ca None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:14.725020 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1eb89-f087-42f1-bc07-7bf37796d3ca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:14.725332 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1eb89-f087-42f1-bc07-7bf37796d3ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:14.726881 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1eb89-f087-42f1-bc07-7bf37796d3ca None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:14.748951 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 422/867] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Jun 2 13:27:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:14.754742 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c6f38-a16b-4b47-a218-6ebaad6e3340 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:14.829124 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:14.861894 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c6f38-a16b-4b47-a218-6ebaad6e3340 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:14.895640 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6a2cd-743c-471d-9cde-35632ef69a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:14.896301 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6a2cd-743c-471d-9cde-35632ef69a0e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:14.896578 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6a2cd-743c-471d-9cde-35632ef69a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:14.896845 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6a2cd-743c-471d-9cde-35632ef69a0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:14.964453 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6a2cd-743c-471d-9cde-35632ef69a0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:14.966084 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6a2cd-743c-471d-9cde-35632ef69a0e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:15.036569 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:15.068833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 446/868] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:27:14 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:27:15.073647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30efaa-81cf-4de3-bdb1-b7a44511e6c4 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:15.073943 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30efaa-81cf-4de3-bdb1-b7a44511e6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:15.074260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30efaa-81cf-4de3-bdb1-b7a44511e6c4 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:15.078392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6a2cd-743c-471d-9cde-35632ef69a0e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:15.079436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 423/869] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:15.086758 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76899261-7783-4fae-bfe9-84765ad58c52 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:15.086758 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76899261-7783-4fae-bfe9-84765ad58c52 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:15.086758 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76899261-7783-4fae-bfe9-84765ad58c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:15.107323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-76899261-7783-4fae-bfe9-84765ad58c52 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:15.108527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-76899261-7783-4fae-bfe9-84765ad58c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:15.194605 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 424/870] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:15 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:27:15.203991 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6a2cd-743c-471d-9cde-35632ef69a0e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:15.210842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76899261-7783-4fae-bfe9-84765ad58c52 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:15.244003 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1f673-b2fa-4939-aa8b-952933127059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:15.244966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1f673-b2fa-4939-aa8b-952933127059 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:15.245339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1f673-b2fa-4939-aa8b-952933127059 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:15.245613 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1f673-b2fa-4939-aa8b-952933127059 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:15.257261 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a1f673-b2fa-4939-aa8b-952933127059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:15.258767 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a1f673-b2fa-4939-aa8b-952933127059 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:15.260747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:15.280804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-74a1f673-b2fa-4939-aa8b-952933127059 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:15.280804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:15.280804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:15.280804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:15.280804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:15.280804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:15.280804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:15.280804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:15.280804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:15.280804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:15.280804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:15.280804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:15.280804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:15.280804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:15.280804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:15.281735 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:15.281735 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:15.281735 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:15.281735 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:15.281735 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:15.281735 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:15.281735 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:15.281735 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:15.281735 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:15.281735 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:15.281735 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:15.281735 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:15.281735 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:15.281735 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:15.281735 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:15.281735 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:15.281735 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:15.282798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:15.282798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:15.282798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:15.282798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:15.282798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 447/871] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:15.287578 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1f673-b2fa-4939-aa8b-952933127059 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:15.321259 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:15.324407 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76899261-7783-4fae-bfe9-84765ad58c52 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:15.373634 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9cf853-24f4-4e05-bcfe-b8985340be1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:15.374471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cf853-24f4-4e05-bcfe-b8985340be1d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:15.375032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cf853-24f4-4e05-bcfe-b8985340be1d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:15.375313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cf853-24f4-4e05-bcfe-b8985340be1d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:15.375974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9cf853-24f4-4e05-bcfe-b8985340be1d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:15.378474 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9cf853-24f4-4e05-bcfe-b8985340be1d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:15.393891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-8e9cf853-24f4-4e05-bcfe-b8985340be1d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:27:15.393891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:15.393891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:27:15.393891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:27:15.393891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:27:15.393891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:27:15.393891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:27:15.393891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:15.393891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:27:15.393891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:15.393891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:27:15.393891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:15.393891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:15.393891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:15.393891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:15.393891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:15.393891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:15.395215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:15.395215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:15.395215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:15.395215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:15.395215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:15.395215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:15.395215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:27:15.395215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:27:15.395215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:27:15.395215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:27:15.395215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:15.395215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:15.395215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:15.395215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:15.395215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:15.395215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:15.396078 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:15.396078 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:15.396078 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:15.396078 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:15.396078 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:15.396078 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:15.396078 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:15.396078 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:15.396078 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:15.396078 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:15.396078 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:27:15.396078 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:15.396078 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:27:15.396078 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:15.398705 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 425/872] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 2 13:27:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:15.403482 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9cf853-24f4-4e05-bcfe-b8985340be1d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:15.419643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1f673-b2fa-4939-aa8b-952933127059 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:15.468273 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b02af-ed8a-4b47-a0ae-bc12c809fe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:15.469341 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b02af-ed8a-4b47-a0ae-bc12c809fe9a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:15.469834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b02af-ed8a-4b47-a0ae-bc12c809fe9a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:15.470313 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b02af-ed8a-4b47-a0ae-bc12c809fe9a None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:15.471705 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b02af-ed8a-4b47-a0ae-bc12c809fe9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:15.473144 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b02af-ed8a-4b47-a0ae-bc12c809fe9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:15.475626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b02af-ed8a-4b47-a0ae-bc12c809fe9a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:15.495313 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 448/873] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:15.497333 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b02af-ed8a-4b47-a0ae-bc12c809fe9a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:15.534745 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9cf853-24f4-4e05-bcfe-b8985340be1d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:15.552722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:15.578860 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a8d45-f100-4c04-8169-503510e77165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:15.579560 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a8d45-f100-4c04-8169-503510e77165 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:15.579839 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a8d45-f100-4c04-8169-503510e77165 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:15.580113 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a8d45-f100-4c04-8169-503510e77165 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:15.580821 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a8d45-f100-4c04-8169-503510e77165 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:15.581126 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a8d45-f100-4c04-8169-503510e77165 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:15.582522 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a8d45-f100-4c04-8169-503510e77165 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:15.596618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 426/874] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 2 13:27:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:15.597830 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a8d45-f100-4c04-8169-503510e77165 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:15.613641 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:15.633754 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b02af-ed8a-4b47-a0ae-bc12c809fe9a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:15.675914 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19752957-a2ee-49b1-ac13-288961f9a645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:15.676953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19752957-a2ee-49b1-ac13-288961f9a645 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:15.677241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19752957-a2ee-49b1-ac13-288961f9a645 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:15.677515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19752957-a2ee-49b1-ac13-288961f9a645 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:15.686245 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19752957-a2ee-49b1-ac13-288961f9a645 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:15.688566 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19752957-a2ee-49b1-ac13-288961f9a645 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:15.706118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-19752957-a2ee-49b1-ac13-288961f9a645 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:15.706118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:15.706118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:15.706118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:15.706118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:15.706118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:15.706118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:15.706118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:15.706118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:15.706118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:15.706118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:15.706118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:15.706118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:27:15.706118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:27:15.706118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:27:15.707174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:27:15.707174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:15.707174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:15.707174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:15.707174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:15.707174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:15.707174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:15.707174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:15.707174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:15.707174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:15.707174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:15.707174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:15.707174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:15.707174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:15.707174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:15.707174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:15.707174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:15.708104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:27:15.708104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:27:15.708104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:27:15.708104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:27:15.708104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:27:15.708104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:27:15.708104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:15.708104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:15.710718 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 449/875] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:27:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:15.713008 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19752957-a2ee-49b1-ac13-288961f9a645 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:15.726173 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a8d45-f100-4c04-8169-503510e77165 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:15.764046 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c5e69-082f-40fc-92c1-d23c44b24134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:15.765000 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c5e69-082f-40fc-92c1-d23c44b24134 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:15.765184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c5e69-082f-40fc-92c1-d23c44b24134 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:15.765407 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c5e69-082f-40fc-92c1-d23c44b24134 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:15.766129 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c5e69-082f-40fc-92c1-d23c44b24134 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:15.766437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c5e69-082f-40fc-92c1-d23c44b24134 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:15.768053 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c5e69-082f-40fc-92c1-d23c44b24134 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:15.778937 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 427/876] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 2 13:27:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:15.838977 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19752957-a2ee-49b1-ac13-288961f9a645 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:15.879703 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372bdc0-aeab-45ab-b1b4-40cf123eea61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:15.880795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372bdc0-aeab-45ab-b1b4-40cf123eea61 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:15.881275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372bdc0-aeab-45ab-b1b4-40cf123eea61 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:15.881746 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372bdc0-aeab-45ab-b1b4-40cf123eea61 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:15.882840 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372bdc0-aeab-45ab-b1b4-40cf123eea61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:15.883387 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372bdc0-aeab-45ab-b1b4-40cf123eea61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:15.885057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372bdc0-aeab-45ab-b1b4-40cf123eea61 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:15.899059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 450/877] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:27:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:15.905993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c5e69-082f-40fc-92c1-d23c44b24134 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:15.954849 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:16.015626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c5e69-082f-40fc-92c1-d23c44b24134 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:16.051446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9fe75-c991-4b80-9598-bf9c867f97d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:16.052475 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9fe75-c991-4b80-9598-bf9c867f97d4 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:16.052975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9fe75-c991-4b80-9598-bf9c867f97d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:16.053469 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9fe75-c991-4b80-9598-bf9c867f97d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:16.054511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9fe75-c991-4b80-9598-bf9c867f97d4 None admin] RBAC: Adding query filter params (role.id=9dc761b84aa745ad920c76ddf9fb0b9e, scope.project.id=af45a1ec7c94408bb638c55fb43fa961, user.id=cbf7d6db675047cbb3a3f16631c59622) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:16.055051 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9fe75-c991-4b80-9598-bf9c867f97d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:16.056688 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9fe75-c991-4b80-9598-bf9c867f97d4 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:16.063620 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 428/878] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:27:15 2022] GET /identity/v3/role_assignments?user.id=cbf7d6db675047cbb3a3f16631c59622&scope.project.id=af45a1ec7c94408bb638c55fb43fa961&role.id=9dc761b84aa745ad920c76ddf9fb0b9e => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:16.166045 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a376cb-4292-41c9-bb85-9d6c495eef88 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:16.166390 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a376cb-4292-41c9-bb85-9d6c495eef88 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:16.166627 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a376cb-4292-41c9-bb85-9d6c495eef88 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:16.168451 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 451/879] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:16.174201 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481fde4-6a72-4087-81aa-3bea431a8ce7 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:16.174832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481fde4-6a72-4087-81aa-3bea431a8ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:16.175329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481fde4-6a72-4087-81aa-3bea431a8ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:16.193835 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-c481fde4-6a72-4087-81aa-3bea431a8ce7 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:16.195432 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c481fde4-6a72-4087-81aa-3bea431a8ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:16.272967 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 429/880] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:16 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:16.296396 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a376cb-4292-41c9-bb85-9d6c495eef88 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:16.301140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:16.409360 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a376cb-4292-41c9-bb85-9d6c495eef88 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:16.445452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819066f5-e24e-4cc8-aeee-375ea0cd1509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:16.446093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819066f5-e24e-4cc8-aeee-375ea0cd1509 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:16.446375 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819066f5-e24e-4cc8-aeee-375ea0cd1509 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:16.446666 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819066f5-e24e-4cc8-aeee-375ea0cd1509 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:16.447404 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819066f5-e24e-4cc8-aeee-375ea0cd1509 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:16.448843 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819066f5-e24e-4cc8-aeee-375ea0cd1509 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:16.466404 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 452/881] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 13:27:16 2022] POST /identity/v3/services => generated 269 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:27:16.969242 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b61dd-dd63-4bc9-93e5-aa214020bfac None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:16.969663 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b61dd-dd63-4bc9-93e5-aa214020bfac None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:16.969868 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b61dd-dd63-4bc9-93e5-aa214020bfac None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:16.971570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 430/882] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:16.977033 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1b3e8-aef0-46fc-9303-60c91ca1cd37 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:16.977505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1b3e8-aef0-46fc-9303-60c91ca1cd37 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:16.977597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1b3e8-aef0-46fc-9303-60c91ca1cd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:16.995195 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-57e1b3e8-aef0-46fc-9303-60c91ca1cd37 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:16.996439 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-57e1b3e8-aef0-46fc-9303-60c91ca1cd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:17.058721 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:17.078703 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 453/883] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:16 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:27:17.096792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b61dd-dd63-4bc9-93e5-aa214020bfac None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:17.132883 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:17.210646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b61dd-dd63-4bc9-93e5-aa214020bfac None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:17.245466 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76860426-d0e0-4c05-8a00-fd65b566aa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:17.246252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76860426-d0e0-4c05-8a00-fd65b566aa81 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:17.246533 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76860426-d0e0-4c05-8a00-fd65b566aa81 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:17.246865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76860426-d0e0-4c05-8a00-fd65b566aa81 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:17.247522 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76860426-d0e0-4c05-8a00-fd65b566aa81 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:17.248891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76860426-d0e0-4c05-8a00-fd65b566aa81 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:17.260738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-76860426-d0e0-4c05-8a00-fd65b566aa81 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:27:17.260738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:17.260738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:27:17.260738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:27:17.260738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:27:17.260738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:27:17.260738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:27:17.260738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:17.260738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:27:17.260738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:17.260738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:27:17.260738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:17.260738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:17.260738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:17.260738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:17.260738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:17.260738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:17.261802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:17.261802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:17.261802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:17.261802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:17.261802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:17.261802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:17.261802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:27:17.261802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:27:17.261802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:27:17.261802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:27:17.261802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:17.261802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:17.261802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:17.261802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:17.261802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:17.261802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:17.262676 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:17.262676 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:17.262676 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:17.262676 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:17.262676 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:17.262676 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:17.262676 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:17.262676 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:17.262676 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:17.262676 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:17.262676 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:27:17.262676 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:17.262676 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:27:17.262676 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:17.262676 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 431/884] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 13:27:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:17.268365 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1b3e8-aef0-46fc-9303-60c91ca1cd37 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:17.366700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1b3e8-aef0-46fc-9303-60c91ca1cd37 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:17.404293 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfff2c0-eb6d-4600-819f-d16a119af9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:17.404967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfff2c0-eb6d-4600-819f-d16a119af9cd None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:17.405244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfff2c0-eb6d-4600-819f-d16a119af9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:17.405513 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfff2c0-eb6d-4600-819f-d16a119af9cd None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:17.406222 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfff2c0-eb6d-4600-819f-d16a119af9cd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:17.406519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfff2c0-eb6d-4600-819f-d16a119af9cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:17.407918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfff2c0-eb6d-4600-819f-d16a119af9cd None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:17.417839 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 454/885] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 13:27:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:17.419475 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76860426-d0e0-4c05-8a00-fd65b566aa81 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:17.534020 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:17.536945 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76860426-d0e0-4c05-8a00-fd65b566aa81 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:17.573224 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a5626-ee74-4b9f-89e0-dcace2df9af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:17.573908 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a5626-ee74-4b9f-89e0-dcace2df9af1 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:17.574249 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a5626-ee74-4b9f-89e0-dcace2df9af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:17.574525 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a5626-ee74-4b9f-89e0-dcace2df9af1 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:17.575265 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a5626-ee74-4b9f-89e0-dcace2df9af1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:17.575567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a5626-ee74-4b9f-89e0-dcace2df9af1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:17.576931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a5626-ee74-4b9f-89e0-dcace2df9af1 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:17.582488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 432/886] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 13:27:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:17.588107 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfff2c0-eb6d-4600-819f-d16a119af9cd None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:17.648685 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:17.699359 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfff2c0-eb6d-4600-819f-d16a119af9cd None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:17.734193 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826b89d-dd68-446a-8914-d2f20c054e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:17.734909 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826b89d-dd68-446a-8914-d2f20c054e53 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:17.735192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826b89d-dd68-446a-8914-d2f20c054e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:17.735468 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826b89d-dd68-446a-8914-d2f20c054e53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:17.736266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826b89d-dd68-446a-8914-d2f20c054e53 None admin] RBAC: Adding query filter params (interface=public, service_id=89ca08f4b85c48b0ba70e2e2cd2be34f, region_id=RegionOne) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:17.736576 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826b89d-dd68-446a-8914-d2f20c054e53 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:17.737941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826b89d-dd68-446a-8914-d2f20c054e53 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:17.743776 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 455/887] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jun 2 13:27:17 2022] GET /identity/v3/endpoints?service_id=89ca08f4b85c48b0ba70e2e2cd2be34f&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:17.749632 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a5626-ee74-4b9f-89e0-dcace2df9af1 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:17.849151 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a5626-ee74-4b9f-89e0-dcace2df9af1 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:17.882772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01bd19-6d4c-4b9f-a0cf-d3ab584b1f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:17.883345 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01bd19-6d4c-4b9f-a0cf-d3ab584b1f74 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:17.883622 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01bd19-6d4c-4b9f-a0cf-d3ab584b1f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:17.883898 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01bd19-6d4c-4b9f-a0cf-d3ab584b1f74 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:17.884573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01bd19-6d4c-4b9f-a0cf-d3ab584b1f74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:17.885925 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01bd19-6d4c-4b9f-a0cf-d3ab584b1f74 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:17.898782 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 433/888] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 2 13:27:17 2022] GET /identity/v3/services => generated 1268 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:27:18.307515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bb9ab-1dfa-4f5d-a2bc-341ada037252 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:18.308236 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bb9ab-1dfa-4f5d-a2bc-341ada037252 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:18.308487 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bb9ab-1dfa-4f5d-a2bc-341ada037252 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:18.311425 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 456/889] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:18.320478 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fc3ac-36a3-4283-923b-e892aad59c38 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:18.321490 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fc3ac-36a3-4283-923b-e892aad59c38 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:18.321490 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fc3ac-36a3-4283-923b-e892aad59c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:18.347743 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-662fc3ac-36a3-4283-923b-e892aad59c38 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:18.349540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-662fc3ac-36a3-4283-923b-e892aad59c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:18.390081 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:18.467484 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 434/890] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:18.506556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bb9ab-1dfa-4f5d-a2bc-341ada037252 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:18.625700 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed1dc5-6ef6-4b29-a87f-4990a7fc5409 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:18.626410 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed1dc5-6ef6-4b29-a87f-4990a7fc5409 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:18.626916 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed1dc5-6ef6-4b29-a87f-4990a7fc5409 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:18.628762 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 435/891] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:27:18.634798 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9da38-23b8-4d24-b89e-a928f7d4f78a None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:18.635306 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9da38-23b8-4d24-b89e-a928f7d4f78a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:18.635783 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9da38-23b8-4d24-b89e-a928f7d4f78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:18.654111 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d6c9da38-23b8-4d24-b89e-a928f7d4f78a None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:18.655726 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d6c9da38-23b8-4d24-b89e-a928f7d4f78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:18.691504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bb9ab-1dfa-4f5d-a2bc-341ada037252 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:18.716811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:18.736371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10e89a-27bb-4d97-a40e-37d0c0235640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:18.737474 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10e89a-27bb-4d97-a40e-37d0c0235640 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:18.737977 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10e89a-27bb-4d97-a40e-37d0c0235640 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:18.738475 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10e89a-27bb-4d97-a40e-37d0c0235640 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:18.739443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10e89a-27bb-4d97-a40e-37d0c0235640 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:18.741071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10e89a-27bb-4d97-a40e-37d0c0235640 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:18.748715 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 436/892] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:27:18.763728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 457/893] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 13:27:18 2022] POST /identity/v3/services => generated 241 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:27:18.770299 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9da38-23b8-4d24-b89e-a928f7d4f78a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:18.868398 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:18.881776 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9da38-23b8-4d24-b89e-a928f7d4f78a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:18.926650 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5d437-b905-45db-be20-73be20079e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:18.927497 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5d437-b905-45db-be20-73be20079e27 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:18.927777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5d437-b905-45db-be20-73be20079e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:18.928050 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5d437-b905-45db-be20-73be20079e27 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:18.940775 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5d437-b905-45db-be20-73be20079e27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:27:18.949205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-21d5d437-b905-45db-be20-73be20079e27 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:27:18.949205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:18.949205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:18.949205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:18.949205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:18.949205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:18.949205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:18.949205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:18.949205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:18.949205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:18.949205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:18.949205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:18.949205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:27:18.949205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:27:18.949205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:27:18.949205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:27:18.950195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:27:18.950195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:27:18.950195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:27:18.950195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:27:18.950195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:18.950195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:18.950195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:18.950195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:18.950195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:18.950195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:18.950195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:18.950195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:18.950195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:18.950195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:18.950195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:18.950195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:18.951098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:18.951098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:18.951098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:18.951098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:18.951098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:27:18.951098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:27:18.951098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:27:18.951098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:27:18.951098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:27:18.951098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:27:18.951098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:27:18.951098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:18.951747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 437/894] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Jun 2 13:27:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:18.960243 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10e89a-27bb-4d97-a40e-37d0c0235640 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:19.020546 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550f67f-a2f4-4ed4-b0d8-20981a2702f5 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:19.020858 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550f67f-a2f4-4ed4-b0d8-20981a2702f5 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:19.021478 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550f67f-a2f4-4ed4-b0d8-20981a2702f5 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:19.022673 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 438/895] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:27:19.028206 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835374c-f8da-453e-9d8d-c60aef07b100 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:19.028900 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835374c-f8da-453e-9d8d-c60aef07b100 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:19.029281 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835374c-f8da-453e-9d8d-c60aef07b100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:19.051299 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-c835374c-f8da-453e-9d8d-c60aef07b100 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:19.052657 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c835374c-f8da-453e-9d8d-c60aef07b100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:19.083127 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10e89a-27bb-4d97-a40e-37d0c0235640 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:19.126958 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 439/896] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:27:19.137762 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87344e49-f4ac-4d68-be23-757a06f26f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:19.138402 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87344e49-f4ac-4d68-be23-757a06f26f2a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:19.142618 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87344e49-f4ac-4d68-be23-757a06f26f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:19.142618 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87344e49-f4ac-4d68-be23-757a06f26f2a None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:19.142618 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87344e49-f4ac-4d68-be23-757a06f26f2a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:19.142618 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87344e49-f4ac-4d68-be23-757a06f26f2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:19.142618 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87344e49-f4ac-4d68-be23-757a06f26f2a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:19.150399 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 458/897] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jun 2 13:27:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:19.156335 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835374c-f8da-453e-9d8d-c60aef07b100 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:19.158115 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87344e49-f4ac-4d68-be23-757a06f26f2a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:19.211144 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:19.245489 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:19.273773 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835374c-f8da-453e-9d8d-c60aef07b100 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:19.287251 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87344e49-f4ac-4d68-be23-757a06f26f2a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:19.316435 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212dd68-da6c-4d5d-8e41-7fc2af671838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:19.317261 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212dd68-da6c-4d5d-8e41-7fc2af671838 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:19.317543 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212dd68-da6c-4d5d-8e41-7fc2af671838 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:19.317817 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212dd68-da6c-4d5d-8e41-7fc2af671838 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:19.324353 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef1444-40a0-46d4-bf7d-b68d1fde2a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:19.325878 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef1444-40a0-46d4-bf7d-b68d1fde2a13 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:19.326355 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef1444-40a0-46d4-bf7d-b68d1fde2a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:19.326951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef1444-40a0-46d4-bf7d-b68d1fde2a13 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:19.327895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef1444-40a0-46d4-bf7d-b68d1fde2a13 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:19.329165 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212dd68-da6c-4d5d-8e41-7fc2af671838 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:19.330132 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef1444-40a0-46d4-bf7d-b68d1fde2a13 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:19.330646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212dd68-da6c-4d5d-8e41-7fc2af671838 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:19.343749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-60ef1444-40a0-46d4-bf7d-b68d1fde2a13 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:27:19.343749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:19.343749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:27:19.343749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:27:19.343749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:27:19.343749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:27:19.343749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:27:19.343749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:19.343749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:27:19.343749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:19.343749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:27:19.343749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:19.343749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:19.343749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:19.343749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:19.343749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:19.344719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:19.344719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:19.344719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:19.344719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:19.344719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:19.344719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:19.344719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:19.344719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:27:19.344719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:27:19.344719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:27:19.344719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:27:19.344719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:19.344719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:19.344719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:19.344719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:19.344719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:19.345545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:19.345545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:19.345545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:19.345545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:19.345545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:19.345545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:19.345545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:19.345545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:19.345545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:19.345545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:19.345545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:19.345545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:27:19.345545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:19.345545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:27:19.345545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:19.348413 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 459/898] 10.222.0.18 () {56 vars in 1132 bytes} [Thu Jun 2 13:27:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:19.349226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-b212dd68-da6c-4d5d-8e41-7fc2af671838 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:19.349226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:19.349226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:19.349226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:19.349226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:19.349226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:19.349226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:19.349226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:19.349226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:19.349226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:19.349226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:19.349226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:19.349226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:19.349226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:19.349226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:19.350055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:19.350055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:19.350055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:19.350055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:19.350055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:19.350055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:19.350055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:19.350055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:19.350055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:19.350055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:19.350055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:19.350055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:19.350055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:19.350055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:19.350055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:19.350055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:19.350055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:19.350985 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:19.350985 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:19.350985 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:19.350985 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:19.354938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 440/899] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:19.360609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212dd68-da6c-4d5d-8e41-7fc2af671838 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:19.360857 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef1444-40a0-46d4-bf7d-b68d1fde2a13 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:19.475670 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef1444-40a0-46d4-bf7d-b68d1fde2a13 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:19.479538 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:19.488859 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212dd68-da6c-4d5d-8e41-7fc2af671838 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:19.517382 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:19.528901 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356b6dd-1734-4eef-af60-2e589e5a0f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:19.528901 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356b6dd-1734-4eef-af60-2e589e5a0f72 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:19.529182 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356b6dd-1734-4eef-af60-2e589e5a0f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:19.529256 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356b6dd-1734-4eef-af60-2e589e5a0f72 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:19.530074 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356b6dd-1734-4eef-af60-2e589e5a0f72 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:19.530445 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356b6dd-1734-4eef-af60-2e589e5a0f72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:19.531911 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356b6dd-1734-4eef-af60-2e589e5a0f72 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:19.535572 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466dc16-90e3-4149-89ce-d58c193bff10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:19.536561 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466dc16-90e3-4149-89ce-d58c193bff10 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:19.537018 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466dc16-90e3-4149-89ce-d58c193bff10 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:19.537562 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466dc16-90e3-4149-89ce-d58c193bff10 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:19.538468 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466dc16-90e3-4149-89ce-d58c193bff10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:19.538968 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466dc16-90e3-4149-89ce-d58c193bff10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:19.540479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466dc16-90e3-4149-89ce-d58c193bff10 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:19.542595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 460/900] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 2 13:27:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:19.543469 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356b6dd-1734-4eef-af60-2e589e5a0f72 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:19.561738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 441/901] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:19.562589 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466dc16-90e3-4149-89ce-d58c193bff10 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:19.663676 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356b6dd-1734-4eef-af60-2e589e5a0f72 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:19.692179 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466dc16-90e3-4149-89ce-d58c193bff10 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:19.716482 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1e761-a76b-46d6-9779-ac586998dcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:19.718226 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1e761-a76b-46d6-9779-ac586998dcd5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:19.718857 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1e761-a76b-46d6-9779-ac586998dcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:19.719408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1e761-a76b-46d6-9779-ac586998dcd5 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:19.720617 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1e761-a76b-46d6-9779-ac586998dcd5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:19.721534 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1e761-a76b-46d6-9779-ac586998dcd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:19.723638 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1e761-a76b-46d6-9779-ac586998dcd5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:19.729375 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58123c53-90a2-48b5-8ece-a987ff8180ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:19.730505 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58123c53-90a2-48b5-8ece-a987ff8180ab None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:19.730911 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58123c53-90a2-48b5-8ece-a987ff8180ab None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:19.731395 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58123c53-90a2-48b5-8ece-a987ff8180ab None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:19.731819 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 461/902] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 2 13:27:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:19.737110 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1e761-a76b-46d6-9779-ac586998dcd5 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:19.743044 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58123c53-90a2-48b5-8ece-a987ff8180ab None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:19.744844 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58123c53-90a2-48b5-8ece-a987ff8180ab None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:19.760993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-58123c53-90a2-48b5-8ece-a987ff8180ab None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:27:19.760993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:19.760993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:19.760993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:19.760993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:19.760993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:19.760993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:19.760993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:19.760993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:19.760993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:19.760993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:19.760993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:19.760993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:27:19.760993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:27:19.760993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:27:19.760993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:27:19.762027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:19.762027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:19.762027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:27:19.762027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:19.762027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:27:19.762027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:19.762027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:19.762027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:19.762027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:19.762027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:19.762027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:19.762027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:19.762027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:19.762027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:19.762027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:19.762027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:19.762027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:19.762027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:19.763075 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:19.763075 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:19.763075 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:27:19.763075 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:27:19.763075 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:27:19.763075 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:27:19.763075 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:27:19.763075 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:27:19.763075 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:27:19.763075 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:19.765568 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 442/903] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 2 13:27:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:19.770977 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58123c53-90a2-48b5-8ece-a987ff8180ab None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:19.778414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:19.829352 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:19.879233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1e761-a76b-46d6-9779-ac586998dcd5 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:19.891206 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58123c53-90a2-48b5-8ece-a987ff8180ab None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:19.925669 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb6c5a-8232-4c9d-bbc9-781769ad6d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:19.926460 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb6c5a-8232-4c9d-bbc9-781769ad6d2f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:19.926785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb6c5a-8232-4c9d-bbc9-781769ad6d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:19.927057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb6c5a-8232-4c9d-bbc9-781769ad6d2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:19.927855 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb6c5a-8232-4c9d-bbc9-781769ad6d2f None admin] RBAC: Adding query filter params (interface=public, service_id=2b1b9a50f2bb4ecb99fbdbbdee07fc0e, region_id=RegionOne) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:19.928185 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb6c5a-8232-4c9d-bbc9-781769ad6d2f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:19.929632 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb6c5a-8232-4c9d-bbc9-781769ad6d2f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:19.931293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f8458-45f2-4c47-a582-1fcc3aa39006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:19.932200 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f8458-45f2-4c47-a582-1fcc3aa39006 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:19.932688 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f8458-45f2-4c47-a582-1fcc3aa39006 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:19.933151 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f8458-45f2-4c47-a582-1fcc3aa39006 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:19.934230 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f8458-45f2-4c47-a582-1fcc3aa39006 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:19.934775 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f8458-45f2-4c47-a582-1fcc3aa39006 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:19.939935 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 462/904] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jun 2 13:27:19 2022] GET /identity/v3/endpoints?service_id=2b1b9a50f2bb4ecb99fbdbbdee07fc0e&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:19.940068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f8458-45f2-4c47-a582-1fcc3aa39006 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:19.940992 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb6c5a-8232-4c9d-bbc9-781769ad6d2f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:19.966666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 443/905] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Jun 2 13:27:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:19.970102 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f8458-45f2-4c47-a582-1fcc3aa39006 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:20.048668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:20.054798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb6c5a-8232-4c9d-bbc9-781769ad6d2f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:20.090938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48131101-01e2-41e4-91ec-2bbb445cc50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:20.092023 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48131101-01e2-41e4-91ec-2bbb445cc50d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:20.092561 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48131101-01e2-41e4-91ec-2bbb445cc50d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:20.093076 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48131101-01e2-41e4-91ec-2bbb445cc50d None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:20.093972 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48131101-01e2-41e4-91ec-2bbb445cc50d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:20.095135 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f8458-45f2-4c47-a582-1fcc3aa39006 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:20.095821 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48131101-01e2-41e4-91ec-2bbb445cc50d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:20.097634 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:20.110917 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 463/906] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 2 13:27:19 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:27:20.135355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfa41d-27c3-4399-a1c3-112beeb75d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:20.136037 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfa41d-27c3-4399-a1c3-112beeb75d84 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:20.136320 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfa41d-27c3-4399-a1c3-112beeb75d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:20.136973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfa41d-27c3-4399-a1c3-112beeb75d84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:20.184725 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3626b-d011-47e5-af3a-26bb07796e6a None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:20.185377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3626b-d011-47e5-af3a-26bb07796e6a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:20.185868 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3626b-d011-47e5-af3a-26bb07796e6a None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:20.187892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 464/907] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:27:20.193586 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474321f-fe27-4a03-952c-753e3c45904e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:20.193836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474321f-fe27-4a03-952c-753e3c45904e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:20.194888 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474321f-fe27-4a03-952c-753e3c45904e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:20.218843 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfa41d-27c3-4399-a1c3-112beeb75d84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:20.220332 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfa41d-27c3-4399-a1c3-112beeb75d84 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:20.222047 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6474321f-fe27-4a03-952c-753e3c45904e None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:20.226480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6474321f-fe27-4a03-952c-753e3c45904e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:20.323109 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 465/908] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:27:20.341228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 444/909] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:27:19 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 13:27:20.345829 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474321f-fe27-4a03-952c-753e3c45904e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:20.347478 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfa41d-27c3-4399-a1c3-112beeb75d84 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:20.351632 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:20.451464 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:20.461505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474321f-fe27-4a03-952c-753e3c45904e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:20.478515 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfa41d-27c3-4399-a1c3-112beeb75d84 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:20.499736 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a6e6c-261e-4163-931e-fafd4d55dd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:20.500917 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a6e6c-261e-4163-931e-fafd4d55dd9d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:20.501400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a6e6c-261e-4163-931e-fafd4d55dd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:20.501855 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a6e6c-261e-4163-931e-fafd4d55dd9d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:20.502738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a6e6c-261e-4163-931e-fafd4d55dd9d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:20.504320 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a6e6c-261e-4163-931e-fafd4d55dd9d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:20.517015 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b7e97-3d73-4dda-9524-a9fd0dd4ced2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:20.517714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-473a6e6c-261e-4163-931e-fafd4d55dd9d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:27:20.517714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:20.517714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:27:20.517714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:27:20.517714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:27:20.517714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:27:20.517714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:27:20.517714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:20.517714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:27:20.517714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:20.517714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:27:20.517714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:20.517714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:20.517714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:20.517714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:20.517714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:20.517714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:20.518699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:20.518699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:20.518699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:20.518699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:20.518699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:20.518699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:20.518699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:27:20.518699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:27:20.518699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:27:20.518699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:27:20.518699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:20.518699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:20.518699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:20.518699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:20.518699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:20.518699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:20.519547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:20.519547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:20.519547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:20.519547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:20.519547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:20.519547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:20.519547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:20.519547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:20.519547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:20.519547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:20.519547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:27:20.519547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:20.519547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:27:20.519547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:20.520274 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b7e97-3d73-4dda-9524-a9fd0dd4ced2 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:20.520274 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b7e97-3d73-4dda-9524-a9fd0dd4ced2 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:20.520274 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b7e97-3d73-4dda-9524-a9fd0dd4ced2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:20.522799 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 466/910] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 13:27:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:20.534853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a6e6c-261e-4163-931e-fafd4d55dd9d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:20.537274 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b7e97-3d73-4dda-9524-a9fd0dd4ced2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:20.538163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b7e97-3d73-4dda-9524-a9fd0dd4ced2 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:20.557160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-ac5b7e97-3d73-4dda-9524-a9fd0dd4ced2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:20.557160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:20.557160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:20.557160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:20.557160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:20.557160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:20.557160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:20.557160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:20.557160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:20.557160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:20.557160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:20.557160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:20.557160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:20.557160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:20.557160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:20.558408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:20.558408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:20.558408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:20.558408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:20.558408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:20.558408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:20.558408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:20.558408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:20.558408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:20.558408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:20.558408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:20.558408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:20.558408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:20.558408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:20.558408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:20.558408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:20.558408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:20.559935 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:20.559935 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:20.559935 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:20.559935 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:20.563910 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 445/911] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:20.564835 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b7e97-3d73-4dda-9524-a9fd0dd4ced2 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:20.645666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:20.668501 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a6e6c-261e-4163-931e-fafd4d55dd9d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:20.697852 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b7e97-3d73-4dda-9524-a9fd0dd4ced2 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:20.712389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc92ad-dfdb-4424-a4f5-9b55c8054715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:20.713204 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc92ad-dfdb-4424-a4f5-9b55c8054715 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:20.713486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc92ad-dfdb-4424-a4f5-9b55c8054715 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:20.713762 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc92ad-dfdb-4424-a4f5-9b55c8054715 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:20.714477 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc92ad-dfdb-4424-a4f5-9b55c8054715 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:20.714909 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc92ad-dfdb-4424-a4f5-9b55c8054715 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:20.716460 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc92ad-dfdb-4424-a4f5-9b55c8054715 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:20.726987 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 467/912] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 13:27:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:20.729310 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc92ad-dfdb-4424-a4f5-9b55c8054715 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:20.744743 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78939e-7816-4828-8af6-412e9fd10c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:20.745608 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78939e-7816-4828-8af6-412e9fd10c95 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:20.745736 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78939e-7816-4828-8af6-412e9fd10c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:20.746021 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78939e-7816-4828-8af6-412e9fd10c95 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:20.746779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78939e-7816-4828-8af6-412e9fd10c95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:20.747113 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78939e-7816-4828-8af6-412e9fd10c95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:20.748455 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78939e-7816-4828-8af6-412e9fd10c95 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:20.754262 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:20.766802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 446/913] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:20.767775 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78939e-7816-4828-8af6-412e9fd10c95 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:20.864009 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc92ad-dfdb-4424-a4f5-9b55c8054715 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:20.877354 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78939e-7816-4828-8af6-412e9fd10c95 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:20.894173 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:20.908249 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9426f-027a-4125-9c97-8294536d213c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:20.908938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9426f-027a-4125-9c97-8294536d213c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:20.909220 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9426f-027a-4125-9c97-8294536d213c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:20.909494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9426f-027a-4125-9c97-8294536d213c None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:20.910363 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9426f-027a-4125-9c97-8294536d213c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:20.910700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9426f-027a-4125-9c97-8294536d213c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:20.912686 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9426f-027a-4125-9c97-8294536d213c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:20.916443 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d768fbf-bf68-4852-ae06-441306a7714e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:20.917557 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d768fbf-bf68-4852-ae06-441306a7714e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:20.918096 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d768fbf-bf68-4852-ae06-441306a7714e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:20.918636 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d768fbf-bf68-4852-ae06-441306a7714e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:20.922802 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 468/914] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 13:27:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:20.924083 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9426f-027a-4125-9c97-8294536d213c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:20.931617 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d768fbf-bf68-4852-ae06-441306a7714e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:20.933071 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d768fbf-bf68-4852-ae06-441306a7714e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:20.948202 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-5d768fbf-bf68-4852-ae06-441306a7714e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:20.948202 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:20.948202 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:20.948202 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:20.948202 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:20.948202 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:20.948202 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:20.948202 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:20.948202 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:20.948202 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:20.948202 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:20.948202 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:20.948202 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:27:20.948202 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:27:20.948202 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:27:20.949154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:27:20.949154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:20.949154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:20.949154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:20.949154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:20.949154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:20.949154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:20.949154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:20.949154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:20.949154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:20.949154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:20.949154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:20.949154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:20.949154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:20.949154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:20.949154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:20.949154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:20.950165 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:27:20.950165 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:27:20.950165 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:27:20.950165 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:27:20.950165 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:27:20.950165 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:27:20.950165 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:20.950165 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:20.954301 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 447/915] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:27:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:20.955222 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d768fbf-bf68-4852-ae06-441306a7714e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:21.036300 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:21.061220 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9426f-027a-4125-9c97-8294536d213c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:21.063898 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d768fbf-bf68-4852-ae06-441306a7714e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:21.100856 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64da917-17b1-4336-9276-556e0319f1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:21.101628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64da917-17b1-4336-9276-556e0319f1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:21.101908 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64da917-17b1-4336-9276-556e0319f1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:21.102251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64da917-17b1-4336-9276-556e0319f1f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:21.103177 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64da917-17b1-4336-9276-556e0319f1f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:21.103578 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64da917-17b1-4336-9276-556e0319f1f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:21.105098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64da917-17b1-4336-9276-556e0319f1f5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:21.105494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e8718-89a4-4480-b038-801c49859018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:21.106429 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e8718-89a4-4480-b038-801c49859018 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:21.107139 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e8718-89a4-4480-b038-801c49859018 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:21.108075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e8718-89a4-4480-b038-801c49859018 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:21.109018 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e8718-89a4-4480-b038-801c49859018 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:21.110606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e8718-89a4-4480-b038-801c49859018 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:21.118714 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 448/916] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:27:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:21.124718 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64da917-17b1-4336-9276-556e0319f1f5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:21.146890 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 469/917] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 2 13:27:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:27:21.168809 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5513d64-d1e0-4b3d-9e52-5d56ce1ee643 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:21.169067 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5513d64-d1e0-4b3d-9e52-5d56ce1ee643 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:21.169356 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5513d64-d1e0-4b3d-9e52-5d56ce1ee643 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:21.171318 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 470/918] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:21.178230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbbf75-479c-43f7-b268-0136afafbde5 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:21.178485 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbbf75-479c-43f7-b268-0136afafbde5 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:21.178795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbbf75-479c-43f7-b268-0136afafbde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:21.185748 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:21.202262 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3bdbbf75-479c-43f7-b268-0136afafbde5 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:21.203560 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3bdbbf75-479c-43f7-b268-0136afafbde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:21.261927 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64da917-17b1-4336-9276-556e0319f1f5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:21.310606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 471/919] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:21.311828 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b21c14-96eb-4e0b-bcc0-a0f03a87c80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:21.312556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b21c14-96eb-4e0b-bcc0-a0f03a87c80c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:21.312842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b21c14-96eb-4e0b-bcc0-a0f03a87c80c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:21.313120 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b21c14-96eb-4e0b-bcc0-a0f03a87c80c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:21.313999 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b21c14-96eb-4e0b-bcc0-a0f03a87c80c None admin] RBAC: Adding query filter params (role.id=ee7c0043cf84487d98a7417ff2ffadd4, scope.project.id=af45a1ec7c94408bb638c55fb43fa961, user.id=cbf7d6db675047cbb3a3f16631c59622) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:21.314364 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b21c14-96eb-4e0b-bcc0-a0f03a87c80c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:21.318626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b21c14-96eb-4e0b-bcc0-a0f03a87c80c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:21.324505 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 449/920] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:27:21 2022] GET /identity/v3/role_assignments?user.id=cbf7d6db675047cbb3a3f16631c59622&scope.project.id=af45a1ec7c94408bb638c55fb43fa961&role.id=ee7c0043cf84487d98a7417ff2ffadd4 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:21.337235 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbbf75-479c-43f7-b268-0136afafbde5 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:21.412402 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:21.454699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbbf75-479c-43f7-b268-0136afafbde5 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:21.493743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f65c9f-fb73-4c04-95c3-979bfe48ac30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:21.494902 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f65c9f-fb73-4c04-95c3-979bfe48ac30 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:21.495356 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f65c9f-fb73-4c04-95c3-979bfe48ac30 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:21.495798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f65c9f-fb73-4c04-95c3-979bfe48ac30 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:21.496613 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f65c9f-fb73-4c04-95c3-979bfe48ac30 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:21.498171 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f65c9f-fb73-4c04-95c3-979bfe48ac30 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:21.511904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-c3f65c9f-fb73-4c04-95c3-979bfe48ac30 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:27:21.511904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:21.511904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:27:21.511904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:27:21.511904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:27:21.511904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:27:21.511904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:27:21.511904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:21.511904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:27:21.511904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:21.511904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:27:21.511904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:21.511904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:21.511904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:21.511904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:21.511904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:21.511904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:21.513186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:21.513186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:21.513186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:21.513186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:21.513186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:21.513186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:21.513186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:27:21.513186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:27:21.513186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:27:21.513186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:27:21.513186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:21.513186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:21.513186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:21.513186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:21.513186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:21.513186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:21.514383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:21.514383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:21.514383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:21.514383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:21.514383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:21.514383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:21.514383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:21.514383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:21.514383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:21.514383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:21.514383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:27:21.514383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:21.514383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:27:21.514383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:21.518717 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 472/921] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 2 13:27:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:21.526774 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b21c14-96eb-4e0b-bcc0-a0f03a87c80c None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:21.624867 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:21.632413 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b21c14-96eb-4e0b-bcc0-a0f03a87c80c None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:21.670430 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f86b6-9660-45ee-96a9-b1137d91b937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:21.671137 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f86b6-9660-45ee-96a9-b1137d91b937 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:21.671417 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f86b6-9660-45ee-96a9-b1137d91b937 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:21.671689 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f86b6-9660-45ee-96a9-b1137d91b937 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:21.672396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f86b6-9660-45ee-96a9-b1137d91b937 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:21.672700 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f86b6-9660-45ee-96a9-b1137d91b937 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:21.674073 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f86b6-9660-45ee-96a9-b1137d91b937 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:21.679569 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 450/922] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 2 13:27:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:21.685093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f65c9f-fb73-4c04-95c3-979bfe48ac30 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:21.791804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f65c9f-fb73-4c04-95c3-979bfe48ac30 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:21.819439 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:21.828668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f60f4-601f-4add-a0b2-121c3b54e721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:21.829746 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f60f4-601f-4add-a0b2-121c3b54e721 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:21.830256 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f60f4-601f-4add-a0b2-121c3b54e721 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:21.830755 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f60f4-601f-4add-a0b2-121c3b54e721 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:21.831674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f60f4-601f-4add-a0b2-121c3b54e721 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:21.832176 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f60f4-601f-4add-a0b2-121c3b54e721 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:21.833777 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f60f4-601f-4add-a0b2-121c3b54e721 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:21.839817 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 473/923] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 2 13:27:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:21.850621 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f86b6-9660-45ee-96a9-b1137d91b937 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:21.948507 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f86b6-9660-45ee-96a9-b1137d91b937 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:21.982743 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481b0a9-4009-40bd-a1b1-544a20a19eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:21.983415 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481b0a9-4009-40bd-a1b1-544a20a19eec None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:21.983696 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481b0a9-4009-40bd-a1b1-544a20a19eec None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:21.983959 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481b0a9-4009-40bd-a1b1-544a20a19eec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:21.984746 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481b0a9-4009-40bd-a1b1-544a20a19eec None admin] RBAC: Adding query filter params (interface=public, service_id=b967d05ad7654bc1bb1f51b1bd8f4c94, region_id=RegionOne) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:21.985055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481b0a9-4009-40bd-a1b1-544a20a19eec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:21.986422 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481b0a9-4009-40bd-a1b1-544a20a19eec None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:21.994248 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 451/924] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jun 2 13:27:21 2022] GET /identity/v3/endpoints?service_id=b967d05ad7654bc1bb1f51b1bd8f4c94&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:21.999916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f60f4-601f-4add-a0b2-121c3b54e721 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:22.100593 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f60f4-601f-4add-a0b2-121c3b54e721 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:22.138732 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48c69d-ae74-42ce-a9ef-6eb10bcfb57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:22.139841 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48c69d-ae74-42ce-a9ef-6eb10bcfb57f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:22.140373 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48c69d-ae74-42ce-a9ef-6eb10bcfb57f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:22.140843 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48c69d-ae74-42ce-a9ef-6eb10bcfb57f None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:22.141744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48c69d-ae74-42ce-a9ef-6eb10bcfb57f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:22.143403 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48c69d-ae74-42ce-a9ef-6eb10bcfb57f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:22.151007 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 474/925] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 2 13:27:21 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:27:22.467922 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09aad31-866d-49c4-b6be-eff9293721a4 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:22.468278 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09aad31-866d-49c4-b6be-eff9293721a4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:22.468477 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09aad31-866d-49c4-b6be-eff9293721a4 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:22.470090 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 452/926] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:22.475615 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e2568-c3eb-4fc7-9284-97fc171c2b55 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:22.476055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e2568-c3eb-4fc7-9284-97fc171c2b55 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:22.476164 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e2568-c3eb-4fc7-9284-97fc171c2b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:22.493473 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b19e2568-c3eb-4fc7-9284-97fc171c2b55 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:22.494681 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b19e2568-c3eb-4fc7-9284-97fc171c2b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:22.551590 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:22.573631 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 475/927] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:22.596464 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09aad31-866d-49c4-b6be-eff9293721a4 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:22.623451 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:22.703379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09aad31-866d-49c4-b6be-eff9293721a4 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:22.736890 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d35960-7299-4c97-b108-a62f2ea80edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:22.737636 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d35960-7299-4c97-b108-a62f2ea80edf None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:22.737915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d35960-7299-4c97-b108-a62f2ea80edf None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:22.738186 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d35960-7299-4c97-b108-a62f2ea80edf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:22.738865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d35960-7299-4c97-b108-a62f2ea80edf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:22.740236 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d35960-7299-4c97-b108-a62f2ea80edf None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:22.752575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-96d35960-7299-4c97-b108-a62f2ea80edf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:27:22.752575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:22.752575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:27:22.752575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:27:22.752575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:27:22.752575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:27:22.752575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:27:22.752575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:22.752575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:27:22.752575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:22.752575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:27:22.752575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:22.752575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:22.752575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:22.752575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:22.752575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:22.753512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:22.753512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:22.753512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:22.753512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:22.753512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:22.753512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:22.753512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:22.753512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:27:22.753512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:27:22.753512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:27:22.753512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:27:22.753512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:22.753512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:22.753512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:22.753512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:22.753512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:22.754343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:22.754343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:22.754343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:22.754343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:22.754343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:22.754343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:22.754343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:22.754343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:22.754343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:22.754343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:22.754343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:22.754343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:27:22.754343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:22.754343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:27:22.754343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:22.754343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 453/928] 10.222.0.18 () {56 vars in 1132 bytes} [Thu Jun 2 13:27:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:22.759987 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e2568-c3eb-4fc7-9284-97fc171c2b55 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:22.859202 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e2568-c3eb-4fc7-9284-97fc171c2b55 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:22.894489 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1249e-48b2-4c44-989c-6c622447c63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:22.895251 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1249e-48b2-4c44-989c-6c622447c63d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:22.895525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1249e-48b2-4c44-989c-6c622447c63d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:22.895790 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1249e-48b2-4c44-989c-6c622447c63d None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:22.896536 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1249e-48b2-4c44-989c-6c622447c63d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:22.896836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1249e-48b2-4c44-989c-6c622447c63d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:22.898185 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1249e-48b2-4c44-989c-6c622447c63d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:22.908351 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 476/929] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 2 13:27:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:22.909709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d35960-7299-4c97-b108-a62f2ea80edf None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:23.004674 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:23.017099 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d35960-7299-4c97-b108-a62f2ea80edf None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:23.051774 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7342ab2-a4e5-4186-93c8-907c89d179b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:23.052510 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7342ab2-a4e5-4186-93c8-907c89d179b9 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:23.052792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7342ab2-a4e5-4186-93c8-907c89d179b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:23.053067 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7342ab2-a4e5-4186-93c8-907c89d179b9 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:23.053826 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7342ab2-a4e5-4186-93c8-907c89d179b9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:23.054136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7342ab2-a4e5-4186-93c8-907c89d179b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:23.055544 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7342ab2-a4e5-4186-93c8-907c89d179b9 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:23.060903 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 454/930] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 2 13:27:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:23.066562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1249e-48b2-4c44-989c-6c622447c63d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:23.123220 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:23.168249 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1249e-48b2-4c44-989c-6c622447c63d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:23.203319 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecb5e8-6173-4021-9e91-249e1f75ab79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:23.204348 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecb5e8-6173-4021-9e91-249e1f75ab79 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:23.204840 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecb5e8-6173-4021-9e91-249e1f75ab79 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:23.205311 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecb5e8-6173-4021-9e91-249e1f75ab79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:23.206282 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccecb5e8-6173-4021-9e91-249e1f75ab79 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:23.207875 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccecb5e8-6173-4021-9e91-249e1f75ab79 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:23.234743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 477/931] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 2 13:27:23 2022] POST /identity/v3/endpoints => generated 347 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:27:23.596889 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ea40f-622b-4c66-9e75-3cf0885cdcb0 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:23.597419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ea40f-622b-4c66-9e75-3cf0885cdcb0 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:23.597419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ea40f-622b-4c66-9e75-3cf0885cdcb0 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:23.599081 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 455/932] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:27:23.604310 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efd3e7-96da-458b-9544-55ae1a6109fa None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:23.604703 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efd3e7-96da-458b-9544-55ae1a6109fa None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:23.604868 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efd3e7-96da-458b-9544-55ae1a6109fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:23.622054 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-59efd3e7-96da-458b-9544-55ae1a6109fa None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:23.623267 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-59efd3e7-96da-458b-9544-55ae1a6109fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:23.698354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 478/933] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:27:23.717966 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da82bf1-54ee-4223-8fb9-7f24909d0d27 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:23.718267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da82bf1-54ee-4223-8fb9-7f24909d0d27 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:23.718508 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da82bf1-54ee-4223-8fb9-7f24909d0d27 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:23.720061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 456/934] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:23.725573 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec8e08-e4df-4f47-ac2c-46955f47a7da None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:23.725711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da82bf1-54ee-4223-8fb9-7f24909d0d27 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:23.726219 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec8e08-e4df-4f47-ac2c-46955f47a7da None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:23.726726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec8e08-e4df-4f47-ac2c-46955f47a7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:23.751135 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-12ec8e08-e4df-4f47-ac2c-46955f47a7da None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:23.752829 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-12ec8e08-e4df-4f47-ac2c-46955f47a7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:23.791926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:23.850700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 479/935] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:23.857733 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da82bf1-54ee-4223-8fb9-7f24909d0d27 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:23.871749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec8e08-e4df-4f47-ac2c-46955f47a7da None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:23.896168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de788094-c2b3-4010-83f2-7d9d04be4de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:23.896938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de788094-c2b3-4010-83f2-7d9d04be4de6 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:23.897299 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de788094-c2b3-4010-83f2-7d9d04be4de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:23.897679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de788094-c2b3-4010-83f2-7d9d04be4de6 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:23.898446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de788094-c2b3-4010-83f2-7d9d04be4de6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:23.899994 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de788094-c2b3-4010-83f2-7d9d04be4de6 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:23.901863 dv-cinder-836083-8-smb devstack@keystone.service[80238]: WARNING keystone.server.flask.common [None req-de788094-c2b3-4010-83f2-7d9d04be4de6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 02 13:27:23.924091 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.sql.core [None req-de788094-c2b3-4010-83f2-7d9d04be4de6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 13:27:23.924091 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 02 13:27:23.924091 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [parameters: {'id': 'e8bf6528b1364abcbbecaf461ebe43b2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 02 13:27:23.924091 dv-cinder-836083-8-smb devstack@keystone.service[80238]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80238) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 13:27:23.940692 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-de788094-c2b3-4010-83f2-7d9d04be4de6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e8bf6528b1364abcbbecaf461ebe43b2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e8bf6528b1364abcbbecaf461ebe43b2. Jun 02 13:27:23.940692 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:23.940692 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:27:23.940692 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:27:23.940692 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:27:23.940692 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:27:23.940692 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:27:23.940692 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:27:23.940692 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:27:23.940692 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:27:23.940692 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:27:23.940692 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:27:23.940692 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:27:23.941625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application result.read() Jun 02 13:27:23.941625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:27:23.941625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:27:23.941625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:27:23.941625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:27:23.941625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:27:23.941625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:27:23.941625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:27:23.941625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:27:23.941625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 13:27:23.941625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:23.941625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 13:27:23.941625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:23.941625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:23.941625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 13:27:23.941625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 13:27:23.941625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 02 13:27:23.941625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 02 13:27:23.942635 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:27:23.942635 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:27:23.942635 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 13:27:23.942635 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application yield resource Jun 02 13:27:23.942635 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:27:23.942635 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:27:23.942635 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 13:27:23.942635 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 13:27:23.942635 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 13:27:23.942635 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 13:27:23.942635 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 13:27:23.942635 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise self.value Jun 02 13:27:23.942635 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 13:27:23.942635 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 13:27:23.942635 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 13:27:23.942635 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application session.commit() Jun 02 13:27:23.942635 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 13:27:23.943552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 13:27:23.943552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 13:27:23.943552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 13:27:23.943552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 13:27:23.943552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self.session.flush() Jun 02 13:27:23.943552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 13:27:23.943552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 13:27:23.943552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 13:27:23.943552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 13:27:23.943552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 13:27:23.943552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application compat.raise_( Jun 02 13:27:23.943552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:27:23.943552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception Jun 02 13:27:23.943552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 13:27:23.943552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 13:27:23.943552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 13:27:23.943552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 13:27:23.945419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 13:27:23.945419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 13:27:23.945419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 13:27:23.945419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 13:27:23.945419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 02 13:27:23.945419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 02 13:27:23.945419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 13:27:23.945419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 13:27:23.945419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 13:27:23.945419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 13:27:23.945419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 13:27:23.945419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 13:27:23.945419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 13:27:23.945419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 13:27:23.945419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 13:27:23.947223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 13:27:23.947223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:27:23.947223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception Jun 02 13:27:23.947223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:27:23.947223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:27:23.947223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:27:23.947223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:27:23.947223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:27:23.947223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:27:23.947223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:27:23.947223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:27:23.947223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:27:23.947223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:27:23.947223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:27:23.947223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application result.read() Jun 02 13:27:23.947223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:27:23.947223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:27:23.948325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:27:23.948325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:27:23.948325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:27:23.948325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:27:23.948325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:27:23.948325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:27:23.948325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 13:27:23.948325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 02 13:27:23.948325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [parameters: {'id': 'e8bf6528b1364abcbbecaf461ebe43b2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 02 13:27:23.948325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 13:27:23.948325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:23.948325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:27:23.948325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:23.948325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:23.948325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 02 13:27:23.949612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 02 13:27:23.949612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 13:27:23.949612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 13:27:23.949612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 02 13:27:23.949612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:23.949612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:27:23.949612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:23.949612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:23.949612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:23.949612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:23.949612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:23.949612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:23.949612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:23.949612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:23.949612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:23.949612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:23.949612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:23.951039 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:23.951039 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 02 13:27:23.951039 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 02 13:27:23.951039 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:23.951039 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:23.951039 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 02 13:27:23.951039 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 02 13:27:23.951039 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e8bf6528b1364abcbbecaf461ebe43b2. Jun 02 13:27:23.951039 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:23.951039 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 457/936] 10.222.0.18 () {60 vars in 1140 bytes} [Thu Jun 2 13:27:23 2022] POST /identity/v3/projects => generated 262 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:23.952633 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de788094-c2b3-4010-83f2-7d9d04be4de6 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:23.965157 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:24.010837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec8e08-e4df-4f47-ac2c-46955f47a7da None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:24.049429 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366b484-bfa9-45c6-a586-0d7671f17644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:24.050436 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366b484-bfa9-45c6-a586-0d7671f17644 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:24.050848 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366b484-bfa9-45c6-a586-0d7671f17644 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:24.051236 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366b484-bfa9-45c6-a586-0d7671f17644 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:24.063062 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366b484-bfa9-45c6-a586-0d7671f17644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:27:24.072057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-c366b484-bfa9-45c6-a586-0d7671f17644 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:27:24.072057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:24.072057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:24.072057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:24.072057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:24.072057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:24.072057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:24.072057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:24.072057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:24.072057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:24.072057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:24.072057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:24.072057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:27:24.072057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:27:24.072057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:27:24.072057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:27:24.073205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:27:24.073205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:27:24.073205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:27:24.073205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:27:24.073205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:24.073205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:24.073205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:24.073205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:24.073205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:24.073205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:24.073205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:24.073205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:24.073205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:24.073205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:24.073205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:24.073205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:24.074284 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:24.074284 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:24.074284 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:24.074284 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:24.074284 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:27:24.074284 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:27:24.074284 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:27:24.074284 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:27:24.074284 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:27:24.074284 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:27:24.074284 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:27:24.074284 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:24.081200 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 480/937] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Jun 2 13:27:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:24.081859 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366b484-bfa9-45c6-a586-0d7671f17644 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:24.088645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de788094-c2b3-4010-83f2-7d9d04be4de6 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:24.109894 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:24.140369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016fa7c-462d-448b-8fe2-d9e876101e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:24.142101 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016fa7c-462d-448b-8fe2-d9e876101e5e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:24.142634 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016fa7c-462d-448b-8fe2-d9e876101e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:24.143136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016fa7c-462d-448b-8fe2-d9e876101e5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:24.155179 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016fa7c-462d-448b-8fe2-d9e876101e5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:24.158356 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016fa7c-462d-448b-8fe2-d9e876101e5e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:24.178009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-9016fa7c-462d-448b-8fe2-d9e876101e5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:24.178009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:24.178009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:24.178009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:24.178009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:24.178009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:24.178009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:24.178009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:24.178009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:24.178009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:24.178009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:24.178009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:24.178009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:27:24.178009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:27:24.178009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:27:24.179002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:27:24.179002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:24.179002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:24.179002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:24.179002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:24.179002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:24.179002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:24.179002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:24.179002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:24.179002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:24.179002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:24.179002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:24.179002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:24.179002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:24.179002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:24.179002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:24.179002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:24.179889 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:27:24.179889 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:27:24.179889 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:27:24.179889 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:27:24.179889 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:27:24.179889 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:27:24.179889 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:24.179889 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:24.182831 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 458/938] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:27:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:24.185858 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016fa7c-462d-448b-8fe2-d9e876101e5e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:24.204728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366b484-bfa9-45c6-a586-0d7671f17644 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:24.240953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c6f72-92e3-4273-a462-5c3bdbb1be51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:24.241785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c6f72-92e3-4273-a462-5c3bdbb1be51 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:24.242153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c6f72-92e3-4273-a462-5c3bdbb1be51 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:24.242518 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c6f72-92e3-4273-a462-5c3bdbb1be51 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:24.243585 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c6f72-92e3-4273-a462-5c3bdbb1be51 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:24.243792 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c6f72-92e3-4273-a462-5c3bdbb1be51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:24.245335 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c6f72-92e3-4273-a462-5c3bdbb1be51 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:24.260768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 481/939] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jun 2 13:27:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:24.262868 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c6f72-92e3-4273-a462-5c3bdbb1be51 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:24.276672 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:24.316420 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016fa7c-462d-448b-8fe2-d9e876101e5e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:24.358861 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44d79f-68cd-4e02-a0ff-3309e7212ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:24.360740 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44d79f-68cd-4e02-a0ff-3309e7212ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:24.361174 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44d79f-68cd-4e02-a0ff-3309e7212ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:24.361594 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44d79f-68cd-4e02-a0ff-3309e7212ed5 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:24.362499 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44d79f-68cd-4e02-a0ff-3309e7212ed5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:24.362989 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44d79f-68cd-4e02-a0ff-3309e7212ed5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:24.364558 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44d79f-68cd-4e02-a0ff-3309e7212ed5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:24.379099 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:24.390417 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 459/940] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 2 13:27:24 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:24.407003 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c6f72-92e3-4273-a462-5c3bdbb1be51 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:24.448446 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285b050-7660-4fe6-8d67-ff70cbae8ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:24.449641 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285b050-7660-4fe6-8d67-ff70cbae8ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:24.450067 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285b050-7660-4fe6-8d67-ff70cbae8ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:24.450505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285b050-7660-4fe6-8d67-ff70cbae8ff8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:24.462934 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285b050-7660-4fe6-8d67-ff70cbae8ff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:24.464750 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285b050-7660-4fe6-8d67-ff70cbae8ff8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:24.483918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-b285b050-7660-4fe6-8d67-ff70cbae8ff8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:24.483918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:24.483918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:24.483918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:24.483918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:24.483918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:24.483918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:24.483918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:24.483918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:24.483918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:24.483918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:24.483918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:24.483918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:24.483918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:24.483918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:24.485063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:24.485063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:24.485063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:24.485063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:24.485063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:24.485063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:24.485063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:24.485063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:24.485063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:24.485063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:24.485063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:24.485063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:24.485063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:24.485063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:24.485063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:24.485063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:24.485063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:24.486152 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:24.486152 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:24.486152 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:24.486152 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:24.488216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 482/941] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:24.494258 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44d79f-68cd-4e02-a0ff-3309e7212ed5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:24.512684 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98ea2f-bf65-4406-9a10-510abd795557 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:24.512965 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98ea2f-bf65-4406-9a10-510abd795557 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:24.513245 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98ea2f-bf65-4406-9a10-510abd795557 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:24.515008 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 483/942] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:27:24.520673 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618302e-e320-46b1-bdfe-ae0c19a11ea8 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:24.520956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618302e-e320-46b1-bdfe-ae0c19a11ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:24.521236 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618302e-e320-46b1-bdfe-ae0c19a11ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:24.542828 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f618302e-e320-46b1-bdfe-ae0c19a11ea8 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:24.544727 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f618302e-e320-46b1-bdfe-ae0c19a11ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:24.622623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44d79f-68cd-4e02-a0ff-3309e7212ed5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:24.655955 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 484/943] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:27:24.663132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:24.671770 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e431829-6e32-42a2-a765-a843ab4c42c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:24.672530 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e431829-6e32-42a2-a765-a843ab4c42c5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:24.672870 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e431829-6e32-42a2-a765-a843ab4c42c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:24.673220 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e431829-6e32-42a2-a765-a843ab4c42c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:24.674013 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e431829-6e32-42a2-a765-a843ab4c42c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:24.674378 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e431829-6e32-42a2-a765-a843ab4c42c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:24.675835 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e431829-6e32-42a2-a765-a843ab4c42c5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:24.690746 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 460/944] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:24.691738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618302e-e320-46b1-bdfe-ae0c19a11ea8 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:24.697023 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e431829-6e32-42a2-a765-a843ab4c42c5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:24.774854 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:24.818231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e431829-6e32-42a2-a765-a843ab4c42c5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:24.824158 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618302e-e320-46b1-bdfe-ae0c19a11ea8 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:24.864446 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46493d7-3d63-42ad-8ddf-4e0ab45a2ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:24.865614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46493d7-3d63-42ad-8ddf-4e0ab45a2ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:24.865891 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46493d7-3d63-42ad-8ddf-4e0ab45a2ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:24.866160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46493d7-3d63-42ad-8ddf-4e0ab45a2ca5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:24.866861 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46493d7-3d63-42ad-8ddf-4e0ab45a2ca5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:24.867383 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57cc79-c361-4250-92ad-8cdb7c2945b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:24.868237 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46493d7-3d63-42ad-8ddf-4e0ab45a2ca5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:24.868684 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57cc79-c361-4250-92ad-8cdb7c2945b7 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:24.869153 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57cc79-c361-4250-92ad-8cdb7c2945b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:24.869647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57cc79-c361-4250-92ad-8cdb7c2945b7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:24.878972 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af57cc79-c361-4250-92ad-8cdb7c2945b7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:24.880656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-d46493d7-3d63-42ad-8ddf-4e0ab45a2ca5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:27:24.880656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:24.880656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:27:24.880656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:27:24.880656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:27:24.880656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:27:24.880656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:27:24.880656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:24.880656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:27:24.880656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:24.880656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:27:24.880656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:24.880656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:24.880656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:24.880656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:24.880656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:24.880656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:24.881628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:24.881628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:24.881628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:24.881628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:24.881628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:24.881628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:24.881628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:27:24.881628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:27:24.881628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:27:24.881628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:27:24.881628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:24.881628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:24.881628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:24.881628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:24.881628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:24.881628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:24.882462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:24.882462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:24.882462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:24.882462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:24.882462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:24.882462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:24.882462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:24.882462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:24.882462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:24.882462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:24.882462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:27:24.882462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:24.882462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:27:24.882462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:24.882462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 485/945] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 2 13:27:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:24.883316 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af57cc79-c361-4250-92ad-8cdb7c2945b7 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:24.888210 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46493d7-3d63-42ad-8ddf-4e0ab45a2ca5 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:24.902681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-af57cc79-c361-4250-92ad-8cdb7c2945b7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:27:24.902681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:24.902681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:24.902681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:24.902681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:24.902681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:24.902681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:24.902681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:24.902681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:24.902681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:24.902681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:24.902681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:24.902681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:27:24.902681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:27:24.902681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:27:24.902681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:27:24.903675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:24.903675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:24.903675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:27:24.903675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:24.903675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:27:24.903675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:24.903675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:24.903675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:24.903675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:24.903675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:24.903675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:24.903675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:24.903675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:24.903675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:24.903675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:24.903675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:24.903675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:24.903675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:24.904637 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:24.904637 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:24.904637 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:27:24.904637 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:27:24.904637 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:27:24.904637 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:27:24.904637 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:27:24.904637 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:27:24.904637 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:27:24.904637 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:24.907520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 461/946] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 2 13:27:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:24.916116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57cc79-c361-4250-92ad-8cdb7c2945b7 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:24.967393 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:25.016477 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46493d7-3d63-42ad-8ddf-4e0ab45a2ca5 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:25.019831 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57cc79-c361-4250-92ad-8cdb7c2945b7 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:25.048749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:25.055172 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f763d-0681-4268-ac77-69f1478e3a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:25.056064 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f763d-0681-4268-ac77-69f1478e3a92 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:25.056437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f763d-0681-4268-ac77-69f1478e3a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:25.056803 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f763d-0681-4268-ac77-69f1478e3a92 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:25.057057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bd23f-3225-4cfe-966f-98808716c7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:25.057847 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f763d-0681-4268-ac77-69f1478e3a92 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:25.058031 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bd23f-3225-4cfe-966f-98808716c7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:25.058381 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f763d-0681-4268-ac77-69f1478e3a92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:25.058652 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bd23f-3225-4cfe-966f-98808716c7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:25.059080 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bd23f-3225-4cfe-966f-98808716c7a4 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:25.059984 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663bd23f-3225-4cfe-966f-98808716c7a4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:25.060211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f763d-0681-4268-ac77-69f1478e3a92 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:25.060584 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663bd23f-3225-4cfe-966f-98808716c7a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:25.062205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663bd23f-3225-4cfe-966f-98808716c7a4 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:25.068179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 486/947] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 2 13:27:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:25.073499 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bd23f-3225-4cfe-966f-98808716c7a4 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:25.084212 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 462/948] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Jun 2 13:27:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:25.085358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f763d-0681-4268-ac77-69f1478e3a92 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:25.197855 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bd23f-3225-4cfe-966f-98808716c7a4 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:25.202117 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f763d-0681-4268-ac77-69f1478e3a92 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:25.211238 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:25.238502 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab0498-a6f8-462c-b06e-8509750a2741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:25.239483 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab0498-a6f8-462c-b06e-8509750a2741 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:25.239795 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a230a36-1eff-4d57-9b17-21632499659e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:25.240098 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab0498-a6f8-462c-b06e-8509750a2741 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:25.240512 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab0498-a6f8-462c-b06e-8509750a2741 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:25.240876 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a230a36-1eff-4d57-9b17-21632499659e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:25.241282 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a230a36-1eff-4d57-9b17-21632499659e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:25.241647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a230a36-1eff-4d57-9b17-21632499659e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:25.241809 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab0498-a6f8-462c-b06e-8509750a2741 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:25.242244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab0498-a6f8-462c-b06e-8509750a2741 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:25.243885 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab0498-a6f8-462c-b06e-8509750a2741 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:25.249974 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 487/949] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 2 13:27:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:25.252960 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a230a36-1eff-4d57-9b17-21632499659e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:25.254516 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a230a36-1eff-4d57-9b17-21632499659e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:25.255369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab0498-a6f8-462c-b06e-8509750a2741 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:25.273618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-3a230a36-1eff-4d57-9b17-21632499659e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:25.273618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:25.273618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:25.273618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:25.273618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:25.273618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:25.273618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:25.273618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:25.273618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:25.273618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:25.273618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:25.273618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:25.273618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:25.273618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:25.273618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:25.274655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:25.274655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:25.274655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:25.274655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:25.274655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:25.274655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:25.274655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:25.274655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:25.274655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:25.274655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:25.274655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:25.274655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:25.274655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:25.274655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:25.274655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:25.274655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:25.274655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:25.275583 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:25.275583 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:25.275583 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:25.275583 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:25.280644 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 463/950] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:25.281749 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a230a36-1eff-4d57-9b17-21632499659e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:25.334612 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:25.379643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab0498-a6f8-462c-b06e-8509750a2741 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:25.388754 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a230a36-1eff-4d57-9b17-21632499659e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:25.416460 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d3fba-ef12-477f-a5a8-69c35f03936b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:25.417473 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d3fba-ef12-477f-a5a8-69c35f03936b None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:25.418056 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d3fba-ef12-477f-a5a8-69c35f03936b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:25.418546 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d3fba-ef12-477f-a5a8-69c35f03936b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:25.419565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d3fba-ef12-477f-a5a8-69c35f03936b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:25.421243 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d3fba-ef12-477f-a5a8-69c35f03936b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:25.427720 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a2c9a-421f-4733-a6a6-62986d9e881d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:25.428396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a2c9a-421f-4733-a6a6-62986d9e881d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:25.428669 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a2c9a-421f-4733-a6a6-62986d9e881d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:25.429133 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a2c9a-421f-4733-a6a6-62986d9e881d None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:25.429860 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a2c9a-421f-4733-a6a6-62986d9e881d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:25.430195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a2c9a-421f-4733-a6a6-62986d9e881d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:25.432130 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a2c9a-421f-4733-a6a6-62986d9e881d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:25.444401 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 488/951] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 2 13:27:25 2022] POST /identity/v3/endpoints => generated 349 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:27:25.450711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 464/952] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:25.452324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d3fba-ef12-477f-a5a8-69c35f03936b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:25.571739 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d3fba-ef12-477f-a5a8-69c35f03936b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:25.584157 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:25.612937 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad11c8-0b78-4dd9-9c84-f91837af84e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:25.613850 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad11c8-0b78-4dd9-9c84-f91837af84e1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:25.614191 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad11c8-0b78-4dd9-9c84-f91837af84e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:25.614522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad11c8-0b78-4dd9-9c84-f91837af84e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:25.622725 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad11c8-0b78-4dd9-9c84-f91837af84e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:25.624585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57978ea5-6cf8-4e72-b9f3-f5f6f55ef34a None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:25.625053 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57978ea5-6cf8-4e72-b9f3-f5f6f55ef34a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:25.626312 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57978ea5-6cf8-4e72-b9f3-f5f6f55ef34a None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:25.627458 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 465/953] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:25.628973 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad11c8-0b78-4dd9-9c84-f91837af84e1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:25.640684 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a01759-7ab9-4e42-963b-0370ffe5dbae None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:25.643514 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a01759-7ab9-4e42-963b-0370ffe5dbae None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:25.644130 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a01759-7ab9-4e42-963b-0370ffe5dbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:25.645557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-36ad11c8-0b78-4dd9-9c84-f91837af84e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:25.645557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:25.645557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:25.645557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:25.645557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:25.645557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:25.645557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:25.645557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:25.645557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:25.645557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:25.645557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:25.645557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:25.645557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:27:25.645557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:27:25.645557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:27:25.646515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:27:25.646515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:25.646515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:25.646515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:25.646515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:25.646515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:25.646515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:25.646515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:25.646515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:25.646515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:25.646515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:25.646515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:25.646515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:25.646515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:25.646515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:25.646515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:25.646515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:25.647796 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:27:25.647796 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:27:25.647796 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:27:25.647796 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:27:25.647796 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:27:25.647796 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:27:25.647796 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:25.647796 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:25.647796 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 489/954] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:27:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:25.653320 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad11c8-0b78-4dd9-9c84-f91837af84e1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:25.669244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-04a01759-7ab9-4e42-963b-0370ffe5dbae None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:25.670927 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-04a01759-7ab9-4e42-963b-0370ffe5dbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:25.689604 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:25.768644 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 466/955] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:25.782437 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad11c8-0b78-4dd9-9c84-f91837af84e1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:25.792445 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a01759-7ab9-4e42-963b-0370ffe5dbae None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:25.825099 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129dab9-876c-4371-9143-7f16d0802cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:25.826024 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129dab9-876c-4371-9143-7f16d0802cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:25.826313 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129dab9-876c-4371-9143-7f16d0802cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:25.826604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129dab9-876c-4371-9143-7f16d0802cf6 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:25.827835 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129dab9-876c-4371-9143-7f16d0802cf6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:25.828154 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129dab9-876c-4371-9143-7f16d0802cf6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:25.829871 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129dab9-876c-4371-9143-7f16d0802cf6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:25.846440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 490/956] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:27:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:25.852928 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129dab9-876c-4371-9143-7f16d0802cf6 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:25.885898 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:25.918256 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a01759-7ab9-4e42-963b-0370ffe5dbae None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:25.956701 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4024950-93e2-4acd-8e22-512ca1cab6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:25.958166 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4024950-93e2-4acd-8e22-512ca1cab6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:25.958728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4024950-93e2-4acd-8e22-512ca1cab6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:25.959206 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4024950-93e2-4acd-8e22-512ca1cab6c4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:25.960057 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4024950-93e2-4acd-8e22-512ca1cab6c4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:25.961763 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4024950-93e2-4acd-8e22-512ca1cab6c4 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:25.973988 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129dab9-876c-4371-9143-7f16d0802cf6 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:25.975197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-f4024950-93e2-4acd-8e22-512ca1cab6c4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:27:25.975197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:25.975197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:27:25.975197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:27:25.975197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:27:25.975197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:27:25.975197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:27:25.975197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:25.975197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:27:25.975197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:25.975197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:27:25.975197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:25.975197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:25.975197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:25.975197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:25.975197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:25.975197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:25.976223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:25.976223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:25.976223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:25.976223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:25.976223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:25.976223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:25.976223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:27:25.976223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:27:25.976223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:27:25.976223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:27:25.976223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:25.976223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:25.976223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:25.976223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:25.976223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:25.976223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:25.977181 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:25.977181 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:25.977181 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:25.977181 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:25.977181 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:25.977181 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:25.977181 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:25.977181 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:25.977181 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:25.977181 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:25.977181 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:27:25.977181 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:25.977181 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:27:25.977181 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:25.980148 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 467/957] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:27:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:25.986935 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4024950-93e2-4acd-8e22-512ca1cab6c4 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:26.004215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:26.022972 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3002f-4a1d-437b-a5df-4d3ccfa53bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:26.023950 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3002f-4a1d-437b-a5df-4d3ccfa53bc9 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:26.024232 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3002f-4a1d-437b-a5df-4d3ccfa53bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:26.024506 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3002f-4a1d-437b-a5df-4d3ccfa53bc9 None admin] PATH_INFO: `/v3/projects/af45a1ec7c94408bb638c55fb43fa961/users/cbf7d6db675047cbb3a3f16631c59622/roles/ee7c0043cf84487d98a7417ff2ffadd4` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:26.027851 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3002f-4a1d-437b-a5df-4d3ccfa53bc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=af45a1ec7c94408bb638c55fb43fa961, user_id=cbf7d6db675047cbb3a3f16631c59622, role_id=ee7c0043cf84487d98a7417ff2ffadd4)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:26.029521 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3002f-4a1d-437b-a5df-4d3ccfa53bc9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:26.058612 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 491/958] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 13:27:25 2022] PUT /identity/v3/projects/af45a1ec7c94408bb638c55fb43fa961/users/cbf7d6db675047cbb3a3f16631c59622/roles/ee7c0043cf84487d98a7417ff2ffadd4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:27:26.115243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4024950-93e2-4acd-8e22-512ca1cab6c4 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:26.156423 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58563a5b-26d5-45e7-bb2c-a492e5617d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:26.157479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58563a5b-26d5-45e7-bb2c-a492e5617d73 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:26.158051 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58563a5b-26d5-45e7-bb2c-a492e5617d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:26.158500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58563a5b-26d5-45e7-bb2c-a492e5617d73 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:26.159458 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58563a5b-26d5-45e7-bb2c-a492e5617d73 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:26.159967 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58563a5b-26d5-45e7-bb2c-a492e5617d73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:26.161531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58563a5b-26d5-45e7-bb2c-a492e5617d73 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:26.168213 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 468/959] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 2 13:27:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:26.174706 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3002f-4a1d-437b-a5df-4d3ccfa53bc9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:26.278277 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:26.288384 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3002f-4a1d-437b-a5df-4d3ccfa53bc9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:26.327546 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8f68d-577f-4f83-98a5-ef100cddb0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:26.328711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8f68d-577f-4f83-98a5-ef100cddb0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:26.329214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8f68d-577f-4f83-98a5-ef100cddb0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:26.329695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8f68d-577f-4f83-98a5-ef100cddb0e9 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:26.330410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8f68d-577f-4f83-98a5-ef100cddb0e9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:26.330760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8f68d-577f-4f83-98a5-ef100cddb0e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:26.332136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8f68d-577f-4f83-98a5-ef100cddb0e9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:26.338300 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 492/960] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 2 13:27:26 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:26.872159 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03752670-cbb4-4deb-9fd9-86aff7f0aabf None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:26.872717 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03752670-cbb4-4deb-9fd9-86aff7f0aabf None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:26.872717 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03752670-cbb4-4deb-9fd9-86aff7f0aabf None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:26.874326 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 469/961] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:26.879643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2c99c-ccc8-4f53-a710-3159c1eaf66e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:26.880092 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2c99c-ccc8-4f53-a710-3159c1eaf66e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:26.880192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2c99c-ccc8-4f53-a710-3159c1eaf66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:26.897209 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-fef2c99c-ccc8-4f53-a710-3159c1eaf66e None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:26.898371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fef2c99c-ccc8-4f53-a710-3159c1eaf66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:26.970916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 493/962] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:26.995735 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03752670-cbb4-4deb-9fd9-86aff7f0aabf None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:27.076599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:27.106930 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03752670-cbb4-4deb-9fd9-86aff7f0aabf None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:27.142524 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c609ad-b1bb-4835-b1cf-38df67c71e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:27.143460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c609ad-b1bb-4835-b1cf-38df67c71e26 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:27.144002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c609ad-b1bb-4835-b1cf-38df67c71e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:27.144441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c609ad-b1bb-4835-b1cf-38df67c71e26 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:27.145278 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c609ad-b1bb-4835-b1cf-38df67c71e26 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:27.146876 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c609ad-b1bb-4835-b1cf-38df67c71e26 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:27.163273 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.sql.core [None req-86c609ad-b1bb-4835-b1cf-38df67c71e26 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 13:27:27.163273 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 02 13:27:27.163273 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [parameters: {'user_id': 'c302e482e4dd43c5b34ce6d387f25d03', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 02 13:27:27.163273 dv-cinder-836083-8-smb devstack@keystone.service[80238]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80238) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 13:27:27.171730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-86c609ad-b1bb-4835-b1cf-38df67c71e26 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 02 13:27:27.171730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:27.171730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:27:27.171730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:27:27.171730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:27:27.171730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:27:27.171730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:27:27.171730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:27:27.171730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:27:27.171730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:27:27.171730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:27:27.171730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:27:27.171730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:27:27.171730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application result.read() Jun 02 13:27:27.171730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:27:27.172794 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:27:27.172794 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:27:27.172794 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:27:27.172794 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:27:27.172794 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:27:27.172794 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:27:27.172794 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:27:27.172794 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 13:27:27.172794 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:27.172794 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 13:27:27.172794 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:27.172794 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:27.172794 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 13:27:27.172794 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 13:27:27.172794 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 02 13:27:27.172794 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 02 13:27:27.172794 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:27:27.172794 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:27:27.174048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 13:27:27.174048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application yield resource Jun 02 13:27:27.174048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:27:27.174048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:27:27.174048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 13:27:27.174048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 13:27:27.174048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 13:27:27.174048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 13:27:27.174048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 13:27:27.174048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise self.value Jun 02 13:27:27.174048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 13:27:27.174048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 13:27:27.174048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 13:27:27.174048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application session.commit() Jun 02 13:27:27.174048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 13:27:27.174048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 13:27:27.174048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 13:27:27.175085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 13:27:27.175085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 13:27:27.175085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self.session.flush() Jun 02 13:27:27.175085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 13:27:27.175085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 13:27:27.175085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 13:27:27.175085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 13:27:27.175085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 13:27:27.175085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application compat.raise_( Jun 02 13:27:27.175085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:27:27.175085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception Jun 02 13:27:27.175085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 13:27:27.175085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 13:27:27.175085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 13:27:27.175085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 13:27:27.175085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 13:27:27.175085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 13:27:27.175973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 13:27:27.175973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 13:27:27.175973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 02 13:27:27.175973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 02 13:27:27.175973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 13:27:27.175973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 13:27:27.175973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 13:27:27.175973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 13:27:27.175973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 13:27:27.175973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 13:27:27.175973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 13:27:27.175973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 13:27:27.175973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 13:27:27.175973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 13:27:27.175973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:27:27.175973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception Jun 02 13:27:27.176815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:27:27.176815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:27:27.176815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:27:27.176815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:27:27.176815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:27:27.176815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:27:27.176815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:27:27.176815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:27:27.176815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:27:27.176815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:27:27.176815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:27:27.176815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application result.read() Jun 02 13:27:27.176815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:27:27.176815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:27:27.176815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:27:27.176815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:27:27.177656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:27:27.177656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:27:27.177656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:27:27.177656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:27:27.177656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 13:27:27.177656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 02 13:27:27.177656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c302e482e4dd43c5b34ce6d387f25d03', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 02 13:27:27.177656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 13:27:27.177656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:27.177656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:27:27.177656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:27.177656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:27.177656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:27.177656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:27.177656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:27.178500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:27.178500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:27.178500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:27.178500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:27.178500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:27.178500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:27.178500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:27.178500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 02 13:27:27.178500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 02 13:27:27.178500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:27.178500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:27.178500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:27:27.178500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:27.178500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:27:27.178500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:27.178500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 02 13:27:27.178500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 02 13:27:27.179700 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 02 13:27:27.179700 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 02 13:27:27.179700 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 13:27:27.179700 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 13:27:27.179700 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 02 13:27:27.179700 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:27.181816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 470/963] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Jun 2 13:27:26 2022] POST /identity/v3/users => generated 160 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:27.191777 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2c99c-ccc8-4f53-a710-3159c1eaf66e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:27.284513 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:27.301688 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2c99c-ccc8-4f53-a710-3159c1eaf66e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:27.335902 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec97220-0e03-4430-a217-39de7fad5ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:27.336769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec97220-0e03-4430-a217-39de7fad5ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:27.337053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec97220-0e03-4430-a217-39de7fad5ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:27.337320 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec97220-0e03-4430-a217-39de7fad5ee1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:27.344697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec97220-0e03-4430-a217-39de7fad5ee1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:27.346149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec97220-0e03-4430-a217-39de7fad5ee1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:27.360858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-dec97220-0e03-4430-a217-39de7fad5ee1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:27:27.360858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:27.360858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:27.360858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:27.360858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:27.360858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:27.360858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:27.360858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:27.360858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:27.360858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:27.360858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:27.360858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:27.360858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:27:27.360858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:27:27.360858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:27:27.360858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:27:27.361834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:27.361834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:27.361834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:27:27.361834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:27.361834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:27:27.361834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:27.361834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:27.361834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:27.361834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:27.361834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:27.361834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:27.361834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:27.361834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:27.361834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:27.361834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:27.361834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:27.361834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:27.361834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:27.362907 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:27.362907 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:27.362907 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:27:27.362907 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:27:27.362907 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:27:27.362907 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:27:27.362907 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:27:27.362907 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:27:27.362907 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:27:27.362907 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:27.362907 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 494/964] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:27:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:27.371216 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c609ad-b1bb-4835-b1cf-38df67c71e26 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:27.481610 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c609ad-b1bb-4835-b1cf-38df67c71e26 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:27.522147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db5a79-24c2-490a-98d5-10e008f99ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:27.523267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db5a79-24c2-490a-98d5-10e008f99ded None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:27.523750 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db5a79-24c2-490a-98d5-10e008f99ded None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:27.524218 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db5a79-24c2-490a-98d5-10e008f99ded None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:27.525225 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db5a79-24c2-490a-98d5-10e008f99ded None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:27.525728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db5a79-24c2-490a-98d5-10e008f99ded None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:27.528352 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db5a79-24c2-490a-98d5-10e008f99ded None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:27.545678 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:27.568842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 471/965] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 13:27:27 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:27.822479 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186fb2b-77fc-4e40-a756-a6fc238ac507 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:27.822753 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186fb2b-77fc-4e40-a756-a6fc238ac507 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:27.823047 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186fb2b-77fc-4e40-a756-a6fc238ac507 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:27.824689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 495/966] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:27.832020 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45806bb7-0641-4ce4-b58e-0cb82ead55cc None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:27.832317 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45806bb7-0641-4ce4-b58e-0cb82ead55cc None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:27.832585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45806bb7-0641-4ce4-b58e-0cb82ead55cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:27.852675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-45806bb7-0641-4ce4-b58e-0cb82ead55cc None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:27.854858 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-45806bb7-0641-4ce4-b58e-0cb82ead55cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:27.928323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 472/967] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:27.951309 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186fb2b-77fc-4e40-a756-a6fc238ac507 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:28.055261 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186fb2b-77fc-4e40-a756-a6fc238ac507 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:28.095380 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c37cbc-f1f5-4b2e-bec7-f24d2ff8060f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:28.096137 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c37cbc-f1f5-4b2e-bec7-f24d2ff8060f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:28.096420 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c37cbc-f1f5-4b2e-bec7-f24d2ff8060f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:28.096649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c37cbc-f1f5-4b2e-bec7-f24d2ff8060f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:28.097340 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c37cbc-f1f5-4b2e-bec7-f24d2ff8060f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:28.098767 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c37cbc-f1f5-4b2e-bec7-f24d2ff8060f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:28.112059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-b9c37cbc-f1f5-4b2e-bec7-f24d2ff8060f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:27:28.112059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:28.112059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:27:28.112059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:27:28.112059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:27:28.112059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:27:28.112059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:27:28.112059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:28.112059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:27:28.112059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:28.112059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:27:28.112059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:28.112059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:28.112059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:28.112059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:28.112059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:28.112059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:28.113141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:28.113141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:28.113141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:28.113141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:28.113141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:28.113141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:28.113141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:27:28.113141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:27:28.113141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:27:28.113141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:27:28.113141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:28.113141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:28.113141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:28.113141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:28.113141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:28.113141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:28.119165 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:28.119165 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:28.119165 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:28.119165 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:28.119165 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:28.119165 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:28.119165 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:28.119165 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:28.119165 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:28.119165 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:28.119165 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:27:28.119165 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:28.119165 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:27:28.119165 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:28.119165 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 496/968] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 2 13:27:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:28.121843 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45806bb7-0641-4ce4-b58e-0cb82ead55cc None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:28.232661 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45806bb7-0641-4ce4-b58e-0cb82ead55cc None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:28.259231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:28.269641 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047348f-db69-4330-b71a-010b0dbc69f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:28.270326 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047348f-db69-4330-b71a-010b0dbc69f2 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:28.270617 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047348f-db69-4330-b71a-010b0dbc69f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:28.270900 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047348f-db69-4330-b71a-010b0dbc69f2 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:28.271607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047348f-db69-4330-b71a-010b0dbc69f2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:28.271915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047348f-db69-4330-b71a-010b0dbc69f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:28.273286 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047348f-db69-4330-b71a-010b0dbc69f2 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:28.278934 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 473/969] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 2 13:27:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:28.284895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c37cbc-f1f5-4b2e-bec7-f24d2ff8060f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:28.297366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:28.393298 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c37cbc-f1f5-4b2e-bec7-f24d2ff8060f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:28.411163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82313978-c1fa-4cb1-9940-255cd164ec86 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:28.411463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82313978-c1fa-4cb1-9940-255cd164ec86 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:28.411720 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82313978-c1fa-4cb1-9940-255cd164ec86 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:28.413100 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 474/970] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:27:28.419069 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab78f3-7d17-426f-a20e-f3ecdb08dfc7 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:28.419437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab78f3-7d17-426f-a20e-f3ecdb08dfc7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:28.419799 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab78f3-7d17-426f-a20e-f3ecdb08dfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:28.431868 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d11557-2451-425e-8e58-91e96bd9834b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:28.432540 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d11557-2451-425e-8e58-91e96bd9834b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:28.432817 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d11557-2451-425e-8e58-91e96bd9834b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:28.433202 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d11557-2451-425e-8e58-91e96bd9834b None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:28.433965 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d11557-2451-425e-8e58-91e96bd9834b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:28.434335 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d11557-2451-425e-8e58-91e96bd9834b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:28.435744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d11557-2451-425e-8e58-91e96bd9834b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:28.436843 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-8bab78f3-7d17-426f-a20e-f3ecdb08dfc7 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:28.438083 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8bab78f3-7d17-426f-a20e-f3ecdb08dfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:28.441062 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 497/971] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 2 13:27:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:28.446504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d11557-2451-425e-8e58-91e96bd9834b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:28.518783 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 475/972] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:28.528668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:28.543572 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab78f3-7d17-426f-a20e-f3ecdb08dfc7 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:28.563439 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d11557-2451-425e-8e58-91e96bd9834b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:28.605565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0567dbe-04c9-4afb-890b-2d1fbf85f022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:28.606379 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0567dbe-04c9-4afb-890b-2d1fbf85f022 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:28.606683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0567dbe-04c9-4afb-890b-2d1fbf85f022 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:28.606954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0567dbe-04c9-4afb-890b-2d1fbf85f022 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:28.607757 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0567dbe-04c9-4afb-890b-2d1fbf85f022 None admin] RBAC: Adding query filter params (interface=admin, service_id=b967d05ad7654bc1bb1f51b1bd8f4c94, region_id=RegionOne) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:28.608317 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0567dbe-04c9-4afb-890b-2d1fbf85f022 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:28.609434 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0567dbe-04c9-4afb-890b-2d1fbf85f022 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:28.620387 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 498/973] 10.222.0.18 () {56 vars in 1249 bytes} [Thu Jun 2 13:27:28 2022] GET /identity/v3/endpoints?service_id=b967d05ad7654bc1bb1f51b1bd8f4c94&interface=admin®ion_id=RegionOne => generated 193 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:28.621601 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0567dbe-04c9-4afb-890b-2d1fbf85f022 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:28.650330 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab78f3-7d17-426f-a20e-f3ecdb08dfc7 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:28.677077 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:28.700505 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f1efe-9418-4415-adb3-2ba21130c6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:28.701341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f1efe-9418-4415-adb3-2ba21130c6ba None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:28.701652 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f1efe-9418-4415-adb3-2ba21130c6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:28.701888 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f1efe-9418-4415-adb3-2ba21130c6ba None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:28.713227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f1efe-9418-4415-adb3-2ba21130c6ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:27:28.722401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-e93f1efe-9418-4415-adb3-2ba21130c6ba None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:27:28.722401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:28.722401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:28.722401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:28.722401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:28.722401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:28.722401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:28.722401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:28.722401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:28.722401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:28.722401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:28.722401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:28.722401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:27:28.722401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:27:28.722401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:27:28.722401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:27:28.723573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:27:28.723573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:27:28.723573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:27:28.723573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:27:28.723573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:28.723573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:28.723573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:28.723573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:28.723573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:28.723573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:28.723573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:28.723573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:28.723573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:28.723573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:28.723573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:28.723573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:28.724469 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:28.724469 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:28.724469 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:28.724469 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:28.724469 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:27:28.724469 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:27:28.724469 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:27:28.724469 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:27:28.724469 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:27:28.724469 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:27:28.724469 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:27:28.724469 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:28.730161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 476/974] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Jun 2 13:27:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:28.730980 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f1efe-9418-4415-adb3-2ba21130c6ba None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:28.774065 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0567dbe-04c9-4afb-890b-2d1fbf85f022 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:28.809839 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60b21d-9eb9-498a-9dfe-d594416bd5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:28.810625 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60b21d-9eb9-498a-9dfe-d594416bd5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:28.810966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60b21d-9eb9-498a-9dfe-d594416bd5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:28.811317 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60b21d-9eb9-498a-9dfe-d594416bd5e6 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:28.812063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60b21d-9eb9-498a-9dfe-d594416bd5e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:28.813495 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60b21d-9eb9-498a-9dfe-d594416bd5e6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:28.815391 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:28.836107 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 499/975] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 2 13:27:28 2022] GET /identity/v3/services => generated 1497 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:27:28.857542 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbe7a3-51e3-4754-8bdc-3d0de9f123ac None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:28.857807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbe7a3-51e3-4754-8bdc-3d0de9f123ac None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:28.858116 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbe7a3-51e3-4754-8bdc-3d0de9f123ac None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:28.859740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 500/976] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:27:28.865376 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19367d1-62dd-49c3-a82d-bbf89179b8dc None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:28.865657 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19367d1-62dd-49c3-a82d-bbf89179b8dc None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:28.865927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19367d1-62dd-49c3-a82d-bbf89179b8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:28.867307 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f1efe-9418-4415-adb3-2ba21130c6ba None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:28.883813 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e19367d1-62dd-49c3-a82d-bbf89179b8dc None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:28.885032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e19367d1-62dd-49c3-a82d-bbf89179b8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:28.910776 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82225ff-2eb6-4d26-975f-c09ddb6d7839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:28.911499 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82225ff-2eb6-4d26-975f-c09ddb6d7839 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:28.911841 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82225ff-2eb6-4d26-975f-c09ddb6d7839 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:28.912180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82225ff-2eb6-4d26-975f-c09ddb6d7839 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:28.913037 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82225ff-2eb6-4d26-975f-c09ddb6d7839 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:28.913410 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82225ff-2eb6-4d26-975f-c09ddb6d7839 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:28.914904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82225ff-2eb6-4d26-975f-c09ddb6d7839 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:28.929348 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 477/977] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jun 2 13:27:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:28.931606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82225ff-2eb6-4d26-975f-c09ddb6d7839 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:28.967002 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 501/978] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:27:28.984209 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:28.989740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19367d1-62dd-49c3-a82d-bbf89179b8dc None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:29.051075 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82225ff-2eb6-4d26-975f-c09ddb6d7839 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:29.087086 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66fd28-e5be-4bad-87a3-febfe0d9d255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:29.087901 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66fd28-e5be-4bad-87a3-febfe0d9d255 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:29.088189 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66fd28-e5be-4bad-87a3-febfe0d9d255 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:29.088461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66fd28-e5be-4bad-87a3-febfe0d9d255 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:29.100270 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66fd28-e5be-4bad-87a3-febfe0d9d255 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:29.100421 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19367d1-62dd-49c3-a82d-bbf89179b8dc None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:29.101710 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66fd28-e5be-4bad-87a3-febfe0d9d255 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:29.119845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-ab66fd28-e5be-4bad-87a3-febfe0d9d255 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:29.119845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:29.119845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:29.119845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:29.119845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:29.119845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:29.119845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:29.119845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:29.119845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:29.119845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:29.119845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:29.119845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:29.119845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:29.119845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:29.119845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:29.120912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:29.120912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:29.120912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:29.120912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:29.120912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:29.120912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:29.120912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:29.120912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:29.120912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:29.120912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:29.120912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:29.120912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:29.120912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:29.120912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:29.120912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:29.120912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:29.120912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:29.121804 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:29.121804 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:29.121804 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:29.121804 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:29.121804 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 478/979] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:29.126784 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66fd28-e5be-4bad-87a3-febfe0d9d255 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:29.132669 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:29.139172 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e515f-4b19-450b-b275-d64a5067b3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:29.140587 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e515f-4b19-450b-b275-d64a5067b3f2 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:29.141034 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e515f-4b19-450b-b275-d64a5067b3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:29.141246 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e515f-4b19-450b-b275-d64a5067b3f2 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:29.141967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e515f-4b19-450b-b275-d64a5067b3f2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:29.143497 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e515f-4b19-450b-b275-d64a5067b3f2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:29.160111 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 502/980] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 13:27:28 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:27:29.229626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:29.238708 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66fd28-e5be-4bad-87a3-febfe0d9d255 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:29.284143 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31196d-42c9-4e80-b674-b027791832a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:29.284827 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31196d-42c9-4e80-b674-b027791832a8 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:29.285106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31196d-42c9-4e80-b674-b027791832a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:29.285375 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31196d-42c9-4e80-b674-b027791832a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:29.286101 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e31196d-42c9-4e80-b674-b027791832a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:29.286401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e31196d-42c9-4e80-b674-b027791832a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:29.287801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e31196d-42c9-4e80-b674-b027791832a8 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:29.301423 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 479/981] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:29.307222 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e515f-4b19-450b-b275-d64a5067b3f2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:29.420602 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e515f-4b19-450b-b275-d64a5067b3f2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:29.453889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef276c-300b-45cd-9894-089def7efc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:29.454749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef276c-300b-45cd-9894-089def7efc53 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:29.455031 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef276c-300b-45cd-9894-089def7efc53 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:29.455298 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef276c-300b-45cd-9894-089def7efc53 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:29.462914 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef276c-300b-45cd-9894-089def7efc53 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:29.464429 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef276c-300b-45cd-9894-089def7efc53 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:29.479095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-f9ef276c-300b-45cd-9894-089def7efc53 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:27:29.479095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:29.479095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:29.479095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:29.479095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:29.479095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:29.479095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:29.479095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:29.479095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:29.479095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:29.479095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:29.479095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:29.479095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:27:29.479095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:27:29.479095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:27:29.479095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:27:29.480266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:29.480266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:29.480266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:27:29.480266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:29.480266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:27:29.480266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:29.480266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:29.480266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:29.480266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:29.480266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:29.480266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:29.480266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:29.480266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:29.480266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:29.480266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:29.480266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:29.480266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:29.480266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:29.481248 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:29.481248 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:29.481248 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:27:29.481248 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:27:29.481248 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:27:29.481248 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:27:29.481248 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:27:29.481248 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:27:29.481248 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:27:29.481248 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:29.481248 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 503/982] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 2 13:27:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:29.486366 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31196d-42c9-4e80-b674-b027791832a8 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:29.593654 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31196d-42c9-4e80-b674-b027791832a8 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:29.633778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841e71e-2e9d-4ea4-9af0-74ad076a84bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:29.633778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841e71e-2e9d-4ea4-9af0-74ad076a84bd None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:29.633778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841e71e-2e9d-4ea4-9af0-74ad076a84bd None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:29.633778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841e71e-2e9d-4ea4-9af0-74ad076a84bd None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:29.634121 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841e71e-2e9d-4ea4-9af0-74ad076a84bd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:29.634121 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841e71e-2e9d-4ea4-9af0-74ad076a84bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:29.635136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841e71e-2e9d-4ea4-9af0-74ad076a84bd None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:29.654735 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 480/983] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Jun 2 13:27:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:29.660389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef276c-300b-45cd-9894-089def7efc53 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:29.716676 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:29.770351 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef276c-300b-45cd-9894-089def7efc53 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:29.804007 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122ab46-517b-4423-996c-763c00b60de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:29.804666 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122ab46-517b-4423-996c-763c00b60de8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:29.804945 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122ab46-517b-4423-996c-763c00b60de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:29.805213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122ab46-517b-4423-996c-763c00b60de8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:29.872290 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122ab46-517b-4423-996c-763c00b60de8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:29.873742 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122ab46-517b-4423-996c-763c00b60de8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:29.921547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:29.979206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 504/984] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:27:29 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:27:29.981369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841e71e-2e9d-4ea4-9af0-74ad076a84bd None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:29.992427 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:30.082723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841e71e-2e9d-4ea4-9af0-74ad076a84bd None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:30.119710 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685ea41-04bb-4f03-b22a-aa7d04b0ef47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:30.120971 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685ea41-04bb-4f03-b22a-aa7d04b0ef47 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:30.121411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685ea41-04bb-4f03-b22a-aa7d04b0ef47 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:30.121834 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685ea41-04bb-4f03-b22a-aa7d04b0ef47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:30.134279 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685ea41-04bb-4f03-b22a-aa7d04b0ef47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:30.135750 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685ea41-04bb-4f03-b22a-aa7d04b0ef47 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:30.153820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-4685ea41-04bb-4f03-b22a-aa7d04b0ef47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:30.153820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:30.153820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:30.153820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:30.153820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:30.153820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:30.153820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:30.153820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:30.153820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:30.153820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:30.153820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:30.153820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:30.153820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:30.153820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:30.153820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:30.154729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:30.154729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:30.154729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:30.154729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:30.154729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:30.154729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:30.154729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:30.154729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:30.154729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:30.154729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:30.154729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:30.154729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:30.154729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:30.154729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:30.154729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:30.154729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:30.154729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:30.160472 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:30.160472 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:30.160472 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:30.160472 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:30.160472 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 481/985] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:30.162275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122ab46-517b-4423-996c-763c00b60de8 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:30.264075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122ab46-517b-4423-996c-763c00b60de8 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:30.298528 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be4f45-6feb-41c4-9268-62819e54104d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:30.299248 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be4f45-6feb-41c4-9268-62819e54104d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:30.299586 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be4f45-6feb-41c4-9268-62819e54104d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:30.299832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be4f45-6feb-41c4-9268-62819e54104d None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:30.300615 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be4f45-6feb-41c4-9268-62819e54104d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:30.300912 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be4f45-6feb-41c4-9268-62819e54104d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:30.302312 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be4f45-6feb-41c4-9268-62819e54104d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:30.320965 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 505/986] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:30.322366 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685ea41-04bb-4f03-b22a-aa7d04b0ef47 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:30.388873 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:30.435514 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685ea41-04bb-4f03-b22a-aa7d04b0ef47 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:30.476180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591eedf4-21f1-42e4-8a5e-5611e184998a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:30.477001 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591eedf4-21f1-42e4-8a5e-5611e184998a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:30.477283 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591eedf4-21f1-42e4-8a5e-5611e184998a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:30.477555 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591eedf4-21f1-42e4-8a5e-5611e184998a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:30.485361 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591eedf4-21f1-42e4-8a5e-5611e184998a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:30.486854 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591eedf4-21f1-42e4-8a5e-5611e184998a None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:30.501772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-591eedf4-21f1-42e4-8a5e-5611e184998a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:30.501772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:30.501772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:30.501772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:30.501772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:30.501772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:30.501772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:30.501772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:30.501772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:30.501772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:30.501772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:30.501772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:30.501772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:27:30.501772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:27:30.501772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:27:30.502690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:27:30.502690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:30.502690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:30.502690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:30.502690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:30.502690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:30.502690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:30.502690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:30.502690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:30.502690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:30.502690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:30.502690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:30.502690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:30.502690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:30.502690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:30.502690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:30.502690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:30.503673 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:27:30.503673 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:27:30.503673 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:27:30.503673 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:27:30.503673 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:27:30.503673 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:27:30.503673 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:30.503673 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:30.504851 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 482/987] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:27:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:30.511723 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be4f45-6feb-41c4-9268-62819e54104d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:30.527457 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:30.619235 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be4f45-6feb-41c4-9268-62819e54104d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:30.661417 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932de3ed-8ac3-4109-ae07-68c87b1967ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:30.662008 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932de3ed-8ac3-4109-ae07-68c87b1967ab None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:30.662286 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932de3ed-8ac3-4109-ae07-68c87b1967ab None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:30.662551 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932de3ed-8ac3-4109-ae07-68c87b1967ab None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:30.663373 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932de3ed-8ac3-4109-ae07-68c87b1967ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:30.663681 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932de3ed-8ac3-4109-ae07-68c87b1967ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:30.665113 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932de3ed-8ac3-4109-ae07-68c87b1967ab None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:30.677711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 506/988] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:27:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:30.683794 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591eedf4-21f1-42e4-8a5e-5611e184998a None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:30.797520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591eedf4-21f1-42e4-8a5e-5611e184998a None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:30.818675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:30.834554 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff68bf-099f-427f-a557-b56ac2febcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:30.835243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff68bf-099f-427f-a557-b56ac2febcab None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:30.835520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff68bf-099f-427f-a557-b56ac2febcab None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:30.835790 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff68bf-099f-427f-a557-b56ac2febcab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:30.836619 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff68bf-099f-427f-a557-b56ac2febcab None admin] RBAC: Adding query filter params (role.id=ee7c0043cf84487d98a7417ff2ffadd4, scope.project.id=af45a1ec7c94408bb638c55fb43fa961, user.id=cbf7d6db675047cbb3a3f16631c59622) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:30.836925 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff68bf-099f-427f-a557-b56ac2febcab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:30.838338 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff68bf-099f-427f-a557-b56ac2febcab None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:30.845006 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 483/989] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:27:30 2022] GET /identity/v3/role_assignments?user.id=cbf7d6db675047cbb3a3f16631c59622&scope.project.id=af45a1ec7c94408bb638c55fb43fa961&role.id=ee7c0043cf84487d98a7417ff2ffadd4 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:31.091586 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a889073-878f-408d-8768-3264d93bfc5d None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:31.092113 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a889073-878f-408d-8768-3264d93bfc5d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:31.092113 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a889073-878f-408d-8768-3264d93bfc5d None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:31.093521 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 507/990] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:27:31.099459 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e145a-a458-4216-8a9c-eb49716cf458 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:31.099993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e145a-a458-4216-8a9c-eb49716cf458 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:31.099993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e145a-a458-4216-8a9c-eb49716cf458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:31.118901 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-5e4e145a-a458-4216-8a9c-eb49716cf458 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:31.120022 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5e4e145a-a458-4216-8a9c-eb49716cf458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:31.192549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 484/991] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:31.215747 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a889073-878f-408d-8768-3264d93bfc5d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:31.287872 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:31.320469 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a889073-878f-408d-8768-3264d93bfc5d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:31.354549 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a9769-62f8-429d-aeaa-d52fd968413a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:31.355586 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a9769-62f8-429d-aeaa-d52fd968413a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:31.355860 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a9769-62f8-429d-aeaa-d52fd968413a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:31.356123 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a9769-62f8-429d-aeaa-d52fd968413a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:31.356775 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a9769-62f8-429d-aeaa-d52fd968413a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:31.358133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a9769-62f8-429d-aeaa-d52fd968413a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:31.370374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-2b1a9769-62f8-429d-aeaa-d52fd968413a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:27:31.370374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:31.370374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:27:31.370374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:27:31.370374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:27:31.370374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:27:31.370374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:27:31.370374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:31.370374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:27:31.370374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:31.370374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:27:31.370374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:31.370374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:31.370374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:31.370374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:31.370374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:31.370374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:31.371683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:31.371683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:31.371683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:31.371683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:31.371683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:31.371683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:31.371683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:27:31.371683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:27:31.371683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:27:31.371683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:27:31.371683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:31.371683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:31.371683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:31.371683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:31.371683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:31.371683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:31.372519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:31.372519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:31.372519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:31.372519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:31.372519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:31.372519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:31.372519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:31.372519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:31.372519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:31.372519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:31.372519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:27:31.372519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:31.372519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:27:31.372519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:31.374687 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 508/992] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 2 13:27:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:31.378163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e145a-a458-4216-8a9c-eb49716cf458 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:31.442305 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60e7d6-b523-45c8-a7a4-3ff24a91a59c None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:31.442615 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60e7d6-b523-45c8-a7a4-3ff24a91a59c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:31.442928 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60e7d6-b523-45c8-a7a4-3ff24a91a59c None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:31.444583 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 509/993] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:31.449516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf7250-6580-420a-ad5e-5491d5931f1b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:31.449795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf7250-6580-420a-ad5e-5491d5931f1b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:31.450067 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf7250-6580-420a-ad5e-5491d5931f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:31.467991 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6bcf7250-6580-420a-ad5e-5491d5931f1b None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:31.469408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6bcf7250-6580-420a-ad5e-5491d5931f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:31.491086 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e145a-a458-4216-8a9c-eb49716cf458 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:31.507625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:31.531704 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef94e46-4789-4f43-ba13-88864b01d66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:31.532373 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef94e46-4789-4f43-ba13-88864b01d66b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:31.532657 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef94e46-4789-4f43-ba13-88864b01d66b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:31.532925 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef94e46-4789-4f43-ba13-88864b01d66b None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:31.533626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef94e46-4789-4f43-ba13-88864b01d66b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:31.533931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef94e46-4789-4f43-ba13-88864b01d66b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:31.535322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef94e46-4789-4f43-ba13-88864b01d66b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:31.538860 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 510/994] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:31.544446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 485/995] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 2 13:27:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:31.550242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf7250-6580-420a-ad5e-5491d5931f1b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:31.563020 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef94e46-4789-4f43-ba13-88864b01d66b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:31.618114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:31.662362 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf7250-6580-420a-ad5e-5491d5931f1b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:31.672542 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef94e46-4789-4f43-ba13-88864b01d66b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:31.697979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24fe4d-deb8-4ed0-b98f-d332d2e49ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:31.698827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24fe4d-deb8-4ed0-b98f-d332d2e49ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:31.699036 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24fe4d-deb8-4ed0-b98f-d332d2e49ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:31.699301 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24fe4d-deb8-4ed0-b98f-d332d2e49ea9 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:31.700107 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24fe4d-deb8-4ed0-b98f-d332d2e49ea9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:31.700408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24fe4d-deb8-4ed0-b98f-d332d2e49ea9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:31.701777 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24fe4d-deb8-4ed0-b98f-d332d2e49ea9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:31.707014 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 511/996] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 2 13:27:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:31.712518 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24fe4d-deb8-4ed0-b98f-d332d2e49ea9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:31.713938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bda63d-92b3-47d1-ab52-b3e574fb8666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:31.715204 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bda63d-92b3-47d1-ab52-b3e574fb8666 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:31.715317 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bda63d-92b3-47d1-ab52-b3e574fb8666 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:31.715527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bda63d-92b3-47d1-ab52-b3e574fb8666 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:31.716178 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bda63d-92b3-47d1-ab52-b3e574fb8666 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:31.717534 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bda63d-92b3-47d1-ab52-b3e574fb8666 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:31.729479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-07bda63d-92b3-47d1-ab52-b3e574fb8666 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:27:31.729479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:31.729479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:27:31.729479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:27:31.729479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:27:31.729479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:27:31.729479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:27:31.729479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:31.729479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:27:31.729479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:31.729479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:27:31.729479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:31.729479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:31.729479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:31.729479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:31.729479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:31.729479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:31.730830 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:31.730830 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:31.730830 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:31.730830 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:31.730830 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:31.730830 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:31.730830 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:27:31.730830 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:27:31.730830 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:27:31.730830 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:27:31.730830 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:31.730830 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:31.730830 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:31.730830 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:31.730830 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:31.730830 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:31.731679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:31.731679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:31.731679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:31.731679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:31.731679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:31.731679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:31.731679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:31.731679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:31.731679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:31.731679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:31.731679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:27:31.731679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:31.731679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:27:31.731679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:31.731679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 486/997] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:27:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:31.737902 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bda63d-92b3-47d1-ab52-b3e574fb8666 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:31.784765 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:31.818282 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24fe4d-deb8-4ed0-b98f-d332d2e49ea9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:31.842704 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bda63d-92b3-47d1-ab52-b3e574fb8666 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:31.847038 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:31.856271 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88fe87-a888-46a4-8c0e-82a7f2d7087d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:31.856967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88fe87-a888-46a4-8c0e-82a7f2d7087d None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:31.857220 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88fe87-a888-46a4-8c0e-82a7f2d7087d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:31.857492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88fe87-a888-46a4-8c0e-82a7f2d7087d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:31.858243 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88fe87-a888-46a4-8c0e-82a7f2d7087d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:31.859648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88fe87-a888-46a4-8c0e-82a7f2d7087d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:31.875003 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 512/998] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 2 13:27:31 2022] POST /identity/v3/endpoints => generated 325 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:27:31.893915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecc698-47ef-4888-a7ea-35f8c9c113c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:31.894638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecc698-47ef-4888-a7ea-35f8c9c113c3 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:31.894916 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecc698-47ef-4888-a7ea-35f8c9c113c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:31.895182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecc698-47ef-4888-a7ea-35f8c9c113c3 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:31.895913 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecc698-47ef-4888-a7ea-35f8c9c113c3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:31.896263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecc698-47ef-4888-a7ea-35f8c9c113c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:31.897687 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecc698-47ef-4888-a7ea-35f8c9c113c3 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:31.904605 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 487/999] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 2 13:27:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:31.911983 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88fe87-a888-46a4-8c0e-82a7f2d7087d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:32.030165 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88fe87-a888-46a4-8c0e-82a7f2d7087d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:32.067304 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f0fea-93c5-4397-9f5a-7849f73ee2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:32.068007 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f0fea-93c5-4397-9f5a-7849f73ee2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:32.068286 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f0fea-93c5-4397-9f5a-7849f73ee2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:32.068553 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f0fea-93c5-4397-9f5a-7849f73ee2b3 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:32.069278 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f0fea-93c5-4397-9f5a-7849f73ee2b3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:32.069581 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f0fea-93c5-4397-9f5a-7849f73ee2b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:32.071005 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f0fea-93c5-4397-9f5a-7849f73ee2b3 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:32.081565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 513/1000] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 2 13:27:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:32.082897 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecc698-47ef-4888-a7ea-35f8c9c113c3 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:32.186500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecc698-47ef-4888-a7ea-35f8c9c113c3 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:32.188065 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:32.222583 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb938eca-52cf-4a23-a379-291487fd4038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:32.223343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb938eca-52cf-4a23-a379-291487fd4038 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:32.223623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb938eca-52cf-4a23-a379-291487fd4038 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:32.223903 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb938eca-52cf-4a23-a379-291487fd4038 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:32.224688 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb938eca-52cf-4a23-a379-291487fd4038 None admin] RBAC: Adding query filter params (interface=public, service_id=fa41ccf75c744f8e9291e54d90ff4fc9, region_id=RegionOne) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:32.224996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb938eca-52cf-4a23-a379-291487fd4038 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:32.226357 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb938eca-52cf-4a23-a379-291487fd4038 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:32.236130 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 488/1001] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jun 2 13:27:32 2022] GET /identity/v3/endpoints?service_id=fa41ccf75c744f8e9291e54d90ff4fc9&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:32.237370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f0fea-93c5-4397-9f5a-7849f73ee2b3 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:32.291518 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:32.342009 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f0fea-93c5-4397-9f5a-7849f73ee2b3 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:32.376780 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d86547-7750-4af7-93a5-e3945417f34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:32.377453 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d86547-7750-4af7-93a5-e3945417f34e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:32.377730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d86547-7750-4af7-93a5-e3945417f34e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:32.377997 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d86547-7750-4af7-93a5-e3945417f34e None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:32.378708 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d86547-7750-4af7-93a5-e3945417f34e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:32.380074 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d86547-7750-4af7-93a5-e3945417f34e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:32.390670 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 514/1002] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 2 13:27:32 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:27:33.132913 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b79e7-e822-480b-ba24-692d432fde6d None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:33.133332 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b79e7-e822-480b-ba24-692d432fde6d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:33.133436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b79e7-e822-480b-ba24-692d432fde6d None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:33.135049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 489/1003] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:33.141309 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498303d-0a49-4b75-be2c-daa9a4a82d17 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:33.141576 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498303d-0a49-4b75-be2c-daa9a4a82d17 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:33.141869 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498303d-0a49-4b75-be2c-daa9a4a82d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:33.159878 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e498303d-0a49-4b75-be2c-daa9a4a82d17 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:33.161075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e498303d-0a49-4b75-be2c-daa9a4a82d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:33.237501 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 515/1004] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:33 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:33.260386 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b79e7-e822-480b-ba24-692d432fde6d None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:33.370067 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b79e7-e822-480b-ba24-692d432fde6d None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:33.406585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5834bcb-9975-42e2-bd19-da548e1084be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:33.407345 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5834bcb-9975-42e2-bd19-da548e1084be None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:33.407625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5834bcb-9975-42e2-bd19-da548e1084be None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:33.407894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5834bcb-9975-42e2-bd19-da548e1084be None admin] PATH_INFO: `/v3/services/image` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:33.408600 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5834bcb-9975-42e2-bd19-da548e1084be None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:33.410062 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5834bcb-9975-42e2-bd19-da548e1084be None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:33.423419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-f5834bcb-9975-42e2-bd19-da548e1084be None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:27:33.423419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:33.423419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:27:33.423419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:27:33.423419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:27:33.423419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:27:33.423419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:27:33.423419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:33.423419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:27:33.423419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:33.423419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:27:33.423419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:33.423419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:33.423419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:33.423419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:33.423419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:33.423419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:33.424825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:33.424825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:33.424825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:33.424825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:33.424825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:33.424825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:33.424825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:27:33.424825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:27:33.424825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:27:33.424825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:27:33.424825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:33.424825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:33.424825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:33.424825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:33.424825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:33.424825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:33.425767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:33.425767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:33.425767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:33.425767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:33.425767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:33.425767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:33.425767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:33.425767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:33.425767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:33.425767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:33.425767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:27:33.425767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:33.425767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:27:33.425767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:33.425767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 490/1005] 10.222.0.18 () {56 vars in 1105 bytes} [Thu Jun 2 13:27:33 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:33.433383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498303d-0a49-4b75-be2c-daa9a4a82d17 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:33.484847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:33.544158 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498303d-0a49-4b75-be2c-daa9a4a82d17 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:33.579691 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf3824-2627-490f-a3b2-976e88a4a7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:33.580381 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf3824-2627-490f-a3b2-976e88a4a7da None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:33.580653 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf3824-2627-490f-a3b2-976e88a4a7da None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:33.580923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf3824-2627-490f-a3b2-976e88a4a7da None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:33.581630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf3824-2627-490f-a3b2-976e88a4a7da None admin] RBAC: Adding query filter params (name=image) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:33.581930 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf3824-2627-490f-a3b2-976e88a4a7da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:33.583335 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf3824-2627-490f-a3b2-976e88a4a7da None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:33.588373 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 516/1006] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:33.594007 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5834bcb-9975-42e2-bd19-da548e1084be None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:33.628358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:33.708587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5834bcb-9975-42e2-bd19-da548e1084be None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:33.743268 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af9bdf-2fa5-4687-87a7-f697ac01e779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:33.743944 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af9bdf-2fa5-4687-87a7-f697ac01e779 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:33.744223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af9bdf-2fa5-4687-87a7-f697ac01e779 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:33.744503 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af9bdf-2fa5-4687-87a7-f697ac01e779 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:33.745194 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af9bdf-2fa5-4687-87a7-f697ac01e779 None admin] RBAC: Adding query filter params (type=image) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:33.745557 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af9bdf-2fa5-4687-87a7-f697ac01e779 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:33.746941 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af9bdf-2fa5-4687-87a7-f697ac01e779 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:33.751715 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 491/1007] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:34.163455 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c492e-c2e2-4825-9d75-742c9b0668e6 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:34.163828 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c492e-c2e2-4825-9d75-742c9b0668e6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:34.164002 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c492e-c2e2-4825-9d75-742c9b0668e6 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:34.165342 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 517/1008] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:34.171459 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55e4a9-b5c6-4556-b2ff-3f31203dc26c None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:34.171721 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55e4a9-b5c6-4556-b2ff-3f31203dc26c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:34.172015 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55e4a9-b5c6-4556-b2ff-3f31203dc26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:34.189200 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-db55e4a9-b5c6-4556-b2ff-3f31203dc26c None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:34.190380 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-db55e4a9-b5c6-4556-b2ff-3f31203dc26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:34.260132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 492/1009] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:34 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:34.283631 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c492e-c2e2-4825-9d75-742c9b0668e6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:34.393442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c492e-c2e2-4825-9d75-742c9b0668e6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:34.405066 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:34.433084 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53b7e5-69c7-40ac-8c05-93ad87bc1a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:34.434131 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53b7e5-69c7-40ac-8c05-93ad87bc1a19 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:34.434603 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53b7e5-69c7-40ac-8c05-93ad87bc1a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:34.435016 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53b7e5-69c7-40ac-8c05-93ad87bc1a19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:34.436364 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53b7e5-69c7-40ac-8c05-93ad87bc1a19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:34.438005 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53b7e5-69c7-40ac-8c05-93ad87bc1a19 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:34.440185 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 518/1010] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:34.445696 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55e4a9-b5c6-4556-b2ff-3f31203dc26c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:34.471168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:34.549882 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55e4a9-b5c6-4556-b2ff-3f31203dc26c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:34.584827 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123983f-fea5-4164-bb9d-a29954280a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:34.585500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123983f-fea5-4164-bb9d-a29954280a17 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:34.585783 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123983f-fea5-4164-bb9d-a29954280a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:34.586056 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123983f-fea5-4164-bb9d-a29954280a17 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:34.586814 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123983f-fea5-4164-bb9d-a29954280a17 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:34.588223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123983f-fea5-4164-bb9d-a29954280a17 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:34.618608 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 493/1011] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 13:27:34 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:27:34.658704 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1725e-46a0-4286-8923-e74dc19a5088 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:34.659071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1725e-46a0-4286-8923-e74dc19a5088 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:34.659276 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1725e-46a0-4286-8923-e74dc19a5088 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:34.660618 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 519/1012] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:34.666766 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c049b-d56f-4c93-84bd-afac9ba6658c None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:34.667113 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c049b-d56f-4c93-84bd-afac9ba6658c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:34.667344 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c049b-d56f-4c93-84bd-afac9ba6658c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:34.686697 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-bc0c049b-d56f-4c93-84bd-afac9ba6658c None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:34.687854 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-bc0c049b-d56f-4c93-84bd-afac9ba6658c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:34.763435 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 494/1013] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:34 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:34.787011 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1725e-46a0-4286-8923-e74dc19a5088 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:34.899527 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1725e-46a0-4286-8923-e74dc19a5088 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:34.934537 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab31cc3-a83f-4248-bd6c-ed9a5de3cfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:34.935369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab31cc3-a83f-4248-bd6c-ed9a5de3cfa1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:34.935650 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab31cc3-a83f-4248-bd6c-ed9a5de3cfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:34.935977 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab31cc3-a83f-4248-bd6c-ed9a5de3cfa1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:34.936634 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab31cc3-a83f-4248-bd6c-ed9a5de3cfa1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:34.938051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab31cc3-a83f-4248-bd6c-ed9a5de3cfa1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:34.949976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-7ab31cc3-a83f-4248-bd6c-ed9a5de3cfa1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:27:34.949976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:34.949976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:27:34.949976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:27:34.949976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:27:34.949976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:27:34.949976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:27:34.949976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:34.949976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:27:34.949976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:34.949976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:27:34.949976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:34.949976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:34.949976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:34.949976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:34.949976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:34.949976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:34.951233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:34.951233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:34.951233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:34.951233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:34.951233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:34.951233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:34.951233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:27:34.951233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:27:34.951233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:27:34.951233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:27:34.951233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:34.951233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:34.951233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:34.951233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:34.951233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:34.951233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:34.952082 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:34.952082 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:34.952082 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:34.952082 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:34.952082 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:34.952082 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:34.952082 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:34.952082 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:34.952082 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:34.952082 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:34.952082 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:27:34.952082 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:34.952082 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:27:34.952082 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:34.952082 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 520/1014] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:27:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:34.957623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c049b-d56f-4c93-84bd-afac9ba6658c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:34.966848 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:35.061254 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c049b-d56f-4c93-84bd-afac9ba6658c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:35.095565 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe6683-7eaf-4201-bc43-fb99066f90fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:35.096239 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe6683-7eaf-4201-bc43-fb99066f90fe None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:35.096527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe6683-7eaf-4201-bc43-fb99066f90fe None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:35.096791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe6683-7eaf-4201-bc43-fb99066f90fe None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:35.097496 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe6683-7eaf-4201-bc43-fb99066f90fe None admin] RBAC: Adding query filter params (name=compute) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:35.097784 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe6683-7eaf-4201-bc43-fb99066f90fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:35.099210 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe6683-7eaf-4201-bc43-fb99066f90fe None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:35.104244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 495/1015] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 2 13:27:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:35.109959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab31cc3-a83f-4248-bd6c-ed9a5de3cfa1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:35.154455 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:35.212904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab31cc3-a83f-4248-bd6c-ed9a5de3cfa1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:35.248558 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c21e7-d45d-4cd1-a7c9-6f6b7b674f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:35.249384 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c21e7-d45d-4cd1-a7c9-6f6b7b674f9d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:35.249757 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c21e7-d45d-4cd1-a7c9-6f6b7b674f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:35.250119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c21e7-d45d-4cd1-a7c9-6f6b7b674f9d None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:35.250975 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c21e7-d45d-4cd1-a7c9-6f6b7b674f9d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:35.251380 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c21e7-d45d-4cd1-a7c9-6f6b7b674f9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:35.252836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c21e7-d45d-4cd1-a7c9-6f6b7b674f9d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:35.258223 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 521/1016] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 2 13:27:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:35.263867 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe6683-7eaf-4201-bc43-fb99066f90fe None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:35.333837 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:35.366128 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe6683-7eaf-4201-bc43-fb99066f90fe None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:35.400414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b24b12-5d40-47e7-ba37-d11ba15d4eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:35.401440 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b24b12-5d40-47e7-ba37-d11ba15d4eda None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:35.401887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b24b12-5d40-47e7-ba37-d11ba15d4eda None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:35.402253 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b24b12-5d40-47e7-ba37-d11ba15d4eda None admin] PATH_INFO: `/v3/endpoints` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:35.403023 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b24b12-5d40-47e7-ba37-d11ba15d4eda None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:35.404378 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b24b12-5d40-47e7-ba37-d11ba15d4eda None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:35.429873 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 496/1017] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 2 13:27:35 2022] POST /identity/v3/endpoints => generated 334 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:27:35.974917 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25619f96-fcc0-467b-8c9a-7899187a7cc7 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:35.975513 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25619f96-fcc0-467b-8c9a-7899187a7cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:35.975513 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25619f96-fcc0-467b-8c9a-7899187a7cc7 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:35.976962 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 522/1018] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:35.982228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220619d-c13c-4533-95ee-173ed6701ed9 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:35.982665 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220619d-c13c-4533-95ee-173ed6701ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:35.982764 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220619d-c13c-4533-95ee-173ed6701ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:36.000128 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-4220619d-c13c-4533-95ee-173ed6701ed9 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:36.001292 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4220619d-c13c-4533-95ee-173ed6701ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:36.076648 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 497/1019] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:35 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:36.098996 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25619f96-fcc0-467b-8c9a-7899187a7cc7 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:36.201405 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25619f96-fcc0-467b-8c9a-7899187a7cc7 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:36.208718 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:36.237499 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8ff9e-ada6-44a9-b0c9-4ac9cf5bc862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:36.238087 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8ff9e-ada6-44a9-b0c9-4ac9cf5bc862 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:36.238361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8ff9e-ada6-44a9-b0c9-4ac9cf5bc862 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:36.238655 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8ff9e-ada6-44a9-b0c9-4ac9cf5bc862 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:36.239379 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8ff9e-ada6-44a9-b0c9-4ac9cf5bc862 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:36.240731 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8ff9e-ada6-44a9-b0c9-4ac9cf5bc862 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:36.262617 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 523/1020] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 13:27:36 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:27:36.932462 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fd39d-4e38-40bb-a1e2-93e4253cf1df None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:36.932713 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fd39d-4e38-40bb-a1e2-93e4253cf1df None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:36.933225 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fd39d-4e38-40bb-a1e2-93e4253cf1df None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:36.934856 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 498/1021] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:36.940110 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db6b1a-ff83-4b75-b0eb-7e01c8308c2d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:36.940406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db6b1a-ff83-4b75-b0eb-7e01c8308c2d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:36.940637 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db6b1a-ff83-4b75-b0eb-7e01c8308c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:36.957861 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-42db6b1a-ff83-4b75-b0eb-7e01c8308c2d None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:36.959074 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-42db6b1a-ff83-4b75-b0eb-7e01c8308c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:37.032163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 524/1022] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:27:37.056889 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fd39d-4e38-40bb-a1e2-93e4253cf1df None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:37.114699 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:37.166650 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fd39d-4e38-40bb-a1e2-93e4253cf1df None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:37.200781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849f0fd-0487-49bd-9caf-3ba3f1b0ab1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:37.201495 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849f0fd-0487-49bd-9caf-3ba3f1b0ab1e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:37.201775 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849f0fd-0487-49bd-9caf-3ba3f1b0ab1e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:37.202043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849f0fd-0487-49bd-9caf-3ba3f1b0ab1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:37.203222 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849f0fd-0487-49bd-9caf-3ba3f1b0ab1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:37.204638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849f0fd-0487-49bd-9caf-3ba3f1b0ab1e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:37.206416 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 499/1023] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:37.212066 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db6b1a-ff83-4b75-b0eb-7e01c8308c2d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:37.303722 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:37.315315 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db6b1a-ff83-4b75-b0eb-7e01c8308c2d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:37.349273 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef73326-09fd-4491-aa68-6e49f75b1ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:37.350058 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef73326-09fd-4491-aa68-6e49f75b1ec2 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:37.350338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef73326-09fd-4491-aa68-6e49f75b1ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:37.350676 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef73326-09fd-4491-aa68-6e49f75b1ec2 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:37.351339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef73326-09fd-4491-aa68-6e49f75b1ec2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:37.352772 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef73326-09fd-4491-aa68-6e49f75b1ec2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:37.374160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 525/1024] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 13:27:37 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:27:37.784724 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b8759-334d-4031-84dc-fe259d56ce57 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:37.784976 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b8759-334d-4031-84dc-fe259d56ce57 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:37.785250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b8759-334d-4031-84dc-fe259d56ce57 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:37.786820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 500/1025] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:37.792075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659e1fd-c9d6-4fec-be26-1d86ffbe4127 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:37.792911 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659e1fd-c9d6-4fec-be26-1d86ffbe4127 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:37.792911 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659e1fd-c9d6-4fec-be26-1d86ffbe4127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:37.809825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6659e1fd-c9d6-4fec-be26-1d86ffbe4127 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:37.811053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6659e1fd-c9d6-4fec-be26-1d86ffbe4127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:37.881057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 526/1026] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:37.905405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b8759-334d-4031-84dc-fe259d56ce57 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:38.009476 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b8759-334d-4031-84dc-fe259d56ce57 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:38.031011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:38.046458 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9c31c-c307-44c4-bc80-4846bd16498f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:38.047326 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9c31c-c307-44c4-bc80-4846bd16498f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:38.047598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9c31c-c307-44c4-bc80-4846bd16498f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:38.047866 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9c31c-c307-44c4-bc80-4846bd16498f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:38.058231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9c31c-c307-44c4-bc80-4846bd16498f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:27:38.066471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-10d9c31c-c307-44c4-bc80-4846bd16498f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:27:38.066471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:38.066471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:38.066471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:38.066471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:38.066471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:38.066471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:38.066471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:38.066471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:38.066471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:38.066471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:38.066471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:38.066471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:27:38.066471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:27:38.066471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:27:38.066471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:27:38.067411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:27:38.067411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:27:38.067411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:27:38.067411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:27:38.067411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:38.067411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:38.067411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:38.067411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:38.067411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:38.067411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:38.067411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:38.067411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:38.067411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:38.067411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:38.067411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:38.067411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:38.068249 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:38.068249 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:38.068249 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:38.068249 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:38.068249 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:27:38.068249 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:27:38.068249 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:27:38.068249 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:27:38.068249 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:27:38.068249 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:27:38.068249 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:27:38.068249 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:38.072881 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 501/1027] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Jun 2 13:27:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:38.074039 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659e1fd-c9d6-4fec-be26-1d86ffbe4127 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:38.153311 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:38.176484 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659e1fd-c9d6-4fec-be26-1d86ffbe4127 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:38.216247 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449811b-d7d5-47a8-a3c8-e40033c96e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:38.217176 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449811b-d7d5-47a8-a3c8-e40033c96e5a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:38.217452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449811b-d7d5-47a8-a3c8-e40033c96e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:38.217711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449811b-d7d5-47a8-a3c8-e40033c96e5a None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:38.218479 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449811b-d7d5-47a8-a3c8-e40033c96e5a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:38.218809 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449811b-d7d5-47a8-a3c8-e40033c96e5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:38.220208 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449811b-d7d5-47a8-a3c8-e40033c96e5a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:38.230480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 527/1028] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jun 2 13:27:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:38.236368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9c31c-c307-44c4-bc80-4846bd16498f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:38.343753 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9c31c-c307-44c4-bc80-4846bd16498f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:38.379915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3ff03-0192-408e-b26d-a1164db7b324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:38.380717 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3ff03-0192-408e-b26d-a1164db7b324 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:38.380995 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3ff03-0192-408e-b26d-a1164db7b324 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:38.381261 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3ff03-0192-408e-b26d-a1164db7b324 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:38.392951 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c3ff03-0192-408e-b26d-a1164db7b324 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:38.394383 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c3ff03-0192-408e-b26d-a1164db7b324 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:38.412461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-b6c3ff03-0192-408e-b26d-a1164db7b324 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:38.412461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:38.412461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:38.412461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:38.412461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:38.412461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:38.412461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:38.412461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:38.412461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:38.412461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:38.412461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:38.412461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:38.412461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:38.412461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:38.412461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:38.413379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:38.413379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:38.413379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:38.413379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:38.413379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:38.413379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:38.413379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:38.413379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:38.413379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:38.413379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:38.413379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:38.413379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:38.413379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:38.413379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:38.413379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:38.413379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:38.413379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:38.414257 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:38.414257 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:38.414257 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:38.414257 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:38.418445 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 502/1029] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:38.419924 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449811b-d7d5-47a8-a3c8-e40033c96e5a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:38.520975 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449811b-d7d5-47a8-a3c8-e40033c96e5a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:38.544399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0fcbc-c526-4898-8ab5-a77730e3cbd9 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:38.544681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0fcbc-c526-4898-8ab5-a77730e3cbd9 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:38.544958 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0fcbc-c526-4898-8ab5-a77730e3cbd9 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:38.546352 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 503/1030] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:38.551560 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b2aec-4633-490c-9832-13169cd73f28 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:38.552091 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b2aec-4633-490c-9832-13169cd73f28 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:38.552570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b2aec-4633-490c-9832-13169cd73f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:38.562255 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39679fa-28ef-4f9c-aded-6f06e8c2b46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:38.562990 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39679fa-28ef-4f9c-aded-6f06e8c2b46e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:38.563270 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39679fa-28ef-4f9c-aded-6f06e8c2b46e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:38.563671 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39679fa-28ef-4f9c-aded-6f06e8c2b46e None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:38.564288 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39679fa-28ef-4f9c-aded-6f06e8c2b46e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:38.564596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39679fa-28ef-4f9c-aded-6f06e8c2b46e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:38.566013 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39679fa-28ef-4f9c-aded-6f06e8c2b46e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:38.571149 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-a76b2aec-4633-490c-9832-13169cd73f28 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:38.572320 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a76b2aec-4633-490c-9832-13169cd73f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:38.576749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:38.585446 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 528/1031] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:38.586588 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39679fa-28ef-4f9c-aded-6f06e8c2b46e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:38.603680 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:38.648235 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 504/1032] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:27:38.671934 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b2aec-4633-490c-9832-13169cd73f28 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:38.702524 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39679fa-28ef-4f9c-aded-6f06e8c2b46e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:38.740316 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f360f9-75e1-4230-bef0-cfa0eb063524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:38.740896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f360f9-75e1-4230-bef0-cfa0eb063524 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:38.741176 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f360f9-75e1-4230-bef0-cfa0eb063524 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:38.741451 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f360f9-75e1-4230-bef0-cfa0eb063524 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:38.750011 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f360f9-75e1-4230-bef0-cfa0eb063524 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:38.757765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f360f9-75e1-4230-bef0-cfa0eb063524 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:38.777661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-b6f360f9-75e1-4230-bef0-cfa0eb063524 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:27:38.777661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:38.777661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:38.777661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:38.777661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:38.777661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:38.777661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:38.777661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:38.777661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:38.777661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:38.777661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:38.777661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:38.777661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:27:38.777661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:27:38.777661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:27:38.777661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:27:38.778951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:38.778951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:38.778951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:27:38.778951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:38.778951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:27:38.778951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:38.778951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:38.778951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:38.778951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:38.778951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:38.778951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:38.778951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:38.778951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:38.778951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:38.778951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:38.778951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:38.778951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:38.778951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:38.779929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:38.779929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:38.779929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:27:38.779929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:27:38.779929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:27:38.779929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:27:38.779929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:27:38.779929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:27:38.779929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:27:38.779929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:38.779929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 529/1033] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 2 13:27:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:38.787988 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f360f9-75e1-4230-bef0-cfa0eb063524 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:38.799026 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b2aec-4633-490c-9832-13169cd73f28 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:38.844578 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b886766-97ef-4d1f-9acc-8e16cbe3fc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:38.845382 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b886766-97ef-4d1f-9acc-8e16cbe3fc55 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:38.845655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b886766-97ef-4d1f-9acc-8e16cbe3fc55 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:38.845932 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b886766-97ef-4d1f-9acc-8e16cbe3fc55 None admin] PATH_INFO: `/v3/services/image` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:38.846598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b886766-97ef-4d1f-9acc-8e16cbe3fc55 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:38.847977 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b886766-97ef-4d1f-9acc-8e16cbe3fc55 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:38.859809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-4b886766-97ef-4d1f-9acc-8e16cbe3fc55 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:27:38.859809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:38.859809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:27:38.859809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:27:38.859809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:27:38.859809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:27:38.859809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:27:38.859809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:38.859809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:27:38.859809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:38.859809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:27:38.859809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:38.859809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:38.859809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:38.859809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:38.859809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:38.859809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:38.860820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:38.860820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:38.860820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:38.860820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:38.860820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:38.860820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:38.860820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:27:38.860820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:27:38.860820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:27:38.860820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:27:38.860820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:38.860820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:38.860820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:38.860820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:38.860820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:38.860820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:38.861719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:38.861719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:38.861719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:38.861719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:38.861719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:38.861719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:38.861719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:38.861719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:38.861719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:38.861719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:38.861719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:27:38.861719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:38.861719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:27:38.861719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:38.862473 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:38.862547 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 505/1034] 10.222.0.18 () {56 vars in 1105 bytes} [Thu Jun 2 13:27:38 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:38.867460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b886766-97ef-4d1f-9acc-8e16cbe3fc55 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:38.899240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:38.908608 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f360f9-75e1-4230-bef0-cfa0eb063524 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:38.944969 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38c769-2d33-4fca-9350-4c4ad9f8d799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:38.945865 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38c769-2d33-4fca-9350-4c4ad9f8d799 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:38.946311 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38c769-2d33-4fca-9350-4c4ad9f8d799 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:38.946771 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38c769-2d33-4fca-9350-4c4ad9f8d799 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:38.947768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38c769-2d33-4fca-9350-4c4ad9f8d799 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:38.948222 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38c769-2d33-4fca-9350-4c4ad9f8d799 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:38.949859 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38c769-2d33-4fca-9350-4c4ad9f8d799 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:38.968007 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 530/1035] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 2 13:27:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:38.973453 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38c769-2d33-4fca-9350-4c4ad9f8d799 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:38.983367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b886766-97ef-4d1f-9acc-8e16cbe3fc55 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:39.018460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60369466-d50b-4bb3-b6a4-ec5b2669ab98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:39.019211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60369466-d50b-4bb3-b6a4-ec5b2669ab98 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:39.019482 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60369466-d50b-4bb3-b6a4-ec5b2669ab98 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:39.019754 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60369466-d50b-4bb3-b6a4-ec5b2669ab98 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:39.020457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60369466-d50b-4bb3-b6a4-ec5b2669ab98 None admin] RBAC: Adding query filter params (name=image) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:39.020764 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60369466-d50b-4bb3-b6a4-ec5b2669ab98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:39.022119 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60369466-d50b-4bb3-b6a4-ec5b2669ab98 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:39.032646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 506/1036] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:39.033727 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60369466-d50b-4bb3-b6a4-ec5b2669ab98 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:39.082399 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38c769-2d33-4fca-9350-4c4ad9f8d799 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:39.100197 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:39.120395 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844ce60-d5f2-4b2b-a5f6-6598cfb307c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:39.121066 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844ce60-d5f2-4b2b-a5f6-6598cfb307c9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:39.121344 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844ce60-d5f2-4b2b-a5f6-6598cfb307c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:39.121769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844ce60-d5f2-4b2b-a5f6-6598cfb307c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:39.127850 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:39.138590 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60369466-d50b-4bb3-b6a4-ec5b2669ab98 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:39.175590 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320e338-112c-4c52-92aa-b12073ae0309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:39.176273 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320e338-112c-4c52-92aa-b12073ae0309 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:39.176558 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320e338-112c-4c52-92aa-b12073ae0309 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:39.176834 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320e338-112c-4c52-92aa-b12073ae0309 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:39.177542 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320e338-112c-4c52-92aa-b12073ae0309 None admin] RBAC: Adding query filter params (type=image) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:39.177851 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320e338-112c-4c52-92aa-b12073ae0309 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:39.179256 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320e338-112c-4c52-92aa-b12073ae0309 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:39.184460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 507/1037] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:39.190254 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320e338-112c-4c52-92aa-b12073ae0309 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:39.208270 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844ce60-d5f2-4b2b-a5f6-6598cfb307c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:39.209641 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844ce60-d5f2-4b2b-a5f6-6598cfb307c9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:39.293088 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320e338-112c-4c52-92aa-b12073ae0309 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:39.321675 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 531/1038] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:27:38 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 13:27:39.323022 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844ce60-d5f2-4b2b-a5f6-6598cfb307c9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:39.326599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ec9e4-cdff-4237-8fcf-0ea5142b5298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:39.327285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ec9e4-cdff-4237-8fcf-0ea5142b5298 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:39.327567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ec9e4-cdff-4237-8fcf-0ea5142b5298 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:39.327840 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ec9e4-cdff-4237-8fcf-0ea5142b5298 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:39.328642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ec9e4-cdff-4237-8fcf-0ea5142b5298 None admin] RBAC: Adding query filter params (interface=public, service_id=5654705d1c8e42c0b1eaf57b28d7e69b, region_id=RegionOne) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:39.328951 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ec9e4-cdff-4237-8fcf-0ea5142b5298 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:39.330309 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ec9e4-cdff-4237-8fcf-0ea5142b5298 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:39.340872 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 508/1039] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jun 2 13:27:39 2022] GET /identity/v3/endpoints?service_id=5654705d1c8e42c0b1eaf57b28d7e69b&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:39.342073 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ec9e4-cdff-4237-8fcf-0ea5142b5298 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:39.342865 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:39.363740 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:39.435620 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844ce60-d5f2-4b2b-a5f6-6598cfb307c9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:39.455662 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ec9e4-cdff-4237-8fcf-0ea5142b5298 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:39.473556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526847b-c5db-487c-800a-8c410f640d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:39.474292 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526847b-c5db-487c-800a-8c410f640d5d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:39.474590 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526847b-c5db-487c-800a-8c410f640d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:39.474886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526847b-c5db-487c-800a-8c410f640d5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:39.485613 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526847b-c5db-487c-800a-8c410f640d5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:39.487092 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526847b-c5db-487c-800a-8c410f640d5d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:39.491121 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff95ac-acfe-405c-976b-ad549168d5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:39.491808 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff95ac-acfe-405c-976b-ad549168d5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:39.492091 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff95ac-acfe-405c-976b-ad549168d5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:39.492360 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff95ac-acfe-405c-976b-ad549168d5f4 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:39.493040 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff95ac-acfe-405c-976b-ad549168d5f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:39.494386 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff95ac-acfe-405c-976b-ad549168d5f4 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:39.510607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 509/1040] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 2 13:27:39 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:27:39.510836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-2526847b-c5db-487c-800a-8c410f640d5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:39.510836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:39.510836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:39.510836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:39.510836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:39.510836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:39.510836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:39.510836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:39.510836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:39.510836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:39.510836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:39.510836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:39.510836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:39.510836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:39.510836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:39.512763 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:39.512763 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:39.512763 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:39.512763 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:39.512763 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:39.512763 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:39.512763 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:39.512763 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:39.512763 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:39.512763 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:39.512763 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:39.512763 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:39.512763 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:39.512763 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:39.512763 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:39.512763 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:39.512763 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:39.514151 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:39.514151 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:39.514151 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:39.514151 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:39.514151 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 532/1041] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:39.514473 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff95ac-acfe-405c-976b-ad549168d5f4 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:39.610169 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:39.642722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff95ac-acfe-405c-976b-ad549168d5f4 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:39.682471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20b1e9-14a3-4d46-9355-9f364fd9986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:39.683387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20b1e9-14a3-4d46-9355-9f364fd9986f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:39.683668 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20b1e9-14a3-4d46-9355-9f364fd9986f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:39.683909 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20b1e9-14a3-4d46-9355-9f364fd9986f None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:39.684669 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d20b1e9-14a3-4d46-9355-9f364fd9986f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:39.684972 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d20b1e9-14a3-4d46-9355-9f364fd9986f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:39.686340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d20b1e9-14a3-4d46-9355-9f364fd9986f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:39.700613 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 510/1042] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:39.705343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46733dd2-a9f3-4527-9b80-9fbbb94f0b60 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:39.705637 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46733dd2-a9f3-4527-9b80-9fbbb94f0b60 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:39.705802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20b1e9-14a3-4d46-9355-9f364fd9986f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:39.705914 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46733dd2-a9f3-4527-9b80-9fbbb94f0b60 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:39.707450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 533/1043] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:39.712818 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2afce2-8ab2-43e0-ba75-c9b05c8ea744 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:39.713138 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2afce2-8ab2-43e0-ba75-c9b05c8ea744 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:39.713399 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2afce2-8ab2-43e0-ba75-c9b05c8ea744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:39.732872 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-fb2afce2-8ab2-43e0-ba75-c9b05c8ea744 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:39.734011 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fb2afce2-8ab2-43e0-ba75-c9b05c8ea744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:39.809531 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:39.816290 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20b1e9-14a3-4d46-9355-9f364fd9986f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:39.816769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 534/1044] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:27:39.840909 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2afce2-8ab2-43e0-ba75-c9b05c8ea744 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:39.854733 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c5dcf-ca72-4b50-a607-04b076b18bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:39.855735 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c5dcf-ca72-4b50-a607-04b076b18bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:39.856016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c5dcf-ca72-4b50-a607-04b076b18bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:39.856284 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c5dcf-ca72-4b50-a607-04b076b18bb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:39.863412 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c5dcf-ca72-4b50-a607-04b076b18bb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:39.864821 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c5dcf-ca72-4b50-a607-04b076b18bb2 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:39.879231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-668c5dcf-ca72-4b50-a607-04b076b18bb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:39.879231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:39.879231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:39.879231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:39.879231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:39.879231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:39.879231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:39.879231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:39.879231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:39.879231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:39.879231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:39.879231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:39.879231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:27:39.879231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:27:39.879231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:27:39.880144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:27:39.880144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:39.880144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:39.880144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:39.880144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:39.880144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:39.880144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:39.880144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:39.880144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:39.880144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:39.880144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:39.880144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:39.880144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:39.880144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:39.880144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:39.880144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:39.880144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:39.886520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:27:39.886520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:27:39.886520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:27:39.886520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:27:39.886520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:27:39.886520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:27:39.886520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:39.886520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:39.886520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 511/1045] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:27:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:39.886520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c5dcf-ca72-4b50-a607-04b076b18bb2 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:39.889726 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:39.953362 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2afce2-8ab2-43e0-ba75-c9b05c8ea744 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:39.990657 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e09be-45b4-4a53-8fdd-7b44d6d089d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:39.991536 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e09be-45b4-4a53-8fdd-7b44d6d089d0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:39.991655 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e09be-45b4-4a53-8fdd-7b44d6d089d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:39.991921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e09be-45b4-4a53-8fdd-7b44d6d089d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:40.002392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e09be-45b4-4a53-8fdd-7b44d6d089d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:27:40.009948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-a83e09be-45b4-4a53-8fdd-7b44d6d089d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:27:40.009948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:40.009948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:40.009948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:40.009948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:40.009948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:40.009948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:40.009948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:40.009948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:40.009948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:40.009948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:40.009948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:40.009948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:27:40.009948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:27:40.009948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:27:40.009948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:27:40.011203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:27:40.011203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:27:40.011203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:27:40.011203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:27:40.011203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:40.011203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:40.011203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:40.011203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:40.011203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:40.011203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:40.011203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:40.011203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:40.011203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:40.011203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:40.011203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:40.011203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:40.012242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:40.012242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:40.012242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:40.012242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:40.012242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:27:40.012242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:27:40.012242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:27:40.012242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:27:40.012242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:27:40.012242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:27:40.012242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:27:40.012242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:40.012242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 535/1046] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:27:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:40.017193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c5dcf-ca72-4b50-a607-04b076b18bb2 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:40.017321 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e09be-45b4-4a53-8fdd-7b44d6d089d0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:40.054367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124eb1d-d60e-48d1-94b4-008787af7f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:40.055377 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124eb1d-d60e-48d1-94b4-008787af7f71 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:40.055659 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124eb1d-d60e-48d1-94b4-008787af7f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:40.055937 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124eb1d-d60e-48d1-94b4-008787af7f71 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:40.056731 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124eb1d-d60e-48d1-94b4-008787af7f71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:40.057043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124eb1d-d60e-48d1-94b4-008787af7f71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:40.058705 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124eb1d-d60e-48d1-94b4-008787af7f71 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:40.077221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 512/1047] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:27:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:40.079137 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124eb1d-d60e-48d1-94b4-008787af7f71 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:40.084603 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:40.128452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e09be-45b4-4a53-8fdd-7b44d6d089d0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:40.143193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:40.164257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da54892-a5a2-4d37-b68f-6b4302f44591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:40.164940 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da54892-a5a2-4d37-b68f-6b4302f44591 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:40.165227 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da54892-a5a2-4d37-b68f-6b4302f44591 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:40.165501 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da54892-a5a2-4d37-b68f-6b4302f44591 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:40.166249 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da54892-a5a2-4d37-b68f-6b4302f44591 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:40.166556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da54892-a5a2-4d37-b68f-6b4302f44591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:40.168224 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da54892-a5a2-4d37-b68f-6b4302f44591 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:40.182110 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 536/1048] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:27:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:40.183365 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da54892-a5a2-4d37-b68f-6b4302f44591 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:40.187799 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124eb1d-d60e-48d1-94b4-008787af7f71 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:40.223828 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a6156-a211-4b4e-9afd-1748a6906e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:40.224503 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a6156-a211-4b4e-9afd-1748a6906e6e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:40.224819 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a6156-a211-4b4e-9afd-1748a6906e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:40.225068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a6156-a211-4b4e-9afd-1748a6906e6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:40.225915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a6156-a211-4b4e-9afd-1748a6906e6e None admin] RBAC: Adding query filter params (role.id=ee7c0043cf84487d98a7417ff2ffadd4, scope.project.id=af45a1ec7c94408bb638c55fb43fa961, user.id=5a0061e2927843cf86769d2beab18743) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:40.226211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a6156-a211-4b4e-9afd-1748a6906e6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:40.227652 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a6156-a211-4b4e-9afd-1748a6906e6e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:40.233621 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 513/1049] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:27:40 2022] GET /identity/v3/role_assignments?user.id=5a0061e2927843cf86769d2beab18743&scope.project.id=af45a1ec7c94408bb638c55fb43fa961&role.id=ee7c0043cf84487d98a7417ff2ffadd4 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:40.308195 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da54892-a5a2-4d37-b68f-6b4302f44591 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:40.341116 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:40.354927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec76200-f1ea-45fb-b80e-b9e36136e19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:40.355849 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec76200-f1ea-45fb-b80e-b9e36136e19f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:40.356120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec76200-f1ea-45fb-b80e-b9e36136e19f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:40.356386 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec76200-f1ea-45fb-b80e-b9e36136e19f None admin] PATH_INFO: `/v3/users/c95f53b318ea4ba0832f8aed85686ae4` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:40.372655 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec76200-f1ea-45fb-b80e-b9e36136e19f None admin] RBAC: Authorizing `identity:get_user(user_id=c95f53b318ea4ba0832f8aed85686ae4)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:40.374180 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec76200-f1ea-45fb-b80e-b9e36136e19f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:40.376144 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 537/1050] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:27:40 2022] GET /identity/v3/users/c95f53b318ea4ba0832f8aed85686ae4 => generated 285 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:40.381939 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a6156-a211-4b4e-9afd-1748a6906e6e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:40.495738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a6156-a211-4b4e-9afd-1748a6906e6e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:40.520319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:40.529933 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdc391-17ac-499e-b5fc-748f418e72e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:40.530603 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdc391-17ac-499e-b5fc-748f418e72e8 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:40.530884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdc391-17ac-499e-b5fc-748f418e72e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:40.531150 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdc391-17ac-499e-b5fc-748f418e72e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:40.598284 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdc391-17ac-499e-b5fc-748f418e72e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:40.599687 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdc391-17ac-499e-b5fc-748f418e72e8 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:40.712955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 514/1051] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:27:40 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:27:40.718792 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec76200-f1ea-45fb-b80e-b9e36136e19f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:40.827324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec76200-f1ea-45fb-b80e-b9e36136e19f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:40.862688 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1331dbd-c9a9-4301-80a3-bb09aa7135ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:40.863507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1331dbd-c9a9-4301-80a3-bb09aa7135ed None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:40.863787 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1331dbd-c9a9-4301-80a3-bb09aa7135ed None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:40.864059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1331dbd-c9a9-4301-80a3-bb09aa7135ed None admin] PATH_INFO: `/v3/projects/bbd9263176274738a6fef6ba8b25bb34` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:40.865427 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1331dbd-c9a9-4301-80a3-bb09aa7135ed None admin] RBAC: Authorizing `identity:get_project(project_id=bbd9263176274738a6fef6ba8b25bb34)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:40.866893 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1331dbd-c9a9-4301-80a3-bb09aa7135ed None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:40.868734 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 538/1052] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:27:40 2022] GET /identity/v3/projects/bbd9263176274738a6fef6ba8b25bb34 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:40.874816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdc391-17ac-499e-b5fc-748f418e72e8 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:40.904155 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:40.979731 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdc391-17ac-499e-b5fc-748f418e72e8 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:41.013350 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9762e3-b46e-4c07-86b8-0f955759f467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:41.014006 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9762e3-b46e-4c07-86b8-0f955759f467 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:41.014283 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9762e3-b46e-4c07-86b8-0f955759f467 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:41.014556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9762e3-b46e-4c07-86b8-0f955759f467 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:41.015413 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9762e3-b46e-4c07-86b8-0f955759f467 None admin] RBAC: Adding query filter params (role.id=6edd584a77084fa78240661ea76cddb5, scope.project.id=bbd9263176274738a6fef6ba8b25bb34, user.id=c95f53b318ea4ba0832f8aed85686ae4) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:41.015721 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9762e3-b46e-4c07-86b8-0f955759f467 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:41.017153 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9762e3-b46e-4c07-86b8-0f955759f467 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:41.022918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 515/1053] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:27:40 2022] GET /identity/v3/role_assignments?user.id=c95f53b318ea4ba0832f8aed85686ae4&scope.project.id=bbd9263176274738a6fef6ba8b25bb34&role.id=6edd584a77084fa78240661ea76cddb5 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:41.867340 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b6a00-1e7b-4d40-839a-180c5eaae9c2 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:41.867920 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b6a00-1e7b-4d40-839a-180c5eaae9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:41.867920 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b6a00-1e7b-4d40-839a-180c5eaae9c2 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:41.869259 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 539/1054] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:41.875515 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e23d50-63fb-41bf-b0f1-692d6b75ae11 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:41.876012 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e23d50-63fb-41bf-b0f1-692d6b75ae11 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:41.876117 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e23d50-63fb-41bf-b0f1-692d6b75ae11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:41.893859 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-c6e23d50-63fb-41bf-b0f1-692d6b75ae11 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:41.895013 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c6e23d50-63fb-41bf-b0f1-692d6b75ae11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:41.969227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 516/1055] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:41.992706 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b6a00-1e7b-4d40-839a-180c5eaae9c2 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:42.047174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:42.102091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b6a00-1e7b-4d40-839a-180c5eaae9c2 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:42.137639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372042bc-e107-4b05-9112-1874a800acfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:42.138475 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372042bc-e107-4b05-9112-1874a800acfe None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:42.138789 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372042bc-e107-4b05-9112-1874a800acfe None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:42.139064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372042bc-e107-4b05-9112-1874a800acfe None admin] PATH_INFO: `/v3/services/image` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:42.139742 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372042bc-e107-4b05-9112-1874a800acfe None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:42.141162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372042bc-e107-4b05-9112-1874a800acfe None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:42.155179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-372042bc-e107-4b05-9112-1874a800acfe None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:27:42.155179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:42.155179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:27:42.155179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:27:42.155179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:27:42.155179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:27:42.155179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:27:42.155179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:42.155179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:27:42.155179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:42.155179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:27:42.155179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:42.155179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:42.155179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:42.155179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:42.155179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:42.155179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:42.156216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:42.156216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:42.156216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:42.156216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:42.156216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:42.156216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:42.156216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:27:42.156216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:27:42.156216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:27:42.156216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:27:42.156216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:42.156216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:42.156216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:42.156216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:42.156216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:42.156216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:42.157052 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:42.157052 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:42.157052 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:42.157052 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:42.157052 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:42.157052 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:42.157052 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:42.157052 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:42.157052 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:42.157052 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:42.157052 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:27:42.157052 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:27:42.157052 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:27:42.157052 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:42.158591 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 540/1056] 10.222.0.18 () {56 vars in 1105 bytes} [Thu Jun 2 13:27:41 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:42.162897 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e23d50-63fb-41bf-b0f1-692d6b75ae11 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:42.189779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:42.283652 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e23d50-63fb-41bf-b0f1-692d6b75ae11 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:42.322771 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236824c-9f0e-4fb8-b440-fb43cdab16d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:42.323809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236824c-9f0e-4fb8-b440-fb43cdab16d0 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:42.324235 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236824c-9f0e-4fb8-b440-fb43cdab16d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:42.324642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236824c-9f0e-4fb8-b440-fb43cdab16d0 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:42.325745 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236824c-9f0e-4fb8-b440-fb43cdab16d0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:42.326216 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236824c-9f0e-4fb8-b440-fb43cdab16d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:42.328395 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236824c-9f0e-4fb8-b440-fb43cdab16d0 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:42.341145 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 517/1057] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:42.342435 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372042bc-e107-4b05-9112-1874a800acfe None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:42.449188 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372042bc-e107-4b05-9112-1874a800acfe None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:42.462168 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:42.484926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0107e6-ee18-4831-94af-112da71671c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:42.485596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0107e6-ee18-4831-94af-112da71671c8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:42.485874 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0107e6-ee18-4831-94af-112da71671c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:42.486145 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0107e6-ee18-4831-94af-112da71671c8 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:42.486876 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0107e6-ee18-4831-94af-112da71671c8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:42.487181 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0107e6-ee18-4831-94af-112da71671c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:42.488546 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0107e6-ee18-4831-94af-112da71671c8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:42.498610 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 541/1058] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:42.500009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236824c-9f0e-4fb8-b440-fb43cdab16d0 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:42.511455 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f4056-dd0a-4962-b76a-b86d9cf5cdb7 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:42.511729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f4056-dd0a-4962-b76a-b86d9cf5cdb7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:42.511999 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f4056-dd0a-4962-b76a-b86d9cf5cdb7 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:42.513354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 542/1059] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:42.518333 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaa1cb-ff90-4a32-85b0-cb19617c8a34 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:42.518617 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaa1cb-ff90-4a32-85b0-cb19617c8a34 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:42.518910 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaa1cb-ff90-4a32-85b0-cb19617c8a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:42.536019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-53aaa1cb-ff90-4a32-85b0-cb19617c8a34 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:42.537206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-53aaa1cb-ff90-4a32-85b0-cb19617c8a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:42.591930 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:42.610073 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236824c-9f0e-4fb8-b440-fb43cdab16d0 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:42.614600 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 543/1060] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:42.636464 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aaa1cb-ff90-4a32-85b0-cb19617c8a34 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:42.658204 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdde795-9ecb-4804-b822-613ba185f0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:42.659448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdde795-9ecb-4804-b822-613ba185f0e3 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:42.659731 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdde795-9ecb-4804-b822-613ba185f0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:42.659999 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdde795-9ecb-4804-b822-613ba185f0e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:42.660756 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdde795-9ecb-4804-b822-613ba185f0e3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:42.663807 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdde795-9ecb-4804-b822-613ba185f0e3 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:42.688223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 518/1061] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 2 13:27:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:27:42.752850 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aaa1cb-ff90-4a32-85b0-cb19617c8a34 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:42.761880 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:42.802760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb6310-2592-439c-867a-a2077b664e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:42.803885 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb6310-2592-439c-867a-a2077b664e2d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:42.804404 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb6310-2592-439c-867a-a2077b664e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:42.804826 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb6310-2592-439c-867a-a2077b664e2d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:42.817448 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb6310-2592-439c-867a-a2077b664e2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:27:42.826467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-b6cb6310-2592-439c-867a-a2077b664e2d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:27:42.826467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:42.826467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:42.826467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:42.826467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:42.826467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:42.826467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:42.826467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:42.826467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:42.826467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:42.826467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:42.826467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:42.826467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:27:42.826467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:27:42.826467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:27:42.826467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:27:42.827554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:27:42.827554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:27:42.827554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:27:42.827554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:27:42.827554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:42.827554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:42.827554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:42.827554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:42.827554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:42.827554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:42.827554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:42.827554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:42.827554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:42.827554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:42.827554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:42.827554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:42.828411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:42.828411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:42.828411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:42.828411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:42.828411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:27:42.828411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:27:42.828411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:27:42.828411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:27:42.828411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:27:42.828411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:27:42.828411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:27:42.828411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:42.830762 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 544/1062] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Jun 2 13:27:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:42.834867 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdde795-9ecb-4804-b822-613ba185f0e3 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:42.956644 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdde795-9ecb-4804-b822-613ba185f0e3 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:42.996961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81154e-5a17-4b44-ba23-7416fda9e85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:42.998140 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81154e-5a17-4b44-ba23-7416fda9e85d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:42.998704 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81154e-5a17-4b44-ba23-7416fda9e85d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:42.999183 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81154e-5a17-4b44-ba23-7416fda9e85d None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:43.000224 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81154e-5a17-4b44-ba23-7416fda9e85d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:43.000734 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81154e-5a17-4b44-ba23-7416fda9e85d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:43.002300 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81154e-5a17-4b44-ba23-7416fda9e85d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:43.011979 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 519/1063] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jun 2 13:27:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:43.017443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb6310-2592-439c-867a-a2077b664e2d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:43.125322 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb6310-2592-439c-867a-a2077b664e2d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:43.162447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8bd9d-f1ff-4bc1-902d-0a58bef7de0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:43.163285 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8bd9d-f1ff-4bc1-902d-0a58bef7de0f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:43.163565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8bd9d-f1ff-4bc1-902d-0a58bef7de0f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:43.163833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8bd9d-f1ff-4bc1-902d-0a58bef7de0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:43.174878 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8bd9d-f1ff-4bc1-902d-0a58bef7de0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:43.176467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8bd9d-f1ff-4bc1-902d-0a58bef7de0f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:43.194198 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-84f8bd9d-f1ff-4bc1-902d-0a58bef7de0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:43.194198 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:43.194198 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:43.194198 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:43.194198 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:43.194198 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:43.194198 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:43.194198 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:43.194198 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:43.194198 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:43.194198 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:43.194198 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:43.194198 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:43.194198 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:43.194198 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:43.195392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:43.195392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:43.195392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:43.195392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:43.195392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:43.195392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:43.195392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:43.195392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:43.195392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:43.195392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:43.195392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:43.195392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:43.195392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:43.195392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:43.195392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:43.195392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:43.195392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:43.196350 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:43.196350 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:43.196350 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:43.196350 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:43.197343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 545/1064] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:43.201472 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81154e-5a17-4b44-ba23-7416fda9e85d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:43.204713 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:43.288591 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7c6ca-2124-46ed-9b70-3ca424c06c70 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:43.288796 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7c6ca-2124-46ed-9b70-3ca424c06c70 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:43.289051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7c6ca-2124-46ed-9b70-3ca424c06c70 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:43.290459 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 546/1065] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:43.295925 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d87205-ac24-414b-a441-7929f7398c1e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:43.296212 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d87205-ac24-414b-a441-7929f7398c1e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:43.296486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d87205-ac24-414b-a441-7929f7398c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:43.310522 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81154e-5a17-4b44-ba23-7416fda9e85d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:43.314165 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-67d87205-ac24-414b-a441-7929f7398c1e None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:43.315418 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-67d87205-ac24-414b-a441-7929f7398c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:43.326012 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:43.345217 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44f2aa-82c2-4a36-aff1-a527a21df7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:43.345892 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44f2aa-82c2-4a36-aff1-a527a21df7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:43.346171 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44f2aa-82c2-4a36-aff1-a527a21df7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:43.346476 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44f2aa-82c2-4a36-aff1-a527a21df7c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:43.347200 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44f2aa-82c2-4a36-aff1-a527a21df7c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:43.347506 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44f2aa-82c2-4a36-aff1-a527a21df7c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:43.348861 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44f2aa-82c2-4a36-aff1-a527a21df7c6 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:43.361605 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 520/1066] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:43.366804 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44f2aa-82c2-4a36-aff1-a527a21df7c6 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:43.394515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 547/1067] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:43.418303 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d87205-ac24-414b-a441-7929f7398c1e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:43.432643 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:43.474446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44f2aa-82c2-4a36-aff1-a527a21df7c6 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:43.518825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655bafc-6b38-4f5c-b955-33fd2af67390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:43.519757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655bafc-6b38-4f5c-b955-33fd2af67390 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:43.520027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655bafc-6b38-4f5c-b955-33fd2af67390 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:43.520310 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655bafc-6b38-4f5c-b955-33fd2af67390 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:43.522359 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d87205-ac24-414b-a441-7929f7398c1e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:43.528349 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655bafc-6b38-4f5c-b955-33fd2af67390 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:43.529786 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655bafc-6b38-4f5c-b955-33fd2af67390 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:43.545368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-0655bafc-6b38-4f5c-b955-33fd2af67390 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:27:43.545368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:43.545368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:43.545368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:43.545368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:43.545368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:43.545368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:43.545368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:43.545368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:43.545368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:43.545368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:43.545368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:43.545368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:27:43.545368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:27:43.545368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:27:43.545368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:27:43.546452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:43.546452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:43.546452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:27:43.546452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:43.546452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:27:43.546452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:43.546452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:43.546452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:43.546452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:43.546452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:43.546452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:43.546452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:43.546452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:43.546452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:43.546452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:43.546452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:43.546452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:43.546452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:43.547983 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:43.547983 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:43.547983 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:27:43.547983 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:27:43.547983 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:27:43.547983 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:27:43.547983 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:27:43.547983 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:27:43.547983 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:27:43.547983 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:43.547983 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 521/1068] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 2 13:27:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:43.552574 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655bafc-6b38-4f5c-b955-33fd2af67390 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:43.563885 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7278d-6f97-4c62-b2c6-cd47481637f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:43.565025 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7278d-6f97-4c62-b2c6-cd47481637f4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:43.565310 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7278d-6f97-4c62-b2c6-cd47481637f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:43.565864 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7278d-6f97-4c62-b2c6-cd47481637f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:43.579622 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7278d-6f97-4c62-b2c6-cd47481637f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:27:43.589896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-9fc7278d-6f97-4c62-b2c6-cd47481637f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:27:43.589896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:43.589896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:43.589896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:43.589896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:43.589896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:43.589896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:43.589896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:43.589896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:43.589896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:43.589896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:43.589896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:43.589896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:27:43.589896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:27:43.589896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:27:43.589896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:27:43.590862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:27:43.590862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:27:43.590862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:27:43.590862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:27:43.590862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:43.590862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:43.590862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:43.590862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:43.590862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:43.590862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:43.590862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:43.590862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:43.590862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:43.590862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:43.590862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:43.590862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:43.591702 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:43.591702 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:43.591702 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:43.591702 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:43.591702 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:27:43.591702 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:27:43.591702 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:27:43.591702 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:27:43.591702 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:27:43.591702 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:27:43.591702 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:27:43.591702 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:43.593109 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 548/1069] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:27:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:43.597105 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7278d-6f97-4c62-b2c6-cd47481637f4 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:43.600671 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:43.662265 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655bafc-6b38-4f5c-b955-33fd2af67390 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:43.686162 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:43.700114 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650b1ca-35e2-4c0b-b297-e97eebd6c0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:43.700795 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650b1ca-35e2-4c0b-b297-e97eebd6c0ce None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:43.701071 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650b1ca-35e2-4c0b-b297-e97eebd6c0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:43.701341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650b1ca-35e2-4c0b-b297-e97eebd6c0ce None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:43.702175 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650b1ca-35e2-4c0b-b297-e97eebd6c0ce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:43.702480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650b1ca-35e2-4c0b-b297-e97eebd6c0ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:43.703933 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650b1ca-35e2-4c0b-b297-e97eebd6c0ce None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:43.715489 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7278d-6f97-4c62-b2c6-cd47481637f4 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:43.721285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 522/1070] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 2 13:27:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:43.726865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650b1ca-35e2-4c0b-b297-e97eebd6c0ce None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:43.752662 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9deb24-286e-45c4-ad90-8c653cce8104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:43.753624 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9deb24-286e-45c4-ad90-8c653cce8104 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:43.753912 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9deb24-286e-45c4-ad90-8c653cce8104 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:43.754189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9deb24-286e-45c4-ad90-8c653cce8104 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:43.755244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9deb24-286e-45c4-ad90-8c653cce8104 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:43.755935 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9deb24-286e-45c4-ad90-8c653cce8104 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:43.757872 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9deb24-286e-45c4-ad90-8c653cce8104 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:43.773172 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 549/1071] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:27:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:43.776754 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9deb24-286e-45c4-ad90-8c653cce8104 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:43.839400 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650b1ca-35e2-4c0b-b297-e97eebd6c0ce None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:43.843064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:43.879443 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be68e46-4e68-404c-80b6-ae4c3f686f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:43.880083 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9deb24-286e-45c4-ad90-8c653cce8104 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:43.880729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be68e46-4e68-404c-80b6-ae4c3f686f0b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:43.881160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be68e46-4e68-404c-80b6-ae4c3f686f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:43.881682 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be68e46-4e68-404c-80b6-ae4c3f686f0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:43.892679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be68e46-4e68-404c-80b6-ae4c3f686f0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:43.894127 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be68e46-4e68-404c-80b6-ae4c3f686f0b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:43.913094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-7be68e46-4e68-404c-80b6-ae4c3f686f0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:43.913094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:43.913094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:43.913094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:43.913094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:43.913094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:43.913094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:43.913094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:43.913094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:43.913094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:43.913094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:43.913094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:43.913094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:43.913094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:43.913094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:43.914187 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:43.914187 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:43.914187 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:43.914187 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:43.914187 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:43.914187 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:43.914187 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:43.914187 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:43.914187 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:43.914187 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:43.914187 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:43.914187 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:43.914187 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:43.914187 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:43.914187 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:43.914187 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:43.914187 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:43.915258 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:43.915258 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:43.915258 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:43.915258 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:43.915258 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 523/1072] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:43.921392 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be68e46-4e68-404c-80b6-ae4c3f686f0b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:43.925356 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b19003-258d-40d9-b2a2-2c006e4dfa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:43.926249 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b19003-258d-40d9-b2a2-2c006e4dfa0e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:43.926522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b19003-258d-40d9-b2a2-2c006e4dfa0e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:43.926821 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b19003-258d-40d9-b2a2-2c006e4dfa0e None admin] PATH_INFO: `/v3/users/c95f53b318ea4ba0832f8aed85686ae4` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:43.928031 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b19003-258d-40d9-b2a2-2c006e4dfa0e None admin] RBAC: Authorizing `identity:get_user(user_id=c95f53b318ea4ba0832f8aed85686ae4)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:43.929456 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b19003-258d-40d9-b2a2-2c006e4dfa0e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:43.931145 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 550/1073] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:27:43 2022] GET /identity/v3/users/c95f53b318ea4ba0832f8aed85686ae4 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:43.936896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b19003-258d-40d9-b2a2-2c006e4dfa0e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:43.955907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:44.027378 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be68e46-4e68-404c-80b6-ae4c3f686f0b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:44.039271 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b19003-258d-40d9-b2a2-2c006e4dfa0e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:44.064050 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e870a08-d823-4e59-a487-827ab45bfe37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:44.064955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e870a08-d823-4e59-a487-827ab45bfe37 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:44.065403 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e870a08-d823-4e59-a487-827ab45bfe37 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:44.065679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e870a08-d823-4e59-a487-827ab45bfe37 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:44.066395 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e870a08-d823-4e59-a487-827ab45bfe37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:44.066755 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e870a08-d823-4e59-a487-827ab45bfe37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:44.068105 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e870a08-d823-4e59-a487-827ab45bfe37 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:44.072241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c874ff-55bb-4477-ac5d-681503bff1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:44.073206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c874ff-55bb-4477-ac5d-681503bff1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:44.073481 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c874ff-55bb-4477-ac5d-681503bff1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:44.073738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c874ff-55bb-4477-ac5d-681503bff1b8 None admin] PATH_INFO: `/v3/projects/bbd9263176274738a6fef6ba8b25bb34` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:44.074960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c874ff-55bb-4477-ac5d-681503bff1b8 None admin] RBAC: Authorizing `identity:get_project(project_id=bbd9263176274738a6fef6ba8b25bb34)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:44.076370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c874ff-55bb-4477-ac5d-681503bff1b8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:44.078225 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 551/1074] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:27:43 2022] GET /identity/v3/projects/bbd9263176274738a6fef6ba8b25bb34 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:44.085415 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 524/1075] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:44.085584 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c874ff-55bb-4477-ac5d-681503bff1b8 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:44.086266 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e870a08-d823-4e59-a487-827ab45bfe37 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:44.086706 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:44.191077 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:44.197610 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c874ff-55bb-4477-ac5d-681503bff1b8 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:44.201857 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e870a08-d823-4e59-a487-827ab45bfe37 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:44.233553 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d05f4-2370-4d5f-9773-03d6c60bfabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:44.234466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d05f4-2370-4d5f-9773-03d6c60bfabf None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:44.234786 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d05f4-2370-4d5f-9773-03d6c60bfabf None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:44.235047 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d05f4-2370-4d5f-9773-03d6c60bfabf None admin] PATH_INFO: `/v3/projects/bbd9263176274738a6fef6ba8b25bb34/users/c95f53b318ea4ba0832f8aed85686ae4/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:44.237087 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d05f4-2370-4d5f-9773-03d6c60bfabf None admin] RBAC: Authorizing `identity:create_grant(project_id=bbd9263176274738a6fef6ba8b25bb34, user_id=c95f53b318ea4ba0832f8aed85686ae4, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:44.238524 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d05f4-2370-4d5f-9773-03d6c60bfabf None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:44.238850 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f9fc0-b735-48e8-8a1b-156f963c8960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:44.239662 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f9fc0-b735-48e8-8a1b-156f963c8960 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:44.239944 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f9fc0-b735-48e8-8a1b-156f963c8960 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:44.240216 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f9fc0-b735-48e8-8a1b-156f963c8960 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:44.248575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f9fc0-b735-48e8-8a1b-156f963c8960 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:44.250045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f9fc0-b735-48e8-8a1b-156f963c8960 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:44.262603 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 552/1076] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 13:27:44 2022] PUT /identity/v3/projects/bbd9263176274738a6fef6ba8b25bb34/users/c95f53b318ea4ba0832f8aed85686ae4/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:27:44.272109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-8d0f9fc0-b735-48e8-8a1b-156f963c8960 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:44.272109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:44.272109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:44.272109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:44.272109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:44.272109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:44.272109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:44.272109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:44.272109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:44.272109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:44.272109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:44.272109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:44.272109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:27:44.272109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:27:44.272109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:27:44.273116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:27:44.273116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:44.273116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:44.273116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:44.273116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:44.273116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:44.273116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:44.273116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:44.273116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:44.273116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:44.273116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:44.273116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:44.273116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:44.273116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:44.273116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:44.273116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:44.273116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:44.274061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:27:44.274061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:27:44.274061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:27:44.274061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:27:44.274061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:27:44.274061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:27:44.274061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:44.274061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:44.279053 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 525/1077] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:27:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:44.280152 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d05f4-2370-4d5f-9773-03d6c60bfabf None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:44.353473 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:44.400428 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d05f4-2370-4d5f-9773-03d6c60bfabf None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:44.442931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dade89-fa9f-422f-8bee-46ffd190f181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:44.443539 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dade89-fa9f-422f-8bee-46ffd190f181 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:44.443821 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dade89-fa9f-422f-8bee-46ffd190f181 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:44.444096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dade89-fa9f-422f-8bee-46ffd190f181 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:44.444910 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dade89-fa9f-422f-8bee-46ffd190f181 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:44.445221 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dade89-fa9f-422f-8bee-46ffd190f181 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:44.446734 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dade89-fa9f-422f-8bee-46ffd190f181 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:44.463374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 553/1078] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:27:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:44.468997 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f9fc0-b735-48e8-8a1b-156f963c8960 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:44.574379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f9fc0-b735-48e8-8a1b-156f963c8960 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:44.610336 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afa69e-970e-46d1-b6d9-d7f95d590e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:44.611216 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afa69e-970e-46d1-b6d9-d7f95d590e3c None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:44.611495 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afa69e-970e-46d1-b6d9-d7f95d590e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:44.611737 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afa69e-970e-46d1-b6d9-d7f95d590e3c None admin] PATH_INFO: `/v3/projects/af45a1ec7c94408bb638c55fb43fa961/users/5a0061e2927843cf86769d2beab18743/roles/ee7c0043cf84487d98a7417ff2ffadd4` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:44.614040 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afa69e-970e-46d1-b6d9-d7f95d590e3c None admin] RBAC: Authorizing `identity:create_grant(project_id=af45a1ec7c94408bb638c55fb43fa961, user_id=5a0061e2927843cf86769d2beab18743, role_id=ee7c0043cf84487d98a7417ff2ffadd4)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:44.615509 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afa69e-970e-46d1-b6d9-d7f95d590e3c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:44.631094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 526/1079] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 13:27:44 2022] PUT /identity/v3/projects/af45a1ec7c94408bb638c55fb43fa961/users/5a0061e2927843cf86769d2beab18743/roles/ee7c0043cf84487d98a7417ff2ffadd4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:27:45.008476 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0257e0-af49-4389-8333-3ece622b108f None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:45.008839 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0257e0-af49-4389-8333-3ece622b108f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:45.008997 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0257e0-af49-4389-8333-3ece622b108f None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:45.010626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 554/1080] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:45.015989 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dd79e-0465-4d4d-9187-0e55256b287f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:45.016361 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dd79e-0465-4d4d-9187-0e55256b287f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:45.016663 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dd79e-0465-4d4d-9187-0e55256b287f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:45.034109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-e99dd79e-0465-4d4d-9187-0e55256b287f None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:45.035297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e99dd79e-0465-4d4d-9187-0e55256b287f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:45.044089 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:45.112372 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 527/1081] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:45.135535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0257e0-af49-4389-8333-3ece622b108f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:45.244423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0257e0-af49-4389-8333-3ece622b108f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:45.267421 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:45.280867 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512e815-77a8-4105-b26b-1699ded0895e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:45.281542 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512e815-77a8-4105-b26b-1699ded0895e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:45.281822 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512e815-77a8-4105-b26b-1699ded0895e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:45.282094 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512e815-77a8-4105-b26b-1699ded0895e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:45.355287 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512e815-77a8-4105-b26b-1699ded0895e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:45.356772 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512e815-77a8-4105-b26b-1699ded0895e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:45.462710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 555/1082] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:27:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:27:45.469177 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dd79e-0465-4d4d-9187-0e55256b287f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:45.575640 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dd79e-0465-4d4d-9187-0e55256b287f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:45.609029 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39053403-0a0b-4d71-9d83-46cbe43ae986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:45.609888 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39053403-0a0b-4d71-9d83-46cbe43ae986 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:45.610242 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39053403-0a0b-4d71-9d83-46cbe43ae986 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:45.610427 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39053403-0a0b-4d71-9d83-46cbe43ae986 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:45.620578 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39053403-0a0b-4d71-9d83-46cbe43ae986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:45.622118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39053403-0a0b-4d71-9d83-46cbe43ae986 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:45.624710 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:45.651016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-39053403-0a0b-4d71-9d83-46cbe43ae986 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:45.651016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:45.651016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:45.651016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:45.651016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:45.651016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:45.651016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:45.651016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:45.651016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:45.651016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:45.651016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:45.651016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:45.651016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:45.651016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:45.651016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:45.652066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:45.652066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:45.652066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:45.652066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:45.652066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:45.652066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:45.652066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:45.652066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:45.652066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:45.652066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:45.652066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:45.652066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:45.652066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:45.652066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:45.652066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:45.652066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:45.652066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:45.652943 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:45.652943 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:45.652943 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:45.652943 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:45.654918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 528/1083] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:45.658412 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512e815-77a8-4105-b26b-1699ded0895e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:45.682461 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:45.763093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512e815-77a8-4105-b26b-1699ded0895e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:45.802301 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fa432-156b-415d-8036-f01f40a03844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:45.803028 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fa432-156b-415d-8036-f01f40a03844 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:45.803301 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fa432-156b-415d-8036-f01f40a03844 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:45.803569 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fa432-156b-415d-8036-f01f40a03844 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:45.804285 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fa432-156b-415d-8036-f01f40a03844 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:45.804584 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fa432-156b-415d-8036-f01f40a03844 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:45.805953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fa432-156b-415d-8036-f01f40a03844 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:45.818162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 556/1084] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:46.570415 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69426e01-02f6-4ebb-aa61-22079929f72e None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:46.571125 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69426e01-02f6-4ebb-aa61-22079929f72e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:46.571125 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69426e01-02f6-4ebb-aa61-22079929f72e None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:46.572370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 529/1085] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:46.577865 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e38a6-4a8b-4543-95de-96280e3747ac None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:46.578294 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e38a6-4a8b-4543-95de-96280e3747ac None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:46.578426 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e38a6-4a8b-4543-95de-96280e3747ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:46.596315 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d46e38a6-4a8b-4543-95de-96280e3747ac None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:46.597512 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d46e38a6-4a8b-4543-95de-96280e3747ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:46.673297 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 557/1086] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:46.697025 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69426e01-02f6-4ebb-aa61-22079929f72e None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:46.799574 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69426e01-02f6-4ebb-aa61-22079929f72e None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:46.835061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c831255-e259-4f70-9ae9-78e428b6be1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:46.835785 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c831255-e259-4f70-9ae9-78e428b6be1a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:46.836064 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c831255-e259-4f70-9ae9-78e428b6be1a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:46.836334 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c831255-e259-4f70-9ae9-78e428b6be1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:46.846531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c831255-e259-4f70-9ae9-78e428b6be1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:27:46.853978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-7c831255-e259-4f70-9ae9-78e428b6be1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:27:46.853978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:46.853978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:46.853978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:46.853978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:46.853978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:46.853978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:46.853978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:46.853978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:46.853978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:46.853978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:46.853978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:46.853978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:27:46.853978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:27:46.853978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:27:46.853978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:27:46.855093 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:27:46.855093 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:27:46.855093 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:27:46.855093 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:27:46.855093 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:46.855093 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:46.855093 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:46.855093 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:46.855093 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:46.855093 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:46.855093 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:46.855093 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:46.855093 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:46.855093 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:46.855093 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:46.855093 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:46.861100 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:46.861100 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:46.861100 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:46.861100 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:46.861100 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:27:46.861100 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:27:46.861100 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:27:46.861100 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:27:46.861100 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:27:46.861100 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:27:46.861100 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:27:46.861100 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:46.861100 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 530/1087] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:27:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:46.863445 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e38a6-4a8b-4543-95de-96280e3747ac None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:46.869732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c15b5-e4d4-43f8-adc3-7054e965a885 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:46.870112 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c15b5-e4d4-43f8-adc3-7054e965a885 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:46.870392 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c15b5-e4d4-43f8-adc3-7054e965a885 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:46.872114 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 531/1088] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:27:46.876929 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689ab2c-5887-4834-b46d-308fa1397dbe None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:46.877213 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689ab2c-5887-4834-b46d-308fa1397dbe None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:46.877486 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689ab2c-5887-4834-b46d-308fa1397dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:46.878104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:46.896685 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-6689ab2c-5887-4834-b46d-308fa1397dbe None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:46.897860 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6689ab2c-5887-4834-b46d-308fa1397dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:46.946429 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:46.962891 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e38a6-4a8b-4543-95de-96280e3747ac None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:46.963621 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 532/1089] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:27:46.987325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689ab2c-5887-4834-b46d-308fa1397dbe None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:46.997099 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53bad5-dde1-4158-b744-7c98b12160f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:46.997779 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53bad5-dde1-4158-b744-7c98b12160f3 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:46.998057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53bad5-dde1-4158-b744-7c98b12160f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:46.998323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53bad5-dde1-4158-b744-7c98b12160f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:46.999078 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53bad5-dde1-4158-b744-7c98b12160f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:46.999409 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53bad5-dde1-4158-b744-7c98b12160f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:47.000784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53bad5-dde1-4158-b744-7c98b12160f3 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:47.013991 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 558/1090] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:27:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:47.015079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53bad5-dde1-4158-b744-7c98b12160f3 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:47.085884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689ab2c-5887-4834-b46d-308fa1397dbe None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:47.089967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:47.114454 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53bad5-dde1-4158-b744-7c98b12160f3 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:47.120532 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d2df5-ced2-4e2f-a998-fd01a97a4de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:47.121365 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d2df5-ced2-4e2f-a998-fd01a97a4de8 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:47.121639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d2df5-ced2-4e2f-a998-fd01a97a4de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:47.121907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d2df5-ced2-4e2f-a998-fd01a97a4de8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:47.131951 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d2df5-ced2-4e2f-a998-fd01a97a4de8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:27:47.140043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-f10d2df5-ced2-4e2f-a998-fd01a97a4de8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:27:47.140043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:47.140043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:47.140043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:47.140043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:47.140043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:47.140043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:47.140043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:47.140043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:47.140043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:47.140043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:47.140043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:47.140043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:27:47.140043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:27:47.140043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:27:47.140043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:27:47.141014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:27:47.141014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:27:47.141014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:27:47.141014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:27:47.141014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:47.141014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:47.141014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:47.141014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:47.141014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:47.141014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:47.141014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:47.141014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:47.141014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:47.141014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:47.141014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:47.141014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:47.141866 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:47.141866 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:47.141866 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:47.141866 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:47.141866 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:27:47.141866 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:27:47.141866 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:27:47.141866 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:27:47.141866 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:27:47.141866 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:27:47.141866 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:27:47.141866 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:47.141866 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 533/1091] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Jun 2 13:27:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:47.147347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d2df5-ced2-4e2f-a998-fd01a97a4de8 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:47.148157 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9936e5-2a3b-45df-b7bf-9e310d2dd960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:47.149037 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9936e5-2a3b-45df-b7bf-9e310d2dd960 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:47.149307 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9936e5-2a3b-45df-b7bf-9e310d2dd960 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:47.149576 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9936e5-2a3b-45df-b7bf-9e310d2dd960 None admin] PATH_INFO: `/v3/users/c95f53b318ea4ba0832f8aed85686ae4` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:47.151166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9936e5-2a3b-45df-b7bf-9e310d2dd960 None admin] RBAC: Authorizing `identity:get_user(user_id=c95f53b318ea4ba0832f8aed85686ae4)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:47.152806 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9936e5-2a3b-45df-b7bf-9e310d2dd960 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:47.154392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 559/1092] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:27:47 2022] GET /identity/v3/users/c95f53b318ea4ba0832f8aed85686ae4 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:47.160079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9936e5-2a3b-45df-b7bf-9e310d2dd960 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:47.192138 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:47.247403 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d2df5-ced2-4e2f-a998-fd01a97a4de8 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:47.264336 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9936e5-2a3b-45df-b7bf-9e310d2dd960 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:47.280545 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bb7df-4173-4fbc-a0a8-b9e69c9f3834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:47.281224 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bb7df-4173-4fbc-a0a8-b9e69c9f3834 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:47.281501 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bb7df-4173-4fbc-a0a8-b9e69c9f3834 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:47.281778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bb7df-4173-4fbc-a0a8-b9e69c9f3834 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:47.282519 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bb7df-4173-4fbc-a0a8-b9e69c9f3834 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:47.282881 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bb7df-4173-4fbc-a0a8-b9e69c9f3834 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:47.284238 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bb7df-4173-4fbc-a0a8-b9e69c9f3834 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:47.292464 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 534/1093] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jun 2 13:27:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:47.297652 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059c485-98c7-4d7e-a84a-1543911371d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:47.298096 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bb7df-4173-4fbc-a0a8-b9e69c9f3834 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:47.298288 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059c485-98c7-4d7e-a84a-1543911371d0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:47.298594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059c485-98c7-4d7e-a84a-1543911371d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:47.298862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059c485-98c7-4d7e-a84a-1543911371d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:47.310832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:47.370219 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059c485-98c7-4d7e-a84a-1543911371d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:47.371760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059c485-98c7-4d7e-a84a-1543911371d0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:47.397343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bb7df-4173-4fbc-a0a8-b9e69c9f3834 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:47.404628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:47.432250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5dbb6-8ee7-499f-9700-b017ae599f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:47.433280 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5dbb6-8ee7-499f-9700-b017ae599f0a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:47.433555 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5dbb6-8ee7-499f-9700-b017ae599f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:47.433833 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5dbb6-8ee7-499f-9700-b017ae599f0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:47.443890 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5dbb6-8ee7-499f-9700-b017ae599f0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:47.445338 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5dbb6-8ee7-499f-9700-b017ae599f0a None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:47.462646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-d1a5dbb6-8ee7-499f-9700-b017ae599f0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:47.462646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:47.462646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:47.462646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:47.462646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:47.462646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:47.462646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:47.462646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:47.462646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:47.462646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:47.462646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:47.462646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:47.462646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:47.462646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:47.462646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:47.463779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:47.463779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:47.463779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:47.463779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:47.463779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:47.463779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:47.463779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:47.463779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:47.463779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:47.463779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:47.463779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:47.463779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:47.463779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:47.463779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:47.463779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:47.463779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:47.463779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:47.464925 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:47.464925 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:47.464925 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:47.464925 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:47.464925 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 535/1094] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:27:47.469819 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5dbb6-8ee7-499f-9700-b017ae599f0a None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:47.473960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 560/1095] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:27:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 13:27:47.480039 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059c485-98c7-4d7e-a84a-1543911371d0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:47.522035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:47.577260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5dbb6-8ee7-499f-9700-b017ae599f0a None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:47.579913 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059c485-98c7-4d7e-a84a-1543911371d0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:47.612138 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453066bc-77c3-4222-92b8-fb7d99c9929f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:47.612810 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453066bc-77c3-4222-92b8-fb7d99c9929f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:47.613089 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453066bc-77c3-4222-92b8-fb7d99c9929f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:47.613425 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453066bc-77c3-4222-92b8-fb7d99c9929f None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:47.614100 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453066bc-77c3-4222-92b8-fb7d99c9929f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:47.614407 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453066bc-77c3-4222-92b8-fb7d99c9929f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:47.614951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db3074-2839-49fe-8d18-7293520bfa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:47.615803 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453066bc-77c3-4222-92b8-fb7d99c9929f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:47.615908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db3074-2839-49fe-8d18-7293520bfa98 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:47.616070 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db3074-2839-49fe-8d18-7293520bfa98 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:47.616333 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db3074-2839-49fe-8d18-7293520bfa98 None admin] PATH_INFO: `/v3/projects/bbd9263176274738a6fef6ba8b25bb34` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:47.617488 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db3074-2839-49fe-8d18-7293520bfa98 None admin] RBAC: Authorizing `identity:get_project(project_id=bbd9263176274738a6fef6ba8b25bb34)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:47.618912 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db3074-2839-49fe-8d18-7293520bfa98 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:47.620706 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 561/1096] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:27:47 2022] GET /identity/v3/projects/bbd9263176274738a6fef6ba8b25bb34 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:47.626759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db3074-2839-49fe-8d18-7293520bfa98 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:47.632274 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 536/1097] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:27:47.634656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453066bc-77c3-4222-92b8-fb7d99c9929f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:47.654781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:47.725469 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db3074-2839-49fe-8d18-7293520bfa98 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:47.733779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453066bc-77c3-4222-92b8-fb7d99c9929f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:47.736712 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:47.759576 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4252730-1624-4b53-9403-82f254c2ea6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:47.760241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4252730-1624-4b53-9403-82f254c2ea6a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:47.760629 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4252730-1624-4b53-9403-82f254c2ea6a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:47.760958 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4252730-1624-4b53-9403-82f254c2ea6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:47.761785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4252730-1624-4b53-9403-82f254c2ea6a None admin] RBAC: Adding query filter params (role.id=6edd584a77084fa78240661ea76cddb5, scope.project.id=bbd9263176274738a6fef6ba8b25bb34, user.id=c95f53b318ea4ba0832f8aed85686ae4) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:47.762094 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4252730-1624-4b53-9403-82f254c2ea6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:47.763544 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4252730-1624-4b53-9403-82f254c2ea6a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:47.767770 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0a9bd-f946-4dea-8746-4e9c8ba24408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:47.768572 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0a9bd-f946-4dea-8746-4e9c8ba24408 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:47.768852 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0a9bd-f946-4dea-8746-4e9c8ba24408 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:47.769124 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0a9bd-f946-4dea-8746-4e9c8ba24408 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:47.769565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 562/1098] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:27:47 2022] GET /identity/v3/role_assignments?user.id=c95f53b318ea4ba0832f8aed85686ae4&scope.project.id=bbd9263176274738a6fef6ba8b25bb34&role.id=6edd584a77084fa78240661ea76cddb5 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:47.777928 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0a9bd-f946-4dea-8746-4e9c8ba24408 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:47.779549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0a9bd-f946-4dea-8746-4e9c8ba24408 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:47.795575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-e4d0a9bd-f946-4dea-8746-4e9c8ba24408 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:27:47.795575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:47.795575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:47.795575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:47.795575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:47.795575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:47.795575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:47.795575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:47.795575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:47.795575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:47.795575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:47.795575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:47.795575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:27:47.795575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:27:47.795575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:27:47.795575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:27:47.796832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:47.796832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:47.796832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:27:47.796832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:47.796832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:27:47.796832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:27:47.796832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:47.796832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:47.796832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:47.796832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:47.796832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:47.796832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:47.796832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:47.796832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:47.796832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:47.796832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:47.796832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:47.796832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:47.797994 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:47.797994 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:47.797994 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:27:47.797994 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:27:47.797994 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:27:47.797994 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:27:47.797994 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:27:47.797994 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:27:47.797994 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:27:47.797994 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:27:47.797994 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 537/1099] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 2 13:27:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:47.802833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4252730-1624-4b53-9403-82f254c2ea6a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:47.910414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4252730-1624-4b53-9403-82f254c2ea6a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:47.948131 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da71e7-493c-44aa-a54c-399001e51935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:47.949007 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da71e7-493c-44aa-a54c-399001e51935 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:47.949282 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da71e7-493c-44aa-a54c-399001e51935 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:47.949570 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da71e7-493c-44aa-a54c-399001e51935 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:47.950407 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da71e7-493c-44aa-a54c-399001e51935 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:47.950745 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da71e7-493c-44aa-a54c-399001e51935 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:47.952204 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da71e7-493c-44aa-a54c-399001e51935 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:47.971772 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 563/1100] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 2 13:27:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:47.977883 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0a9bd-f946-4dea-8746-4e9c8ba24408 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:48.064639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:48.088121 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0a9bd-f946-4dea-8746-4e9c8ba24408 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:48.126094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95e7b8-8465-49da-b8ae-abd827aa8261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:48.126718 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95e7b8-8465-49da-b8ae-abd827aa8261 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:48.126999 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95e7b8-8465-49da-b8ae-abd827aa8261 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:48.127273 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95e7b8-8465-49da-b8ae-abd827aa8261 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:48.196352 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95e7b8-8465-49da-b8ae-abd827aa8261 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:48.197807 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95e7b8-8465-49da-b8ae-abd827aa8261 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:48.274423 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:48.297961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 538/1101] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:27:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:27:48.303827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da71e7-493c-44aa-a54c-399001e51935 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:48.336601 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:48.415418 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da71e7-493c-44aa-a54c-399001e51935 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:48.456529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a3eb7-42c6-4495-922f-6fa835e2628e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:48.457268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a3eb7-42c6-4495-922f-6fa835e2628e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:48.457528 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a3eb7-42c6-4495-922f-6fa835e2628e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:48.457801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a3eb7-42c6-4495-922f-6fa835e2628e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:48.469101 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a3eb7-42c6-4495-922f-6fa835e2628e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:48.470578 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a3eb7-42c6-4495-922f-6fa835e2628e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:48.493148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-1d9a3eb7-42c6-4495-922f-6fa835e2628e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:48.493148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:48.493148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:48.493148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:48.493148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:48.493148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:48.493148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:48.493148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:48.493148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:48.493148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:48.493148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:48.493148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:48.493148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:27:48.493148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:27:48.493148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:27:48.494120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:27:48.494120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:48.494120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:48.494120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:48.494120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:48.494120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:48.494120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:48.494120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:48.494120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:48.494120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:48.494120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:48.494120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:48.494120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:48.494120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:48.494120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:48.494120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:48.494120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:48.495196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:27:48.495196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:27:48.495196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:27:48.495196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:48.495196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 564/1102] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:48.501304 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95e7b8-8465-49da-b8ae-abd827aa8261 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:48.622323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95e7b8-8465-49da-b8ae-abd827aa8261 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:48.660527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bee031-0520-428f-ae1a-4d06c6b04ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:48.661200 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bee031-0520-428f-ae1a-4d06c6b04ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:48.661477 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bee031-0520-428f-ae1a-4d06c6b04ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:48.661742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bee031-0520-428f-ae1a-4d06c6b04ed0 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:48.662457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bee031-0520-428f-ae1a-4d06c6b04ed0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:48.662790 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bee031-0520-428f-ae1a-4d06c6b04ed0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:48.664143 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bee031-0520-428f-ae1a-4d06c6b04ed0 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:48.676398 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 539/1103] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:48.682100 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a3eb7-42c6-4495-922f-6fa835e2628e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:48.785933 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:48.803770 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a3eb7-42c6-4495-922f-6fa835e2628e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:48.848949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6683c8-ae19-434b-bafe-7a0c412c806b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:48.849769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6683c8-ae19-434b-bafe-7a0c412c806b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:48.850046 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6683c8-ae19-434b-bafe-7a0c412c806b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:48.850319 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6683c8-ae19-434b-bafe-7a0c412c806b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:48.857602 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6683c8-ae19-434b-bafe-7a0c412c806b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:48.859098 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6683c8-ae19-434b-bafe-7a0c412c806b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:48.875233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-ed6683c8-ae19-434b-bafe-7a0c412c806b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:48.875233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:27:48.875233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:27:48.875233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:27:48.875233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:27:48.875233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:27:48.875233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:27:48.875233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:27:48.875233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:27:48.875233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:27:48.875233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:27:48.875233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:27:48.875233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:27:48.875233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:27:48.875233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:27:48.876206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:27:48.876206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:27:48.876206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:27:48.876206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:27:48.876206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:27:48.876206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:27:48.876206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:27:48.876206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:27:48.876206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:27:48.876206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:27:48.876206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:27:48.876206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:27:48.876206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:27:48.876206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:27:48.876206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:27:48.876206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:27:48.876206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:27:48.877254 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:27:48.877254 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:27:48.877254 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:27:48.877254 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:27:48.877254 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:27:48.877254 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:27:48.877254 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:27:48.877254 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:27:48.877254 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 565/1104] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:27:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:27:48.883022 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bee031-0520-428f-ae1a-4d06c6b04ed0 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:48.935268 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:49.002231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bee031-0520-428f-ae1a-4d06c6b04ed0 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:49.041208 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e35ad1-4860-4a23-a617-a98434b00314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:49.041890 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e35ad1-4860-4a23-a617-a98434b00314 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:49.042213 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e35ad1-4860-4a23-a617-a98434b00314 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:49.042520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e35ad1-4860-4a23-a617-a98434b00314 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:49.043256 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e35ad1-4860-4a23-a617-a98434b00314 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:49.043559 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e35ad1-4860-4a23-a617-a98434b00314 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:49.044950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e35ad1-4860-4a23-a617-a98434b00314 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:49.057034 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 540/1105] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:27:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:49.063524 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6683c8-ae19-434b-bafe-7a0c412c806b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:49.164561 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6683c8-ae19-434b-bafe-7a0c412c806b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:49.198904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c2cdd-9914-45b5-890d-a47926010152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:49.199553 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c2cdd-9914-45b5-890d-a47926010152 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:49.199825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c2cdd-9914-45b5-890d-a47926010152 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:49.200091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c2cdd-9914-45b5-890d-a47926010152 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:49.200917 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c2cdd-9914-45b5-890d-a47926010152 None admin] RBAC: Adding query filter params (role.id=ee7c0043cf84487d98a7417ff2ffadd4, scope.project.id=af45a1ec7c94408bb638c55fb43fa961, user.id=5a0061e2927843cf86769d2beab18743) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:49.201223 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c2cdd-9914-45b5-890d-a47926010152 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:49.202683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c2cdd-9914-45b5-890d-a47926010152 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:49.208905 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 566/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:27:49 2022] GET /identity/v3/role_assignments?user.id=5a0061e2927843cf86769d2beab18743&scope.project.id=af45a1ec7c94408bb638c55fb43fa961&role.id=ee7c0043cf84487d98a7417ff2ffadd4 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:50.092587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1811bd-e85b-4fae-98b2-4a081c70e04c None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:50.093161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1811bd-e85b-4fae-98b2-4a081c70e04c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:50.093161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1811bd-e85b-4fae-98b2-4a081c70e04c None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:50.094502 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 541/1107] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:50.100014 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa02955-f02a-4faa-8f6e-1810c14b6169 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:50.100432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa02955-f02a-4faa-8f6e-1810c14b6169 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:50.100542 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa02955-f02a-4faa-8f6e-1810c14b6169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:50.118742 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2fa02955-f02a-4faa-8f6e-1810c14b6169 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:50.120422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2fa02955-f02a-4faa-8f6e-1810c14b6169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:50.121951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:50.189276 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 567/1108] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:50.214502 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1811bd-e85b-4fae-98b2-4a081c70e04c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:50.339306 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:50.345353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1811bd-e85b-4fae-98b2-4a081c70e04c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:50.380109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad84597-0d2b-40eb-ae6e-db08d1ed36ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:50.380903 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad84597-0d2b-40eb-ae6e-db08d1ed36ec None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:50.381185 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad84597-0d2b-40eb-ae6e-db08d1ed36ec None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:50.381452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad84597-0d2b-40eb-ae6e-db08d1ed36ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:50.382700 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad84597-0d2b-40eb-ae6e-db08d1ed36ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:50.384117 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad84597-0d2b-40eb-ae6e-db08d1ed36ec None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:50.385812 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 542/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:27:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:50.394240 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa02955-f02a-4faa-8f6e-1810c14b6169 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:50.497210 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa02955-f02a-4faa-8f6e-1810c14b6169 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:50.547231 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417811a-2741-4655-8c60-28a824b0c980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:50.547886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417811a-2741-4655-8c60-28a824b0c980 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:50.548163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417811a-2741-4655-8c60-28a824b0c980 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:50.548433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417811a-2741-4655-8c60-28a824b0c980 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:50.549137 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417811a-2741-4655-8c60-28a824b0c980 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:50.550608 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417811a-2741-4655-8c60-28a824b0c980 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:50.559668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:50.575257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 568/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 13:27:50 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:27:52.831967 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738242e-36e0-49b9-8bd3-97fd3df5a303 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:52.832568 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738242e-36e0-49b9-8bd3-97fd3df5a303 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:52.832568 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738242e-36e0-49b9-8bd3-97fd3df5a303 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:52.833860 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 543/1111] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:52.840263 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a506588-c33c-4443-b7f5-8b7112d332c4 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:52.840938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a506588-c33c-4443-b7f5-8b7112d332c4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:52.841123 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a506588-c33c-4443-b7f5-8b7112d332c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:52.864307 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-9a506588-c33c-4443-b7f5-8b7112d332c4 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:52.865480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9a506588-c33c-4443-b7f5-8b7112d332c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:52.936641 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 569/1112] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:52.966152 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738242e-36e0-49b9-8bd3-97fd3df5a303 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:53.072095 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738242e-36e0-49b9-8bd3-97fd3df5a303 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:53.109177 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6891d-5d2c-4e29-a9ec-7b09ce3c4a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:53.110078 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6891d-5d2c-4e29-a9ec-7b09ce3c4a35 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:53.110349 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6891d-5d2c-4e29-a9ec-7b09ce3c4a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:53.110617 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6891d-5d2c-4e29-a9ec-7b09ce3c4a35 None admin] PATH_INFO: `/v3/roles/f63a52fb33144307bba2318551138669` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:53.112197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6891d-5d2c-4e29-a9ec-7b09ce3c4a35 None admin] RBAC: Authorizing `identity:get_role(role_id=f63a52fb33144307bba2318551138669)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:53.113548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6891d-5d2c-4e29-a9ec-7b09ce3c4a35 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:53.114936 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 544/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:27:52 2022] GET /identity/v3/roles/f63a52fb33144307bba2318551138669 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:53.121781 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a506588-c33c-4443-b7f5-8b7112d332c4 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:53.235501 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a506588-c33c-4443-b7f5-8b7112d332c4 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:53.259281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:53.277251 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85363c4a-f629-4276-a4e4-916b6314d15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:53.278137 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85363c4a-f629-4276-a4e4-916b6314d15a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:53.278417 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85363c4a-f629-4276-a4e4-916b6314d15a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:53.278727 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85363c4a-f629-4276-a4e4-916b6314d15a None admin] PATH_INFO: `/v3/users/65539313e0b847c3bbe87e4d8b491549` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:53.291958 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85363c4a-f629-4276-a4e4-916b6314d15a None admin] RBAC: Authorizing `identity:get_user(user_id=65539313e0b847c3bbe87e4d8b491549)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:53.293524 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85363c4a-f629-4276-a4e4-916b6314d15a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:53.295172 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 570/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:27:53 2022] GET /identity/v3/users/65539313e0b847c3bbe87e4d8b491549 => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:53.301607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6891d-5d2c-4e29-a9ec-7b09ce3c4a35 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:53.338694 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:53.404274 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6891d-5d2c-4e29-a9ec-7b09ce3c4a35 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:53.439473 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8309480-713d-4090-8b8e-3feff1e5d691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:53.440151 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8309480-713d-4090-8b8e-3feff1e5d691 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:53.440433 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8309480-713d-4090-8b8e-3feff1e5d691 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:53.440697 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8309480-713d-4090-8b8e-3feff1e5d691 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:53.516691 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8309480-713d-4090-8b8e-3feff1e5d691 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:53.518106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8309480-713d-4090-8b8e-3feff1e5d691 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:53.551652 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:53.625475 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 545/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:27:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:27:53.633791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85363c4a-f629-4276-a4e4-916b6314d15a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:53.735294 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85363c4a-f629-4276-a4e4-916b6314d15a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:53.770755 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beaec68-ba72-4d85-b0ea-950c5f8ce01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:53.771548 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaec68-ba72-4d85-b0ea-950c5f8ce01c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:53.771833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaec68-ba72-4d85-b0ea-950c5f8ce01c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:53.772103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaec68-ba72-4d85-b0ea-950c5f8ce01c None admin] PATH_INFO: `/v3/projects/bbd9263176274738a6fef6ba8b25bb34` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:53.773295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaec68-ba72-4d85-b0ea-950c5f8ce01c None admin] RBAC: Authorizing `identity:get_project(project_id=bbd9263176274738a6fef6ba8b25bb34)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:53.774774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaec68-ba72-4d85-b0ea-950c5f8ce01c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:53.776853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 571/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:27:53 2022] GET /identity/v3/projects/bbd9263176274738a6fef6ba8b25bb34 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:53.783334 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8309480-713d-4090-8b8e-3feff1e5d691 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:53.883493 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8309480-713d-4090-8b8e-3feff1e5d691 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:53.920843 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c135c-c0e1-4b34-9ffc-dd075221224e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:53.921490 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c135c-c0e1-4b34-9ffc-dd075221224e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:53.921767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c135c-c0e1-4b34-9ffc-dd075221224e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:53.922033 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c135c-c0e1-4b34-9ffc-dd075221224e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:53.922884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c135c-c0e1-4b34-9ffc-dd075221224e None admin] RBAC: Adding query filter params (role.id=f63a52fb33144307bba2318551138669, scope.project.id=bbd9263176274738a6fef6ba8b25bb34, user.id=65539313e0b847c3bbe87e4d8b491549) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:53.923190 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c135c-c0e1-4b34-9ffc-dd075221224e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:53.924573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c135c-c0e1-4b34-9ffc-dd075221224e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:53.926438 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:53.931588 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 546/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:27:53 2022] GET /identity/v3/role_assignments?user.id=65539313e0b847c3bbe87e4d8b491549&scope.project.id=bbd9263176274738a6fef6ba8b25bb34&role.id=f63a52fb33144307bba2318551138669 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:56.137268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952603c-8d69-4e99-a57a-6686d6584fdb None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:56.138161 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952603c-8d69-4e99-a57a-6686d6584fdb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:56.138415 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952603c-8d69-4e99-a57a-6686d6584fdb None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:56.140686 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 572/1118] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:56.147017 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e04ebc-af40-430f-9a3e-0316e4f2426a None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:56.147755 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e04ebc-af40-430f-9a3e-0316e4f2426a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:56.147899 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e04ebc-af40-430f-9a3e-0316e4f2426a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:56.167281 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-01e04ebc-af40-430f-9a3e-0316e4f2426a None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:56.168466 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-01e04ebc-af40-430f-9a3e-0316e4f2426a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:56.239803 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 547/1119] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:56.265063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952603c-8d69-4e99-a57a-6686d6584fdb None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:56.331182 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:56.395846 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952603c-8d69-4e99-a57a-6686d6584fdb None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:56.443777 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5b7ce-79e9-43e9-8a7f-a75fced5c47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:56.445112 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5b7ce-79e9-43e9-8a7f-a75fced5c47e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:56.445500 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5b7ce-79e9-43e9-8a7f-a75fced5c47e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:56.446463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5b7ce-79e9-43e9-8a7f-a75fced5c47e None admin] PATH_INFO: `/v3/roles/f63a52fb33144307bba2318551138669` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:56.448247 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5b7ce-79e9-43e9-8a7f-a75fced5c47e None admin] RBAC: Authorizing `identity:get_role(role_id=f63a52fb33144307bba2318551138669)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:56.449694 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5b7ce-79e9-43e9-8a7f-a75fced5c47e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:56.451638 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 573/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:27:56 2022] GET /identity/v3/roles/f63a52fb33144307bba2318551138669 => generated 223 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:56.460400 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e04ebc-af40-430f-9a3e-0316e4f2426a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:56.596873 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e04ebc-af40-430f-9a3e-0316e4f2426a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:56.629352 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:56.639729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec56ffe-cf15-4c0c-b5f8-57d5ac5b3ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:56.640625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec56ffe-cf15-4c0c-b5f8-57d5ac5b3ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:56.640903 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec56ffe-cf15-4c0c-b5f8-57d5ac5b3ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:56.641167 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec56ffe-cf15-4c0c-b5f8-57d5ac5b3ef0 None admin] PATH_INFO: `/v3/users/65539313e0b847c3bbe87e4d8b491549` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:56.642370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec56ffe-cf15-4c0c-b5f8-57d5ac5b3ef0 None admin] RBAC: Authorizing `identity:get_user(user_id=65539313e0b847c3bbe87e4d8b491549)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:56.643831 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec56ffe-cf15-4c0c-b5f8-57d5ac5b3ef0 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:56.645474 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 548/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:27:56 2022] GET /identity/v3/users/65539313e0b847c3bbe87e4d8b491549 => generated 286 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:56.651952 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5b7ce-79e9-43e9-8a7f-a75fced5c47e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:56.751506 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5b7ce-79e9-43e9-8a7f-a75fced5c47e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:56.771055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:56.791103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183327b-f3d4-4163-b598-a419985cf838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:56.792168 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183327b-f3d4-4163-b598-a419985cf838 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:56.792443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183327b-f3d4-4163-b598-a419985cf838 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:56.792718 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183327b-f3d4-4163-b598-a419985cf838 None admin] PATH_INFO: `/v3/projects/bbd9263176274738a6fef6ba8b25bb34` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:56.793932 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183327b-f3d4-4163-b598-a419985cf838 None admin] RBAC: Authorizing `identity:get_project(project_id=bbd9263176274738a6fef6ba8b25bb34)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:56.795402 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183327b-f3d4-4163-b598-a419985cf838 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:56.797045 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 574/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:27:56 2022] GET /identity/v3/projects/bbd9263176274738a6fef6ba8b25bb34 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:56.803410 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec56ffe-cf15-4c0c-b5f8-57d5ac5b3ef0 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:56.911314 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec56ffe-cf15-4c0c-b5f8-57d5ac5b3ef0 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:56.946148 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b517f-07ff-4757-8d66-db7b790c1335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:56.947064 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b517f-07ff-4757-8d66-db7b790c1335 None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:56.947337 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b517f-07ff-4757-8d66-db7b790c1335 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:56.947607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b517f-07ff-4757-8d66-db7b790c1335 None admin] PATH_INFO: `/v3/projects/bbd9263176274738a6fef6ba8b25bb34/users/65539313e0b847c3bbe87e4d8b491549/roles/f63a52fb33144307bba2318551138669` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:56.950366 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b517f-07ff-4757-8d66-db7b790c1335 None admin] RBAC: Authorizing `identity:create_grant(project_id=bbd9263176274738a6fef6ba8b25bb34, user_id=65539313e0b847c3bbe87e4d8b491549, role_id=f63a52fb33144307bba2318551138669)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:56.951741 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b517f-07ff-4757-8d66-db7b790c1335 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:56.966152 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 549/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 13:27:56 2022] PUT /identity/v3/projects/bbd9263176274738a6fef6ba8b25bb34/users/65539313e0b847c3bbe87e4d8b491549/roles/f63a52fb33144307bba2318551138669 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:27:59.181162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd99166-5425-4b98-9b25-95342aec8d9a None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:59.181730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd99166-5425-4b98-9b25-95342aec8d9a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:59.181730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd99166-5425-4b98-9b25-95342aec8d9a None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:59.183262 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 575/1124] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:59.189859 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b8eeb-f762-420c-81b4-a745ca593c0d None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:59.190558 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b8eeb-f762-420c-81b4-a745ca593c0d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:59.190773 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b8eeb-f762-420c-81b4-a745ca593c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:59.217765 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-439b8eeb-f762-420c-81b4-a745ca593c0d None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:59.218986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-439b8eeb-f762-420c-81b4-a745ca593c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:59.273220 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:59.291730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 550/1125] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:27:59.316093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd99166-5425-4b98-9b25-95342aec8d9a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:59.423551 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd99166-5425-4b98-9b25-95342aec8d9a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:59.458350 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d7948-f950-4dd2-a3da-5db9013b6400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:59.459163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d7948-f950-4dd2-a3da-5db9013b6400 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:59.459436 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d7948-f950-4dd2-a3da-5db9013b6400 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:59.459699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d7948-f950-4dd2-a3da-5db9013b6400 None admin] PATH_INFO: `/v3/roles/f63a52fb33144307bba2318551138669` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:59.461180 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d7948-f950-4dd2-a3da-5db9013b6400 None admin] RBAC: Authorizing `identity:get_role(role_id=f63a52fb33144307bba2318551138669)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:59.462559 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d7948-f950-4dd2-a3da-5db9013b6400 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:59.464043 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 576/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:27:59 2022] GET /identity/v3/roles/f63a52fb33144307bba2318551138669 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:59.473038 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b8eeb-f762-420c-81b4-a745ca593c0d None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:59.578841 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b8eeb-f762-420c-81b4-a745ca593c0d None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:59.625741 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f27e2-3143-47f6-aa63-0361ea90c9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:59.626622 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f27e2-3143-47f6-aa63-0361ea90c9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:59.626921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f27e2-3143-47f6-aa63-0361ea90c9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:59.627177 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f27e2-3143-47f6-aa63-0361ea90c9d7 None admin] PATH_INFO: `/v3/users/65539313e0b847c3bbe87e4d8b491549` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:59.628422 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f27e2-3143-47f6-aa63-0361ea90c9d7 None admin] RBAC: Authorizing `identity:get_user(user_id=65539313e0b847c3bbe87e4d8b491549)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:59.630337 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f27e2-3143-47f6-aa63-0361ea90c9d7 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:59.631493 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 551/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:27:59 2022] GET /identity/v3/users/65539313e0b847c3bbe87e4d8b491549 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:59.637941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d7948-f950-4dd2-a3da-5db9013b6400 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:59.701475 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:59.759615 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d7948-f950-4dd2-a3da-5db9013b6400 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:59.797956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e4410-fcb0-4c89-9e1c-d462c6107c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:59.798613 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e4410-fcb0-4c89-9e1c-d462c6107c7a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:59.798905 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e4410-fcb0-4c89-9e1c-d462c6107c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:59.799179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e4410-fcb0-4c89-9e1c-d462c6107c7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:59.868748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e4410-fcb0-4c89-9e1c-d462c6107c7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:59.870264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e4410-fcb0-4c89-9e1c-d462c6107c7a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:59.922402 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:59.986864 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 577/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:27:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:27:59.995508 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f27e2-3143-47f6-aa63-0361ea90c9d7 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:00.060042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:00.109704 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f27e2-3143-47f6-aa63-0361ea90c9d7 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:00.151577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3f149-13c2-49c3-8f33-93f891f0659d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:00.152448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3f149-13c2-49c3-8f33-93f891f0659d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:00.152729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3f149-13c2-49c3-8f33-93f891f0659d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:00.153005 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3f149-13c2-49c3-8f33-93f891f0659d None admin] PATH_INFO: `/v3/projects/bbd9263176274738a6fef6ba8b25bb34` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:00.154230 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3f149-13c2-49c3-8f33-93f891f0659d None admin] RBAC: Authorizing `identity:get_project(project_id=bbd9263176274738a6fef6ba8b25bb34)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:00.155687 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3f149-13c2-49c3-8f33-93f891f0659d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:00.157376 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 552/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:27:59 2022] GET /identity/v3/projects/bbd9263176274738a6fef6ba8b25bb34 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:00.163835 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e4410-fcb0-4c89-9e1c-d462c6107c7a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:00.265851 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e4410-fcb0-4c89-9e1c-d462c6107c7a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:00.303027 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac968b-53eb-47a5-9730-c6c5b9fec998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:00.303692 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac968b-53eb-47a5-9730-c6c5b9fec998 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:00.303969 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac968b-53eb-47a5-9730-c6c5b9fec998 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:00.304242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac968b-53eb-47a5-9730-c6c5b9fec998 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:00.305072 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac968b-53eb-47a5-9730-c6c5b9fec998 None admin] RBAC: Adding query filter params (role.id=f63a52fb33144307bba2318551138669, scope.project.id=bbd9263176274738a6fef6ba8b25bb34, user.id=65539313e0b847c3bbe87e4d8b491549) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:28:00.305391 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac968b-53eb-47a5-9730-c6c5b9fec998 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:00.306849 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac968b-53eb-47a5-9730-c6c5b9fec998 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:00.312987 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 578/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:28:00 2022] GET /identity/v3/role_assignments?user.id=65539313e0b847c3bbe87e4d8b491549&scope.project.id=bbd9263176274738a6fef6ba8b25bb34&role.id=f63a52fb33144307bba2318551138669 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:02.572616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4b7c2-7d8b-4def-83f4-2031b677430d None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:02.573178 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4b7c2-7d8b-4def-83f4-2031b677430d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:02.573268 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4b7c2-7d8b-4def-83f4-2031b677430d None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:02.574629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 553/1131] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:02.581246 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2309f29-1b79-46c0-8dbb-3f7a9948f662 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:02.581936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2309f29-1b79-46c0-8dbb-3f7a9948f662 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:02.582057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2309f29-1b79-46c0-8dbb-3f7a9948f662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:02.608150 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e2309f29-1b79-46c0-8dbb-3f7a9948f662 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:02.609298 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e2309f29-1b79-46c0-8dbb-3f7a9948f662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:02.623613 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:02.680640 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 579/1132] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:28:02.711971 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4b7c2-7d8b-4def-83f4-2031b677430d None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:02.823755 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4b7c2-7d8b-4def-83f4-2031b677430d None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:02.847934 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:02.862901 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e73d78-ac7f-4afb-968b-349cec5a22df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:02.863691 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e73d78-ac7f-4afb-968b-349cec5a22df None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:02.863966 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e73d78-ac7f-4afb-968b-349cec5a22df None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:02.864236 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e73d78-ac7f-4afb-968b-349cec5a22df None admin] PATH_INFO: `/v3/domains/default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:02.865452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e73d78-ac7f-4afb-968b-349cec5a22df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:02.866896 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e73d78-ac7f-4afb-968b-349cec5a22df None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:02.868494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 554/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:28:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:02.875185 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2309f29-1b79-46c0-8dbb-3f7a9948f662 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:02.985104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2309f29-1b79-46c0-8dbb-3f7a9948f662 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:03.020982 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49459eab-32ad-463b-a833-a1d7e99d2a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:03.021640 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49459eab-32ad-463b-a833-a1d7e99d2a81 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:03.021917 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49459eab-32ad-463b-a833-a1d7e99d2a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:03.022188 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49459eab-32ad-463b-a833-a1d7e99d2a81 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:03.022925 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49459eab-32ad-463b-a833-a1d7e99d2a81 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:03.024366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49459eab-32ad-463b-a833-a1d7e99d2a81 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:03.045738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:03.052723 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 580/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 13:28:02 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:28:05.318903 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3802d-dcdf-4e0f-9d8d-71b922e4d374 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:05.319757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3802d-dcdf-4e0f-9d8d-71b922e4d374 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:05.319757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3802d-dcdf-4e0f-9d8d-71b922e4d374 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:05.321880 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 555/1135] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:28:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:05.331065 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051acdc0-e357-4cfd-ab1f-ebf85107ecca None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:05.331504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051acdc0-e357-4cfd-ab1f-ebf85107ecca None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:05.331593 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051acdc0-e357-4cfd-ab1f-ebf85107ecca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:05.350270 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-051acdc0-e357-4cfd-ab1f-ebf85107ecca None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:05.351497 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-051acdc0-e357-4cfd-ab1f-ebf85107ecca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:05.422849 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 581/1136] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:28:05.457465 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3802d-dcdf-4e0f-9d8d-71b922e4d374 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:05.572272 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3802d-dcdf-4e0f-9d8d-71b922e4d374 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:05.607254 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e0deb-4d3e-4b0a-9f28-ac923bd1e438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:05.608032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e0deb-4d3e-4b0a-9f28-ac923bd1e438 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:05.608307 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e0deb-4d3e-4b0a-9f28-ac923bd1e438 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:05.608578 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e0deb-4d3e-4b0a-9f28-ac923bd1e438 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:05.609901 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e0deb-4d3e-4b0a-9f28-ac923bd1e438 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:05.611349 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e0deb-4d3e-4b0a-9f28-ac923bd1e438 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:05.612941 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 556/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:28:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:05.621536 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051acdc0-e357-4cfd-ab1f-ebf85107ecca None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:05.725153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051acdc0-e357-4cfd-ab1f-ebf85107ecca None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:05.754345 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:05.763194 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f8bd6-cabe-4555-b73f-74831bd0c769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:05.763875 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f8bd6-cabe-4555-b73f-74831bd0c769 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:05.764151 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f8bd6-cabe-4555-b73f-74831bd0c769 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:05.764420 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f8bd6-cabe-4555-b73f-74831bd0c769 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:05.765123 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f8bd6-cabe-4555-b73f-74831bd0c769 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:05.766594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f8bd6-cabe-4555-b73f-74831bd0c769 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:05.789558 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 582/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 13:28:05 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:28:08.056462 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c7fb3-df7e-48cf-9bd6-694dd3c3e74c None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:08.057179 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c7fb3-df7e-48cf-9bd6-694dd3c3e74c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:08.057179 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c7fb3-df7e-48cf-9bd6-694dd3c3e74c None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:08.058414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 557/1139] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:08.066167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f370ae8-4fcd-4f7d-8700-88c4addd2a53 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:08.066870 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f370ae8-4fcd-4f7d-8700-88c4addd2a53 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:08.067102 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f370ae8-4fcd-4f7d-8700-88c4addd2a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:08.087701 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4f370ae8-4fcd-4f7d-8700-88c4addd2a53 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:08.089140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4f370ae8-4fcd-4f7d-8700-88c4addd2a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:08.170092 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 583/1140] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:28:08.194449 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c7fb3-df7e-48cf-9bd6-694dd3c3e74c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:08.257771 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:08.302892 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c7fb3-df7e-48cf-9bd6-694dd3c3e74c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:08.337132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15806e0-a794-4018-83bd-6ec8d1e5f90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:08.337852 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15806e0-a794-4018-83bd-6ec8d1e5f90d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:08.338200 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15806e0-a794-4018-83bd-6ec8d1e5f90d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:08.338553 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15806e0-a794-4018-83bd-6ec8d1e5f90d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:08.348775 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15806e0-a794-4018-83bd-6ec8d1e5f90d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:28:08.356441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-a15806e0-a794-4018-83bd-6ec8d1e5f90d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:28:08.356441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:28:08.356441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:28:08.356441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:28:08.356441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:28:08.356441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:28:08.356441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:28:08.356441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:28:08.356441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:28:08.356441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:28:08.356441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:28:08.356441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:28:08.356441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:28:08.356441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:28:08.356441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:28:08.356441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:28:08.357460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:28:08.357460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:28:08.357460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:28:08.357460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:28:08.357460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:28:08.357460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:28:08.357460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:28:08.357460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:28:08.357460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:28:08.357460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:28:08.357460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:28:08.357460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:28:08.357460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:28:08.357460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:28:08.357460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:28:08.357460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:28:08.358442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:28:08.358442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:28:08.358442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:28:08.358442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:28:08.358442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:28:08.358442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:28:08.358442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:28:08.358442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:28:08.358442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:28:08.358442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:28:08.358442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:28:08.358442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:28:08.358442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 558/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:28:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:28:08.363949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f370ae8-4fcd-4f7d-8700-88c4addd2a53 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:08.465358 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f370ae8-4fcd-4f7d-8700-88c4addd2a53 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:08.481820 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:08.500264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede3f4d-c35d-4e24-83ca-257677e8cb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:08.500937 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede3f4d-c35d-4e24-83ca-257677e8cb70 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:08.501215 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede3f4d-c35d-4e24-83ca-257677e8cb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:08.501484 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede3f4d-c35d-4e24-83ca-257677e8cb70 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:08.502264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede3f4d-c35d-4e24-83ca-257677e8cb70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:28:08.502564 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede3f4d-c35d-4e24-83ca-257677e8cb70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:08.503954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede3f4d-c35d-4e24-83ca-257677e8cb70 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:08.511937 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 584/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:28:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:08.518055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15806e0-a794-4018-83bd-6ec8d1e5f90d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:08.622766 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15806e0-a794-4018-83bd-6ec8d1e5f90d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:08.642940 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:08.660979 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72ab4a-34d6-4cb8-bee2-2f58b94a0544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:08.661857 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72ab4a-34d6-4cb8-bee2-2f58b94a0544 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:08.662133 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72ab4a-34d6-4cb8-bee2-2f58b94a0544 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:08.662404 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72ab4a-34d6-4cb8-bee2-2f58b94a0544 None admin] PATH_INFO: `/v3/users/d0a0d41d4e2944a89a171e8489fdda53` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:08.675747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72ab4a-34d6-4cb8-bee2-2f58b94a0544 None admin] RBAC: Authorizing `identity:get_user(user_id=d0a0d41d4e2944a89a171e8489fdda53)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:08.677173 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72ab4a-34d6-4cb8-bee2-2f58b94a0544 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:08.678856 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 559/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:28:08 2022] GET /identity/v3/users/d0a0d41d4e2944a89a171e8489fdda53 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:08.684956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede3f4d-c35d-4e24-83ca-257677e8cb70 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:08.793544 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede3f4d-c35d-4e24-83ca-257677e8cb70 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:08.827889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a5863-7c88-474a-880a-0df8f4d9d8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:08.828532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a5863-7c88-474a-880a-0df8f4d9d8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:08.828788 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a5863-7c88-474a-880a-0df8f4d9d8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:08.829076 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a5863-7c88-474a-880a-0df8f4d9d8f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:08.875923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:08.897740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a5863-7c88-474a-880a-0df8f4d9d8f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:08.899231 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a5863-7c88-474a-880a-0df8f4d9d8f8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:08.999710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 585/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:28:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:28:09.006528 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72ab4a-34d6-4cb8-bee2-2f58b94a0544 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:09.117305 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72ab4a-34d6-4cb8-bee2-2f58b94a0544 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:09.152505 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e5197-2ac7-455f-ad9c-32cc6496eea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:09.153298 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e5197-2ac7-455f-ad9c-32cc6496eea2 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:09.153568 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e5197-2ac7-455f-ad9c-32cc6496eea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:09.153827 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e5197-2ac7-455f-ad9c-32cc6496eea2 None admin] PATH_INFO: `/v3/projects/906a604394a6424abc6d7e2d9c1e7280` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:09.155035 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e5197-2ac7-455f-ad9c-32cc6496eea2 None admin] RBAC: Authorizing `identity:get_project(project_id=906a604394a6424abc6d7e2d9c1e7280)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:09.156460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e5197-2ac7-455f-ad9c-32cc6496eea2 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:09.158114 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 560/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:28:09 2022] GET /identity/v3/projects/906a604394a6424abc6d7e2d9c1e7280 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:09.165264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a5863-7c88-474a-880a-0df8f4d9d8f8 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:09.251938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:09.278962 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a5863-7c88-474a-880a-0df8f4d9d8f8 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:09.311440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb02cef-955c-46f9-b3f6-75fc5c08a154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:09.312080 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb02cef-955c-46f9-b3f6-75fc5c08a154 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:09.312357 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb02cef-955c-46f9-b3f6-75fc5c08a154 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:09.312621 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb02cef-955c-46f9-b3f6-75fc5c08a154 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:09.313440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb02cef-955c-46f9-b3f6-75fc5c08a154 None admin] RBAC: Adding query filter params (role.id=6edd584a77084fa78240661ea76cddb5, scope.project.id=906a604394a6424abc6d7e2d9c1e7280, user.id=d0a0d41d4e2944a89a171e8489fdda53) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:28:09.313743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb02cef-955c-46f9-b3f6-75fc5c08a154 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:09.315213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb02cef-955c-46f9-b3f6-75fc5c08a154 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:09.320608 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 586/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:28:09 2022] GET /identity/v3/role_assignments?user.id=d0a0d41d4e2944a89a171e8489fdda53&scope.project.id=906a604394a6424abc6d7e2d9c1e7280&role.id=6edd584a77084fa78240661ea76cddb5 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:11.560342 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9edfe-acd7-42b9-b914-e210db692ae3 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:11.561253 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9edfe-acd7-42b9-b914-e210db692ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:11.561253 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9edfe-acd7-42b9-b914-e210db692ae3 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:11.563473 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 561/1147] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:28:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:11.569856 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1c3e2-c32a-4cf6-b72a-f7df1dd51a5d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:11.570611 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1c3e2-c32a-4cf6-b72a-f7df1dd51a5d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:11.570736 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1c3e2-c32a-4cf6-b72a-f7df1dd51a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:11.589248 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-01d1c3e2-c32a-4cf6-b72a-f7df1dd51a5d None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:11.590420 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-01d1c3e2-c32a-4cf6-b72a-f7df1dd51a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:11.659105 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 587/1148] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:28:11.682352 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9edfe-acd7-42b9-b914-e210db692ae3 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:11.751033 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:11.811004 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9edfe-acd7-42b9-b914-e210db692ae3 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:11.846519 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f85b9-571d-4677-9b84-9747b96d7d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:11.847347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f85b9-571d-4677-9b84-9747b96d7d40 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:11.847623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f85b9-571d-4677-9b84-9747b96d7d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:11.847891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f85b9-571d-4677-9b84-9747b96d7d40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:11.858974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f85b9-571d-4677-9b84-9747b96d7d40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:28:11.866380 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-418f85b9-571d-4677-9b84-9747b96d7d40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:28:11.866380 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:28:11.866380 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:28:11.866380 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:28:11.866380 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:28:11.866380 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:28:11.866380 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:28:11.866380 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:28:11.866380 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:28:11.866380 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:28:11.866380 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:28:11.866380 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:28:11.866380 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:28:11.866380 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:28:11.866380 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:28:11.866380 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:28:11.867563 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:28:11.867563 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:28:11.867563 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:28:11.867563 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:28:11.867563 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:28:11.867563 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:28:11.867563 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:28:11.867563 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:28:11.867563 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:28:11.867563 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:28:11.867563 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:28:11.867563 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:28:11.867563 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:28:11.867563 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:28:11.867563 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:28:11.867563 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:28:11.871955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:28:11.871955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:28:11.871955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:28:11.871955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:28:11.871955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:28:11.871955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:28:11.871955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:28:11.871955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:28:11.871955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:28:11.871955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:28:11.871955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:28:11.871955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:28:11.871955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 562/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:28:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:28:11.875582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1c3e2-c32a-4cf6-b72a-f7df1dd51a5d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:11.949530 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:11.979807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1c3e2-c32a-4cf6-b72a-f7df1dd51a5d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:12.014587 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9bcfb-98c9-4485-a0b4-7c83d3581d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:12.015270 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9bcfb-98c9-4485-a0b4-7c83d3581d9f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:12.015543 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9bcfb-98c9-4485-a0b4-7c83d3581d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:12.015808 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9bcfb-98c9-4485-a0b4-7c83d3581d9f None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:12.016551 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca9bcfb-98c9-4485-a0b4-7c83d3581d9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:28:12.016850 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca9bcfb-98c9-4485-a0b4-7c83d3581d9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:12.018219 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca9bcfb-98c9-4485-a0b4-7c83d3581d9f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:12.026602 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 588/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:28:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:12.036015 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f85b9-571d-4677-9b84-9747b96d7d40 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:12.160201 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f85b9-571d-4677-9b84-9747b96d7d40 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:12.164784 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:12.200826 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b39a5c-4ea8-4bd7-89d3-3c5548ca0e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:12.201801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b39a5c-4ea8-4bd7-89d3-3c5548ca0e21 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:12.202068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b39a5c-4ea8-4bd7-89d3-3c5548ca0e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:12.202340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b39a5c-4ea8-4bd7-89d3-3c5548ca0e21 None admin] PATH_INFO: `/v3/users/d0a0d41d4e2944a89a171e8489fdda53` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:12.203582 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b39a5c-4ea8-4bd7-89d3-3c5548ca0e21 None admin] RBAC: Authorizing `identity:get_user(user_id=d0a0d41d4e2944a89a171e8489fdda53)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:12.205020 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b39a5c-4ea8-4bd7-89d3-3c5548ca0e21 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:12.206637 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 563/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:28:12 2022] GET /identity/v3/users/d0a0d41d4e2944a89a171e8489fdda53 => generated 286 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:12.215133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9bcfb-98c9-4485-a0b4-7c83d3581d9f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:12.332589 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9bcfb-98c9-4485-a0b4-7c83d3581d9f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:12.367203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c58a65-8792-49ca-b44a-ad34476b3c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:12.368074 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c58a65-8792-49ca-b44a-ad34476b3c0e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:12.368349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c58a65-8792-49ca-b44a-ad34476b3c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:12.368621 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c58a65-8792-49ca-b44a-ad34476b3c0e None admin] PATH_INFO: `/v3/projects/906a604394a6424abc6d7e2d9c1e7280` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:12.369935 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c58a65-8792-49ca-b44a-ad34476b3c0e None admin] RBAC: Authorizing `identity:get_project(project_id=906a604394a6424abc6d7e2d9c1e7280)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:12.371396 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c58a65-8792-49ca-b44a-ad34476b3c0e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:12.373070 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 589/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:28:12 2022] GET /identity/v3/projects/906a604394a6424abc6d7e2d9c1e7280 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:12.382647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b39a5c-4ea8-4bd7-89d3-3c5548ca0e21 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:12.505103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b39a5c-4ea8-4bd7-89d3-3c5548ca0e21 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:12.545564 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3445d-4b1c-42f5-800c-9b840c5f24dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:12.546455 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3445d-4b1c-42f5-800c-9b840c5f24dc None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:12.546764 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3445d-4b1c-42f5-800c-9b840c5f24dc None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:12.547035 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3445d-4b1c-42f5-800c-9b840c5f24dc None admin] PATH_INFO: `/v3/projects/906a604394a6424abc6d7e2d9c1e7280/users/d0a0d41d4e2944a89a171e8489fdda53/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:12.549206 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a3445d-4b1c-42f5-800c-9b840c5f24dc None admin] RBAC: Authorizing `identity:create_grant(project_id=906a604394a6424abc6d7e2d9c1e7280, user_id=d0a0d41d4e2944a89a171e8489fdda53, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:12.550644 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a3445d-4b1c-42f5-800c-9b840c5f24dc None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:12.570518 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 564/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 13:28:12 2022] PUT /identity/v3/projects/906a604394a6424abc6d7e2d9c1e7280/users/d0a0d41d4e2944a89a171e8489fdda53/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:28:14.881752 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd775303-3f2f-4447-949a-144346680373 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:14.882851 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd775303-3f2f-4447-949a-144346680373 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:14.882851 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd775303-3f2f-4447-949a-144346680373 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:14.884858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 590/1154] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:28:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:14.892896 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb6814-2726-4f01-b374-2235a592ccb5 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:14.893362 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb6814-2726-4f01-b374-2235a592ccb5 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:14.893471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb6814-2726-4f01-b374-2235a592ccb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:14.911435 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-c2cb6814-2726-4f01-b374-2235a592ccb5 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:14.912602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c2cb6814-2726-4f01-b374-2235a592ccb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:14.938992 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:14.990368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 565/1155] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:28:15.014412 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd775303-3f2f-4447-949a-144346680373 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:15.017749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:15.122209 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd775303-3f2f-4447-949a-144346680373 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:15.156662 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55fbf8-72c5-42a5-8121-546ea9ea8872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:15.157386 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55fbf8-72c5-42a5-8121-546ea9ea8872 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:15.157666 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55fbf8-72c5-42a5-8121-546ea9ea8872 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:15.157936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55fbf8-72c5-42a5-8121-546ea9ea8872 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:15.170125 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55fbf8-72c5-42a5-8121-546ea9ea8872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:28:15.177715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-8d55fbf8-72c5-42a5-8121-546ea9ea8872 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:28:15.177715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:28:15.177715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:28:15.177715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:28:15.177715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:28:15.177715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:28:15.177715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:28:15.177715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:28:15.177715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:28:15.177715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:28:15.177715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:28:15.177715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:28:15.177715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:28:15.177715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:28:15.177715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:28:15.177715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:28:15.178886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:28:15.178886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:28:15.178886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:28:15.178886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:28:15.178886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:28:15.178886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:28:15.178886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:28:15.178886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:28:15.178886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:28:15.178886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:28:15.178886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:28:15.178886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:28:15.178886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:28:15.178886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:28:15.178886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:28:15.178886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:28:15.179825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:28:15.179825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:28:15.179825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:28:15.179825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:28:15.179825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:28:15.179825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:28:15.179825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:28:15.179825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:28:15.179825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:28:15.179825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:28:15.179825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:28:15.179825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:28:15.179825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 591/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:28:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:28:15.185490 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb6814-2726-4f01-b374-2235a592ccb5 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:15.287829 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb6814-2726-4f01-b374-2235a592ccb5 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:15.323092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7defea-f042-4ec9-b53b-66bcce1340c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:15.323755 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7defea-f042-4ec9-b53b-66bcce1340c2 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:15.324032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7defea-f042-4ec9-b53b-66bcce1340c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:15.324270 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7defea-f042-4ec9-b53b-66bcce1340c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:15.325023 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7defea-f042-4ec9-b53b-66bcce1340c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:28:15.325322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7defea-f042-4ec9-b53b-66bcce1340c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:15.326709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7defea-f042-4ec9-b53b-66bcce1340c2 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:15.335008 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 566/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:28:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:15.341270 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55fbf8-72c5-42a5-8121-546ea9ea8872 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:15.408398 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:15.451409 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55fbf8-72c5-42a5-8121-546ea9ea8872 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:15.485034 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5e7e6-1d19-430f-b11a-211bb9f11fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:15.485891 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5e7e6-1d19-430f-b11a-211bb9f11fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:15.486164 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5e7e6-1d19-430f-b11a-211bb9f11fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:15.486431 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5e7e6-1d19-430f-b11a-211bb9f11fd2 None admin] PATH_INFO: `/v3/users/d0a0d41d4e2944a89a171e8489fdda53` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:15.487743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5e7e6-1d19-430f-b11a-211bb9f11fd2 None admin] RBAC: Authorizing `identity:get_user(user_id=d0a0d41d4e2944a89a171e8489fdda53)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:15.489172 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5e7e6-1d19-430f-b11a-211bb9f11fd2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:15.490786 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 592/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:28:15 2022] GET /identity/v3/users/d0a0d41d4e2944a89a171e8489fdda53 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:15.497250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7defea-f042-4ec9-b53b-66bcce1340c2 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:15.524595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:15.607267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7defea-f042-4ec9-b53b-66bcce1340c2 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:15.641820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b6f4e-899e-412f-8467-8a3b23d03589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:15.642478 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b6f4e-899e-412f-8467-8a3b23d03589 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:15.642783 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b6f4e-899e-412f-8467-8a3b23d03589 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:15.643076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b6f4e-899e-412f-8467-8a3b23d03589 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:15.714938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b6f4e-899e-412f-8467-8a3b23d03589 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:15.716372 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b6f4e-899e-412f-8467-8a3b23d03589 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:15.740948 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:15.829719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 567/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:28:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:28:15.836928 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5e7e6-1d19-430f-b11a-211bb9f11fd2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:15.950051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5e7e6-1d19-430f-b11a-211bb9f11fd2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:15.981464 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:15.988252 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45aa2d-d549-4a1e-96c0-9376c3c506fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:15.989124 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45aa2d-d549-4a1e-96c0-9376c3c506fb None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:15.989399 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45aa2d-d549-4a1e-96c0-9376c3c506fb None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:15.989666 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45aa2d-d549-4a1e-96c0-9376c3c506fb None admin] PATH_INFO: `/v3/projects/906a604394a6424abc6d7e2d9c1e7280` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:15.990935 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45aa2d-d549-4a1e-96c0-9376c3c506fb None admin] RBAC: Authorizing `identity:get_project(project_id=906a604394a6424abc6d7e2d9c1e7280)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:15.992362 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45aa2d-d549-4a1e-96c0-9376c3c506fb None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:15.994078 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 593/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:28:15 2022] GET /identity/v3/projects/906a604394a6424abc6d7e2d9c1e7280 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:16.000556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b6f4e-899e-412f-8467-8a3b23d03589 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:16.128804 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b6f4e-899e-412f-8467-8a3b23d03589 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:16.156345 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:16.169655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4befe-f6f9-4498-ac70-ca2baf2125f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:16.170319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4befe-f6f9-4498-ac70-ca2baf2125f7 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:16.170624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4befe-f6f9-4498-ac70-ca2baf2125f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:16.170921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4befe-f6f9-4498-ac70-ca2baf2125f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:16.171746 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4befe-f6f9-4498-ac70-ca2baf2125f7 None admin] RBAC: Adding query filter params (role.id=6edd584a77084fa78240661ea76cddb5, scope.project.id=906a604394a6424abc6d7e2d9c1e7280, user.id=d0a0d41d4e2944a89a171e8489fdda53) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:28:16.172054 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4befe-f6f9-4498-ac70-ca2baf2125f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:16.173481 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4befe-f6f9-4498-ac70-ca2baf2125f7 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:16.179423 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 568/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:28:15 2022] GET /identity/v3/role_assignments?user.id=d0a0d41d4e2944a89a171e8489fdda53&scope.project.id=906a604394a6424abc6d7e2d9c1e7280&role.id=6edd584a77084fa78240661ea76cddb5 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:18.450342 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a133e5c-fdd3-48d6-97f1-f089745d709f None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:18.450989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a133e5c-fdd3-48d6-97f1-f089745d709f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:18.450989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a133e5c-fdd3-48d6-97f1-f089745d709f None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:18.452292 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 594/1162] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:18.457780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582dbb3-f020-4f8d-aa69-f7bad7cadfe4 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:18.458212 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582dbb3-f020-4f8d-aa69-f7bad7cadfe4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:18.458303 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582dbb3-f020-4f8d-aa69-f7bad7cadfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:18.478065 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-1582dbb3-f020-4f8d-aa69-f7bad7cadfe4 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:18.479464 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1582dbb3-f020-4f8d-aa69-f7bad7cadfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:18.556092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 569/1163] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:28:18.579291 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a133e5c-fdd3-48d6-97f1-f089745d709f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:18.693237 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a133e5c-fdd3-48d6-97f1-f089745d709f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:18.737385 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b89658-f936-4712-b135-9fb97252a0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:18.737975 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b89658-f936-4712-b135-9fb97252a0dc None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:18.738239 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b89658-f936-4712-b135-9fb97252a0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:18.738506 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b89658-f936-4712-b135-9fb97252a0dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:18.803326 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:18.808710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b89658-f936-4712-b135-9fb97252a0dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:18.811291 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b89658-f936-4712-b135-9fb97252a0dc None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:18.924352 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 595/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:28:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:28:18.931659 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582dbb3-f020-4f8d-aa69-f7bad7cadfe4 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:19.044975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582dbb3-f020-4f8d-aa69-f7bad7cadfe4 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:19.061770 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:19.081520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b4d47-fc36-4257-86ba-7bb542f47697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:19.082336 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b4d47-fc36-4257-86ba-7bb542f47697 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:19.082598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b4d47-fc36-4257-86ba-7bb542f47697 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:19.082912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b4d47-fc36-4257-86ba-7bb542f47697 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:19.090320 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b4d47-fc36-4257-86ba-7bb542f47697 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:19.091793 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b4d47-fc36-4257-86ba-7bb542f47697 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:19.106741 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-915b4d47-fc36-4257-86ba-7bb542f47697 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 02 13:28:19.106741 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:28:19.106741 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 02 13:28:19.106741 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 02 13:28:19.106741 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:28:19.106741 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:28:19.106741 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:28:19.106741 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:28:19.106741 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 02 13:28:19.106741 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:28:19.106741 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:28:19.106741 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:28:19.106741 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:28:19.106741 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:28:19.106741 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:28:19.106741 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:28:19.106741 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:28:19.107949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:28:19.107949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:28:19.107949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:28:19.107949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:28:19.107949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:28:19.107949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:28:19.107949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:28:19.107949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:28:19.107949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:28:19.107949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:28:19.107949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:28:19.107949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:28:19.107949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:28:19.107949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:28:19.107949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:28:19.107949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:28:19.108974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:28:19.108974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:28:19.108974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:28:19.108974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:28:19.108974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:28:19.108974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:28:19.108974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:28:19.108974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:28:19.108974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:28:19.108974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:28:19.108974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 02 13:28:19.108974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:28:19.108974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 02 13:28:19.108974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:28:19.108974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 570/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 2 13:28:18 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:28:19.114229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b89658-f936-4712-b135-9fb97252a0dc None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:19.211330 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:19.215732 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b89658-f936-4712-b135-9fb97252a0dc None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:19.261153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7dc555-fe74-4588-9fcd-af1320c936de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:19.261814 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7dc555-fe74-4588-9fcd-af1320c936de None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:19.262090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7dc555-fe74-4588-9fcd-af1320c936de None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:19.262361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7dc555-fe74-4588-9fcd-af1320c936de None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:19.263112 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7dc555-fe74-4588-9fcd-af1320c936de None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:28:19.263409 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7dc555-fe74-4588-9fcd-af1320c936de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:19.264774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7dc555-fe74-4588-9fcd-af1320c936de None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:19.272339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 596/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jun 2 13:28:19 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:21.513224 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16687c-e346-4c71-a382-259387177dd1 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:21.514129 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16687c-e346-4c71-a382-259387177dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:21.514129 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16687c-e346-4c71-a382-259387177dd1 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:21.516272 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 571/1167] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:28:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:21.524303 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709582ea-1418-4dfd-beba-cf3c582f5853 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:21.525145 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709582ea-1418-4dfd-beba-cf3c582f5853 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:21.525252 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709582ea-1418-4dfd-beba-cf3c582f5853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:21.544379 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-709582ea-1418-4dfd-beba-cf3c582f5853 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:21.545549 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-709582ea-1418-4dfd-beba-cf3c582f5853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:21.616538 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 597/1168] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:28:21.640911 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16687c-e346-4c71-a382-259387177dd1 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:21.765691 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16687c-e346-4c71-a382-259387177dd1 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:21.804035 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bdfd2-220f-4abd-b31c-b2975834f61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:21.804683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bdfd2-220f-4abd-b31c-b2975834f61b None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:21.804962 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bdfd2-220f-4abd-b31c-b2975834f61b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:21.805228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bdfd2-220f-4abd-b31c-b2975834f61b None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:21.805950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837bdfd2-220f-4abd-b31c-b2975834f61b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:21.807385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837bdfd2-220f-4abd-b31c-b2975834f61b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:21.825292 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 572/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Thu Jun 2 13:28:21 2022] POST /identity/v3/domains => generated 267 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:28:24.098187 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2795db-f2c6-4aa5-b109-0e311c43e70b None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:24.099143 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2795db-f2c6-4aa5-b109-0e311c43e70b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:24.099143 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2795db-f2c6-4aa5-b109-0e311c43e70b None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:24.101390 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 598/1170] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:28:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:24.107257 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc1232-c7f2-417c-88cd-69e08c04c48f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:24.107715 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc1232-c7f2-417c-88cd-69e08c04c48f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:24.107808 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc1232-c7f2-417c-88cd-69e08c04c48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:24.126443 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-2abc1232-c7f2-417c-88cd-69e08c04c48f None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:24.127735 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2abc1232-c7f2-417c-88cd-69e08c04c48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:24.158311 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:24.200212 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 573/1171] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:28:24.224899 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2795db-f2c6-4aa5-b109-0e311c43e70b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:24.336289 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:24.348419 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2795db-f2c6-4aa5-b109-0e311c43e70b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:24.383073 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad83afe-6b2f-4519-be08-36e696b253a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:24.383931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad83afe-6b2f-4519-be08-36e696b253a4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:24.384203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad83afe-6b2f-4519-be08-36e696b253a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:24.384561 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad83afe-6b2f-4519-be08-36e696b253a4 None admin] PATH_INFO: `/v3/domains/362bd7b5b5d84c31925b539a7d9b549a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:24.395478 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad83afe-6b2f-4519-be08-36e696b253a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=362bd7b5b5d84c31925b539a7d9b549a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:24.396930 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad83afe-6b2f-4519-be08-36e696b253a4 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:24.398521 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 599/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Thu Jun 2 13:28:24 2022] GET /identity/v3/domains/362bd7b5b5d84c31925b539a7d9b549a => generated 267 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:24.408213 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc1232-c7f2-417c-88cd-69e08c04c48f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:24.509461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc1232-c7f2-417c-88cd-69e08c04c48f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:24.548118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53c278-97fe-4e89-bc9e-64aadc8b1454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:24.548765 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53c278-97fe-4e89-bc9e-64aadc8b1454 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:24.549048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53c278-97fe-4e89-bc9e-64aadc8b1454 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:24.549282 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53c278-97fe-4e89-bc9e-64aadc8b1454 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:24.549998 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53c278-97fe-4e89-bc9e-64aadc8b1454 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:24.551439 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53c278-97fe-4e89-bc9e-64aadc8b1454 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:24.578837 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 574/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 13:28:24 2022] POST /identity/v3/projects => generated 361 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:28:26.867358 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de2090-126b-4780-86c5-adb00dae3d7a None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:26.868243 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de2090-126b-4780-86c5-adb00dae3d7a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:26.868243 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de2090-126b-4780-86c5-adb00dae3d7a None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:26.870023 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 600/1174] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:28:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:26.875612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082725ee-73c1-4e2a-bece-14b47bfde0fc None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:26.876047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082725ee-73c1-4e2a-bece-14b47bfde0fc None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:26.876138 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082725ee-73c1-4e2a-bece-14b47bfde0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:26.894561 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-082725ee-73c1-4e2a-bece-14b47bfde0fc None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:26.895689 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-082725ee-73c1-4e2a-bece-14b47bfde0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:26.910625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:26.967442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 575/1175] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:28:26.993193 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de2090-126b-4780-86c5-adb00dae3d7a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:27.113371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de2090-126b-4780-86c5-adb00dae3d7a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:27.152131 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542cffc-1a1f-4378-80e9-26dfd8c94e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:27.152916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542cffc-1a1f-4378-80e9-26dfd8c94e78 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:27.153190 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542cffc-1a1f-4378-80e9-26dfd8c94e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:27.153460 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542cffc-1a1f-4378-80e9-26dfd8c94e78 None admin] PATH_INFO: `/v3/domains/362bd7b5b5d84c31925b539a7d9b549a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:27.154778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542cffc-1a1f-4378-80e9-26dfd8c94e78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=362bd7b5b5d84c31925b539a7d9b549a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:27.156194 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542cffc-1a1f-4378-80e9-26dfd8c94e78 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:27.157797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 601/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Thu Jun 2 13:28:26 2022] GET /identity/v3/domains/362bd7b5b5d84c31925b539a7d9b549a => generated 267 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:27.164050 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082725ee-73c1-4e2a-bece-14b47bfde0fc None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:27.279047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082725ee-73c1-4e2a-bece-14b47bfde0fc None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:27.318812 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277a2d9-a80a-477f-b30a-50b3283573b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:27.319477 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277a2d9-a80a-477f-b30a-50b3283573b3 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:27.319754 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277a2d9-a80a-477f-b30a-50b3283573b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:27.320034 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277a2d9-a80a-477f-b30a-50b3283573b3 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:27.320733 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277a2d9-a80a-477f-b30a-50b3283573b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:27.322226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277a2d9-a80a-477f-b30a-50b3283573b3 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:27.347943 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 576/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 13:28:27 2022] POST /identity/v3/users => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:28:29.651028 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab70405-4a09-4836-a0fd-63e100700365 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:29.651539 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab70405-4a09-4836-a0fd-63e100700365 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:29.651824 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab70405-4a09-4836-a0fd-63e100700365 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:29.653795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 602/1178] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:28:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:29.659884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc04ed-820e-4a70-ba2d-d131d4cc5b50 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:29.660610 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc04ed-820e-4a70-ba2d-d131d4cc5b50 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:29.660740 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc04ed-820e-4a70-ba2d-d131d4cc5b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:29.675702 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:29.681896 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-19bc04ed-820e-4a70-ba2d-d131d4cc5b50 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:29.683842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-19bc04ed-820e-4a70-ba2d-d131d4cc5b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:29.761666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 577/1179] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:28:29.786612 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab70405-4a09-4836-a0fd-63e100700365 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:29.811611 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:29.906828 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab70405-4a09-4836-a0fd-63e100700365 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:29.944665 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a5d1c-300f-4a77-bba4-b2606492b93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:29.945463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a5d1c-300f-4a77-bba4-b2606492b93c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:29.945741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a5d1c-300f-4a77-bba4-b2606492b93c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:29.946007 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a5d1c-300f-4a77-bba4-b2606492b93c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:29.969540 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a5d1c-300f-4a77-bba4-b2606492b93c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:28:29.977224 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-005a5d1c-300f-4a77-bba4-b2606492b93c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:28:29.977224 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:28:29.977224 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:28:29.977224 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:28:29.977224 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:28:29.977224 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:28:29.977224 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:28:29.977224 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:28:29.977224 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:28:29.977224 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:28:29.977224 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:28:29.977224 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:28:29.977224 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:28:29.977224 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:28:29.977224 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:28:29.977224 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:28:29.978700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:28:29.978700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:28:29.978700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:28:29.978700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:28:29.978700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:28:29.978700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:28:29.978700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:28:29.978700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:28:29.978700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:28:29.978700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:28:29.978700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:28:29.978700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:28:29.978700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:28:29.978700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:28:29.978700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:28:29.978700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:28:29.979574 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:28:29.979574 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:28:29.979574 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:28:29.979574 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:28:29.979574 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:28:29.979574 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:28:29.979574 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:28:29.979574 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:28:29.979574 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:28:29.979574 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:28:29.979574 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:28:29.979574 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:28:29.979574 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 603/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:28:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:28:29.991213 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc04ed-820e-4a70-ba2d-d131d4cc5b50 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:30.119135 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc04ed-820e-4a70-ba2d-d131d4cc5b50 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:30.154521 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e33881-2808-4490-8e52-1f3b407168b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:30.155226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e33881-2808-4490-8e52-1f3b407168b8 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:30.155497 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e33881-2808-4490-8e52-1f3b407168b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:30.155767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e33881-2808-4490-8e52-1f3b407168b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:30.156503 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e33881-2808-4490-8e52-1f3b407168b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:28:30.156806 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e33881-2808-4490-8e52-1f3b407168b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:30.158235 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e33881-2808-4490-8e52-1f3b407168b8 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:30.160523 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:30.167055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 578/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:28:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:30.173318 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a5d1c-300f-4a77-bba4-b2606492b93c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:30.264465 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:30.287213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a5d1c-300f-4a77-bba4-b2606492b93c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:30.322273 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21ffb1-57ad-4f9a-b801-a871f9352579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:30.323248 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21ffb1-57ad-4f9a-b801-a871f9352579 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:30.323524 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21ffb1-57ad-4f9a-b801-a871f9352579 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:30.323891 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21ffb1-57ad-4f9a-b801-a871f9352579 None admin] PATH_INFO: `/v3/users/b0b7fa80e3df4eb49cc180e88b26ec1e` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:30.342732 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21ffb1-57ad-4f9a-b801-a871f9352579 None admin] RBAC: Authorizing `identity:get_user(user_id=b0b7fa80e3df4eb49cc180e88b26ec1e)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:30.345345 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21ffb1-57ad-4f9a-b801-a871f9352579 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:30.348382 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 604/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:28:30 2022] GET /identity/v3/users/b0b7fa80e3df4eb49cc180e88b26ec1e => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:30.354758 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e33881-2808-4490-8e52-1f3b407168b8 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:30.598840 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e33881-2808-4490-8e52-1f3b407168b8 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:30.639930 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484448fc-64a8-4c61-adf1-e422c15b4f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:30.640918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484448fc-64a8-4c61-adf1-e422c15b4f9d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:30.641377 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484448fc-64a8-4c61-adf1-e422c15b4f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:30.641827 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484448fc-64a8-4c61-adf1-e422c15b4f9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:30.711327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:30.715024 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484448fc-64a8-4c61-adf1-e422c15b4f9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:30.716914 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484448fc-64a8-4c61-adf1-e422c15b4f9d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:30.818547 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 579/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:28:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:28:30.824733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21ffb1-57ad-4f9a-b801-a871f9352579 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:30.930848 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21ffb1-57ad-4f9a-b801-a871f9352579 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:30.967390 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7dc1e0-a85a-4987-b402-32d9c983992f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:30.968325 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dc1e0-a85a-4987-b402-32d9c983992f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:30.968594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dc1e0-a85a-4987-b402-32d9c983992f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:30.968858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dc1e0-a85a-4987-b402-32d9c983992f None admin] PATH_INFO: `/v3/projects/a9c77456393046489b2b4b0dbb08ed0e` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:30.970141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7dc1e0-a85a-4987-b402-32d9c983992f None admin] RBAC: Authorizing `identity:get_project(project_id=a9c77456393046489b2b4b0dbb08ed0e)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:30.971602 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7dc1e0-a85a-4987-b402-32d9c983992f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:30.973257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 605/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:28:30 2022] GET /identity/v3/projects/a9c77456393046489b2b4b0dbb08ed0e => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:30.981416 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484448fc-64a8-4c61-adf1-e422c15b4f9d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:31.094591 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:31.098510 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484448fc-64a8-4c61-adf1-e422c15b4f9d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:31.138691 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bb7ff-150f-464c-b98b-5761a73dd484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:31.139354 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bb7ff-150f-464c-b98b-5761a73dd484 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:31.139637 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bb7ff-150f-464c-b98b-5761a73dd484 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:31.139909 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bb7ff-150f-464c-b98b-5761a73dd484 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:31.140743 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815bb7ff-150f-464c-b98b-5761a73dd484 None admin] RBAC: Adding query filter params (role.id=6edd584a77084fa78240661ea76cddb5, scope.project.id=a9c77456393046489b2b4b0dbb08ed0e, user.id=b0b7fa80e3df4eb49cc180e88b26ec1e) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:28:31.141044 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815bb7ff-150f-464c-b98b-5761a73dd484 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:31.142461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815bb7ff-150f-464c-b98b-5761a73dd484 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:31.148540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 580/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:28:30 2022] GET /identity/v3/role_assignments?user.id=b0b7fa80e3df4eb49cc180e88b26ec1e&scope.project.id=a9c77456393046489b2b4b0dbb08ed0e&role.id=6edd584a77084fa78240661ea76cddb5 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:33.382460 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e3467-7ac1-4069-9625-3d21006abdbe None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:33.383072 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e3467-7ac1-4069-9625-3d21006abdbe None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:33.383072 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e3467-7ac1-4069-9625-3d21006abdbe None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:33.384435 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 606/1186] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:33.390883 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623252c-3bc4-4eb1-8601-2f609c334c5e None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:33.391648 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623252c-3bc4-4eb1-8601-2f609c334c5e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:33.391804 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623252c-3bc4-4eb1-8601-2f609c334c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:33.419091 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-0623252c-3bc4-4eb1-8601-2f609c334c5e None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:33.420274 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0623252c-3bc4-4eb1-8601-2f609c334c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:33.499574 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 581/1187] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:28:33.523693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e3467-7ac1-4069-9625-3d21006abdbe None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:33.534312 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:33.635421 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e3467-7ac1-4069-9625-3d21006abdbe None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:33.673557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f35f4-3356-4c5e-a092-072912f032cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:33.674356 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f35f4-3356-4c5e-a092-072912f032cc None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:33.674667 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f35f4-3356-4c5e-a092-072912f032cc None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:33.674921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f35f4-3356-4c5e-a092-072912f032cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:33.685836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f35f4-3356-4c5e-a092-072912f032cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:28:33.693281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-818f35f4-3356-4c5e-a092-072912f032cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:28:33.693281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:28:33.693281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:28:33.693281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:28:33.693281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:28:33.693281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:28:33.693281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:28:33.693281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:28:33.693281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:28:33.693281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:28:33.693281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:28:33.693281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:28:33.693281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:28:33.693281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:28:33.693281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:28:33.693281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:28:33.694361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:28:33.694361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:28:33.694361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:28:33.694361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:28:33.694361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:28:33.694361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:28:33.694361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:28:33.694361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:28:33.694361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:28:33.694361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:28:33.694361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:28:33.694361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:28:33.694361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:28:33.694361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:28:33.694361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:28:33.694361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:28:33.695490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:28:33.695490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:28:33.695490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:28:33.695490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:28:33.695490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:28:33.695490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:28:33.695490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:28:33.695490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:28:33.695490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:28:33.695490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:28:33.695490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:28:33.695490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:28:33.695490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 607/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:28:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:28:33.700868 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623252c-3bc4-4eb1-8601-2f609c334c5e None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:33.806502 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:33.817554 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623252c-3bc4-4eb1-8601-2f609c334c5e None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:33.854843 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b52673-71fe-466b-a11a-a686467cdda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:33.855510 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b52673-71fe-466b-a11a-a686467cdda9 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:33.855781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b52673-71fe-466b-a11a-a686467cdda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:33.856045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b52673-71fe-466b-a11a-a686467cdda9 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:33.856779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b52673-71fe-466b-a11a-a686467cdda9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:28:33.857077 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b52673-71fe-466b-a11a-a686467cdda9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:33.858467 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b52673-71fe-466b-a11a-a686467cdda9 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:33.867211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 582/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:28:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:33.875057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f35f4-3356-4c5e-a092-072912f032cc None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:33.944711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:33.984084 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f35f4-3356-4c5e-a092-072912f032cc None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:34.018920 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897be5e-3c19-4d22-803e-f09240fc0a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:34.019792 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897be5e-3c19-4d22-803e-f09240fc0a92 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:34.020068 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897be5e-3c19-4d22-803e-f09240fc0a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:34.020321 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897be5e-3c19-4d22-803e-f09240fc0a92 None admin] PATH_INFO: `/v3/users/b0b7fa80e3df4eb49cc180e88b26ec1e` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:34.021527 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897be5e-3c19-4d22-803e-f09240fc0a92 None admin] RBAC: Authorizing `identity:get_user(user_id=b0b7fa80e3df4eb49cc180e88b26ec1e)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:34.022993 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897be5e-3c19-4d22-803e-f09240fc0a92 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:34.025021 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 608/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:28:33 2022] GET /identity/v3/users/b0b7fa80e3df4eb49cc180e88b26ec1e => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:34.032047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b52673-71fe-466b-a11a-a686467cdda9 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:34.140823 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b52673-71fe-466b-a11a-a686467cdda9 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:34.181633 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee4875-2a96-4823-af5e-5aa56c53a30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:34.182500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee4875-2a96-4823-af5e-5aa56c53a30f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:34.182812 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee4875-2a96-4823-af5e-5aa56c53a30f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:34.183081 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee4875-2a96-4823-af5e-5aa56c53a30f None admin] PATH_INFO: `/v3/projects/a9c77456393046489b2b4b0dbb08ed0e` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:34.184302 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee4875-2a96-4823-af5e-5aa56c53a30f None admin] RBAC: Authorizing `identity:get_project(project_id=a9c77456393046489b2b4b0dbb08ed0e)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:34.185731 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee4875-2a96-4823-af5e-5aa56c53a30f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:34.187509 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 583/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:28:34 2022] GET /identity/v3/projects/a9c77456393046489b2b4b0dbb08ed0e => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:34.194050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897be5e-3c19-4d22-803e-f09240fc0a92 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:34.314393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897be5e-3c19-4d22-803e-f09240fc0a92 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:34.352100 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f3b1a-7420-40d3-9865-acb266cf1575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:34.353088 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f3b1a-7420-40d3-9865-acb266cf1575 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:34.353372 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f3b1a-7420-40d3-9865-acb266cf1575 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:34.353663 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f3b1a-7420-40d3-9865-acb266cf1575 None admin] PATH_INFO: `/v3/projects/a9c77456393046489b2b4b0dbb08ed0e/users/b0b7fa80e3df4eb49cc180e88b26ec1e/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:34.355666 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f3b1a-7420-40d3-9865-acb266cf1575 None admin] RBAC: Authorizing `identity:create_grant(project_id=a9c77456393046489b2b4b0dbb08ed0e, user_id=b0b7fa80e3df4eb49cc180e88b26ec1e, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:34.357107 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f3b1a-7420-40d3-9865-acb266cf1575 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:34.359517 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:34.372031 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 609/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 13:28:34 2022] PUT /identity/v3/projects/a9c77456393046489b2b4b0dbb08ed0e/users/b0b7fa80e3df4eb49cc180e88b26ec1e/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:28:36.588324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bd5e2-65cb-4909-88a2-23bd8843040a None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:36.589195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bd5e2-65cb-4909-88a2-23bd8843040a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:36.589195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bd5e2-65cb-4909-88a2-23bd8843040a None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:36.591410 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 584/1193] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:28:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:36.596869 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc699ecc-a1c3-4b2e-a62b-cfba803b8dc4 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:36.597287 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc699ecc-a1c3-4b2e-a62b-cfba803b8dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:36.597403 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc699ecc-a1c3-4b2e-a62b-cfba803b8dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:36.616179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-cc699ecc-a1c3-4b2e-a62b-cfba803b8dc4 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:36.617348 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cc699ecc-a1c3-4b2e-a62b-cfba803b8dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:36.695279 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 610/1194] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:28:36.726244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52bd5e2-65cb-4909-88a2-23bd8843040a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:36.753749 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:36.842422 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52bd5e2-65cb-4909-88a2-23bd8843040a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:36.878803 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a5bd9-8f3a-42a8-8815-18cb107f27c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:36.879594 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a5bd9-8f3a-42a8-8815-18cb107f27c2 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:36.879868 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a5bd9-8f3a-42a8-8815-18cb107f27c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:36.880142 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a5bd9-8f3a-42a8-8815-18cb107f27c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:36.890769 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a5bd9-8f3a-42a8-8815-18cb107f27c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:28:36.898263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-f50a5bd9-8f3a-42a8-8815-18cb107f27c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:28:36.898263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:28:36.898263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:28:36.898263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:28:36.898263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:28:36.898263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:28:36.898263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:28:36.898263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:28:36.898263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:28:36.898263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:28:36.898263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:28:36.898263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:28:36.898263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:28:36.898263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:28:36.898263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:28:36.898263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:28:36.899904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:28:36.899904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:28:36.899904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:28:36.899904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:28:36.899904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:28:36.899904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:28:36.899904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:28:36.899904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:28:36.899904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:28:36.899904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:28:36.899904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:28:36.899904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:28:36.899904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:28:36.899904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:28:36.899904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:28:36.899904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:28:36.900865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:28:36.900865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:28:36.900865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:28:36.900865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:28:36.900865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:28:36.900865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:28:36.900865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:28:36.900865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:28:36.900865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:28:36.900865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:28:36.900865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:28:36.900865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:28:36.900865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 585/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:28:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:28:36.908038 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc699ecc-a1c3-4b2e-a62b-cfba803b8dc4 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:37.012468 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc699ecc-a1c3-4b2e-a62b-cfba803b8dc4 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:37.037896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:37.057194 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20124eb7-45a3-4b9d-852e-a3392d28ca34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:37.058222 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20124eb7-45a3-4b9d-852e-a3392d28ca34 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:37.058700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20124eb7-45a3-4b9d-852e-a3392d28ca34 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:37.059148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20124eb7-45a3-4b9d-852e-a3392d28ca34 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:37.060355 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20124eb7-45a3-4b9d-852e-a3392d28ca34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:28:37.060838 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20124eb7-45a3-4b9d-852e-a3392d28ca34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:37.063072 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20124eb7-45a3-4b9d-852e-a3392d28ca34 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:37.075190 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 611/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:28:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:37.081189 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a5bd9-8f3a-42a8-8815-18cb107f27c2 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:37.166917 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:37.185479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a5bd9-8f3a-42a8-8815-18cb107f27c2 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:37.218797 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971012ea-60e8-488f-b83f-ad6a7a7e3ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:37.219666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971012ea-60e8-488f-b83f-ad6a7a7e3ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:37.219947 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971012ea-60e8-488f-b83f-ad6a7a7e3ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:37.220220 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971012ea-60e8-488f-b83f-ad6a7a7e3ad5 None admin] PATH_INFO: `/v3/users/b0b7fa80e3df4eb49cc180e88b26ec1e` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:37.221517 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971012ea-60e8-488f-b83f-ad6a7a7e3ad5 None admin] RBAC: Authorizing `identity:get_user(user_id=b0b7fa80e3df4eb49cc180e88b26ec1e)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:37.222969 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971012ea-60e8-488f-b83f-ad6a7a7e3ad5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:37.224556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 586/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 13:28:37 2022] GET /identity/v3/users/b0b7fa80e3df4eb49cc180e88b26ec1e => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:37.230788 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20124eb7-45a3-4b9d-852e-a3392d28ca34 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:37.340837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20124eb7-45a3-4b9d-852e-a3392d28ca34 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:37.380419 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4c6ba-a4e8-4cfc-8b4d-8856f1f96f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:37.381063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4c6ba-a4e8-4cfc-8b4d-8856f1f96f1d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:37.381342 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4c6ba-a4e8-4cfc-8b4d-8856f1f96f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:37.381614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4c6ba-a4e8-4cfc-8b4d-8856f1f96f1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:37.440199 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:37.463021 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4c6ba-a4e8-4cfc-8b4d-8856f1f96f1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:37.464500 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4c6ba-a4e8-4cfc-8b4d-8856f1f96f1d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:37.572225 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 612/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:28:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:28:37.578414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971012ea-60e8-488f-b83f-ad6a7a7e3ad5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:37.687525 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971012ea-60e8-488f-b83f-ad6a7a7e3ad5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:37.721848 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6868c-21a0-4743-bbb3-294aabf8793a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:37.722677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6868c-21a0-4743-bbb3-294aabf8793a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:37.722942 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6868c-21a0-4743-bbb3-294aabf8793a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:37.723210 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6868c-21a0-4743-bbb3-294aabf8793a None admin] PATH_INFO: `/v3/projects/a9c77456393046489b2b4b0dbb08ed0e` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:37.724492 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6868c-21a0-4743-bbb3-294aabf8793a None admin] RBAC: Authorizing `identity:get_project(project_id=a9c77456393046489b2b4b0dbb08ed0e)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:37.725914 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6868c-21a0-4743-bbb3-294aabf8793a None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:37.727674 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 587/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 13:28:37 2022] GET /identity/v3/projects/a9c77456393046489b2b4b0dbb08ed0e => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:37.734966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4c6ba-a4e8-4cfc-8b4d-8856f1f96f1d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:37.828364 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:37.846028 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4c6ba-a4e8-4cfc-8b4d-8856f1f96f1d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:37.880652 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b19ff-46e6-46ac-8b3a-4f9d970eaac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:37.881304 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b19ff-46e6-46ac-8b3a-4f9d970eaac0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:37.881583 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b19ff-46e6-46ac-8b3a-4f9d970eaac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:37.881859 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b19ff-46e6-46ac-8b3a-4f9d970eaac0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:37.882719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b19ff-46e6-46ac-8b3a-4f9d970eaac0 None admin] RBAC: Adding query filter params (role.id=6edd584a77084fa78240661ea76cddb5, scope.project.id=a9c77456393046489b2b4b0dbb08ed0e, user.id=b0b7fa80e3df4eb49cc180e88b26ec1e) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:28:37.883031 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b19ff-46e6-46ac-8b3a-4f9d970eaac0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:37.884591 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b19ff-46e6-46ac-8b3a-4f9d970eaac0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:37.890306 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 613/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:28:37 2022] GET /identity/v3/role_assignments?user.id=b0b7fa80e3df4eb49cc180e88b26ec1e&scope.project.id=a9c77456393046489b2b4b0dbb08ed0e&role.id=6edd584a77084fa78240661ea76cddb5 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:47.716925 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=91 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:47.887813 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=25 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:39.389997 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1736a-cc90-4b17-af4c-9e665202c50b None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:39.390763 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1736a-cc90-4b17-af4c-9e665202c50b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:39.390763 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1736a-cc90-4b17-af4c-9e665202c50b None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:39.391934 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 588/1201] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:29:39.397871 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0143d9-6076-41b1-8c4f-81256dbf1931 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:39.398699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0143d9-6076-41b1-8c4f-81256dbf1931 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:39.398699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0143d9-6076-41b1-8c4f-81256dbf1931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:39.419677 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-9b0143d9-6076-41b1-8c4f-81256dbf1931 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:39.427647 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9b0143d9-6076-41b1-8c4f-81256dbf1931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:39.500184 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 614/1202] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:29:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:29:39.525250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1736a-cc90-4b17-af4c-9e665202c50b None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:39.655076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1736a-cc90-4b17-af4c-9e665202c50b None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:39.698763 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d067e8-6e48-4742-ab09-812c9d5dab65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:39.699661 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d067e8-6e48-4742-ab09-812c9d5dab65 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:39.699902 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d067e8-6e48-4742-ab09-812c9d5dab65 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:39.700179 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d067e8-6e48-4742-ab09-812c9d5dab65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:39.713721 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d067e8-6e48-4742-ab09-812c9d5dab65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:39.715220 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d067e8-6e48-4742-ab09-812c9d5dab65 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:39.733855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-33d067e8-6e48-4742-ab09-812c9d5dab65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:29:39.733855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:29:39.733855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:29:39.733855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:29:39.733855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:29:39.733855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:29:39.733855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:29:39.733855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:29:39.733855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:29:39.733855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:29:39.733855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:29:39.733855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:29:39.733855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:29:39.733855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:29:39.733855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:29:39.734996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:29:39.734996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:29:39.734996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:29:39.734996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:29:39.734996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:29:39.734996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:29:39.734996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:29:39.734996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:29:39.734996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:29:39.734996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:29:39.734996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:29:39.734996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:29:39.734996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:29:39.734996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:29:39.734996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:29:39.734996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:29:39.734996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:29:39.735996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:29:39.735996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:29:39.735996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:29:39.735996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:29:39.735996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 589/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:29:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:29:39.741609 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0143d9-6076-41b1-8c4f-81256dbf1931 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:39.868929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0143d9-6076-41b1-8c4f-81256dbf1931 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:39.910900 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:39.918176 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b0f36-2690-472f-a588-0bd4f46a5aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:39.919124 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b0f36-2690-472f-a588-0bd4f46a5aff None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:39.919434 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b0f36-2690-472f-a588-0bd4f46a5aff None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:39.919879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b0f36-2690-472f-a588-0bd4f46a5aff None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:39.923502 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b0f36-2690-472f-a588-0bd4f46a5aff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:39.923502 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b0f36-2690-472f-a588-0bd4f46a5aff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:39.923502 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b0f36-2690-472f-a588-0bd4f46a5aff None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:39.936144 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 615/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:29:39.942289 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d067e8-6e48-4742-ab09-812c9d5dab65 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:40.007533 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:40.071073 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d067e8-6e48-4742-ab09-812c9d5dab65 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:40.116947 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e328da-703c-4541-995c-03ad67530dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:40.118137 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e328da-703c-4541-995c-03ad67530dd5 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:40.118629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e328da-703c-4541-995c-03ad67530dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:40.118941 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e328da-703c-4541-995c-03ad67530dd5 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:40.119665 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e328da-703c-4541-995c-03ad67530dd5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:40.121113 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e328da-703c-4541-995c-03ad67530dd5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:40.143341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 590/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 13:29:39 2022] POST /identity/v3/users => generated 251 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:29:42.660843 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c9f7f-8001-4911-9db8-9f398e24a64d None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:42.661476 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c9f7f-8001-4911-9db8-9f398e24a64d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:42.661579 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c9f7f-8001-4911-9db8-9f398e24a64d None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:42.662964 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 616/1206] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:29:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:42.670602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f04838-a28d-4142-9bc2-ed9c8ee5580b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:42.670602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f04838-a28d-4142-9bc2-ed9c8ee5580b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:42.670602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f04838-a28d-4142-9bc2-ed9c8ee5580b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:42.687485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-47f04838-a28d-4142-9bc2-ed9c8ee5580b None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:42.688667 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-47f04838-a28d-4142-9bc2-ed9c8ee5580b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:42.764340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 591/1207] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:29:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:29:42.789474 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c9f7f-8001-4911-9db8-9f398e24a64d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:42.922208 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c9f7f-8001-4911-9db8-9f398e24a64d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:42.962104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc33a5d-284e-4d80-83a1-412074de3fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:42.963057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc33a5d-284e-4d80-83a1-412074de3fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:42.963333 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc33a5d-284e-4d80-83a1-412074de3fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:42.963599 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc33a5d-284e-4d80-83a1-412074de3fc1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:42.978556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc33a5d-284e-4d80-83a1-412074de3fc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:29:42.986931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-7bc33a5d-284e-4d80-83a1-412074de3fc1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:29:42.986931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:29:42.986931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:29:42.986931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:29:42.986931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:29:42.986931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:29:42.986931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:29:42.986931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:29:42.986931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:29:42.986931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:29:42.986931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:29:42.986931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:29:42.986931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:29:42.986931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:29:42.986931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:29:42.986931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:29:42.988051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:29:42.988051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:29:42.988051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:29:42.988051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:29:42.988051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:29:42.988051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:29:42.988051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:29:42.988051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:29:42.988051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:29:42.988051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:29:42.988051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:29:42.988051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:29:42.988051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:29:42.988051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:29:42.988051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:29:42.988051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:29:42.989338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:29:42.989338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:29:42.989338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:29:42.989338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:29:42.989338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:29:42.989338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:29:42.989338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:29:42.989338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:29:42.989338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:29:42.989338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:29:42.989338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:29:42.989338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:29:42.989338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 617/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 13:29:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:29:42.997379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f04838-a28d-4142-9bc2-ed9c8ee5580b None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:43.042751 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:43.112712 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f04838-a28d-4142-9bc2-ed9c8ee5580b None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:43.157615 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8989a-7863-4bf9-8257-1d7f62f953b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:43.158320 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8989a-7863-4bf9-8257-1d7f62f953b0 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:43.158755 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8989a-7863-4bf9-8257-1d7f62f953b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:43.159154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8989a-7863-4bf9-8257-1d7f62f953b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:43.159921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8989a-7863-4bf9-8257-1d7f62f953b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:43.160235 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8989a-7863-4bf9-8257-1d7f62f953b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:43.161759 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8989a-7863-4bf9-8257-1d7f62f953b0 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:43.173602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 592/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 13:29:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:29:43.184031 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc33a5d-284e-4d80-83a1-412074de3fc1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:43.244614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:43.309083 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc33a5d-284e-4d80-83a1-412074de3fc1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:43.351575 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603b7d4-e2a2-422b-bdd5-22167ae9c975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:43.352450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603b7d4-e2a2-422b-bdd5-22167ae9c975 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:43.352725 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603b7d4-e2a2-422b-bdd5-22167ae9c975 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:43.353021 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603b7d4-e2a2-422b-bdd5-22167ae9c975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:43.365010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603b7d4-e2a2-422b-bdd5-22167ae9c975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:43.367270 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603b7d4-e2a2-422b-bdd5-22167ae9c975 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:43.386153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-9603b7d4-e2a2-422b-bdd5-22167ae9c975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:29:43.386153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:29:43.386153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:29:43.386153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:29:43.386153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:29:43.386153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:29:43.386153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:29:43.386153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:29:43.386153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:29:43.386153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:29:43.386153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:29:43.386153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:29:43.386153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:29:43.386153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:29:43.386153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:29:43.387550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:29:43.387550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:29:43.387550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:29:43.387550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:29:43.387550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:29:43.387550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:29:43.387550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:29:43.387550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:29:43.387550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:29:43.387550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:29:43.387550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:29:43.387550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:29:43.387550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:29:43.387550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:29:43.387550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:29:43.387550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:29:43.387550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:29:43.394194 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:29:43.394194 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:29:43.394194 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:29:43.394194 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:29:43.394194 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 618/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:29:43.396051 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8989a-7863-4bf9-8257-1d7f62f953b0 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:43.529682 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:43.537564 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8989a-7863-4bf9-8257-1d7f62f953b0 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:43.578910 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b8fd1-2ace-431e-81c1-283549128519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:43.579599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b8fd1-2ace-431e-81c1-283549128519 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:43.579993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b8fd1-2ace-431e-81c1-283549128519 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:43.580311 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b8fd1-2ace-431e-81c1-283549128519 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:43.581184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b8fd1-2ace-431e-81c1-283549128519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:43.581664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b8fd1-2ace-431e-81c1-283549128519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:43.583475 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b8fd1-2ace-431e-81c1-283549128519 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:43.598789 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 593/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:29:43.604594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603b7d4-e2a2-422b-bdd5-22167ae9c975 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:43.725034 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603b7d4-e2a2-422b-bdd5-22167ae9c975 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:43.726910 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:43.766329 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa0b1b-853a-4179-a61c-0f0309c7aa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:43.767419 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa0b1b-853a-4179-a61c-0f0309c7aa2c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:43.767784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa0b1b-853a-4179-a61c-0f0309c7aa2c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:43.768155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa0b1b-853a-4179-a61c-0f0309c7aa2c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:43.778003 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa0b1b-853a-4179-a61c-0f0309c7aa2c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:43.780042 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa0b1b-853a-4179-a61c-0f0309c7aa2c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:43.795255 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-43fa0b1b-853a-4179-a61c-0f0309c7aa2c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:29:43.795255 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:29:43.795255 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:29:43.795255 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:29:43.795255 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:29:43.795255 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:29:43.795255 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:29:43.795255 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:29:43.795255 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:29:43.795255 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:29:43.795255 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:29:43.795255 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:29:43.795255 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:29:43.795255 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:29:43.795255 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:29:43.795255 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:29:43.796639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:29:43.796639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:29:43.796639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:29:43.796639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:29:43.796639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:29:43.796639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:29:43.796639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:29:43.796639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:29:43.796639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:29:43.796639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:29:43.796639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:29:43.796639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:29:43.796639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:29:43.796639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:29:43.796639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:29:43.796639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:29:43.796639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:29:43.796639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:29:43.797871 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:29:43.797871 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:29:43.797871 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:29:43.797871 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:29:43.797871 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:29:43.797871 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:29:43.797871 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:29:43.797871 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:29:43.797871 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:29:43.797871 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:29:43.799133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 619/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:29:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:29:43.805269 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b8fd1-2ace-431e-81c1-283549128519 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:43.924403 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b8fd1-2ace-431e-81c1-283549128519 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:43.963386 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6868936-ac08-4fec-92de-1f065e9048e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:43.964209 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6868936-ac08-4fec-92de-1f065e9048e5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:43.964526 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6868936-ac08-4fec-92de-1f065e9048e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:43.964830 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6868936-ac08-4fec-92de-1f065e9048e5 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:43.965884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6868936-ac08-4fec-92de-1f065e9048e5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:43.966188 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6868936-ac08-4fec-92de-1f065e9048e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:43.967620 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6868936-ac08-4fec-92de-1f065e9048e5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:43.988535 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 594/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Jun 2 13:29:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:29:43.994668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa0b1b-853a-4179-a61c-0f0309c7aa2c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:44.124654 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa0b1b-853a-4179-a61c-0f0309c7aa2c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:44.168683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d736e-e521-4a3f-a5cd-04cbc37b346d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:44.169593 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d736e-e521-4a3f-a5cd-04cbc37b346d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:44.170021 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d736e-e521-4a3f-a5cd-04cbc37b346d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:44.170416 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d736e-e521-4a3f-a5cd-04cbc37b346d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:44.205278 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:44.247596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d736e-e521-4a3f-a5cd-04cbc37b346d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:44.249125 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d736e-e521-4a3f-a5cd-04cbc37b346d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:44.391428 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 620/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:29:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:29:44.399406 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6868936-ac08-4fec-92de-1f065e9048e5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:44.425414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:44.538447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6868936-ac08-4fec-92de-1f065e9048e5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:44.591129 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652181fa-d69a-4477-bf59-93a00875db4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:44.592126 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652181fa-d69a-4477-bf59-93a00875db4f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:44.592485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652181fa-d69a-4477-bf59-93a00875db4f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:44.592852 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652181fa-d69a-4477-bf59-93a00875db4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:44.606342 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652181fa-d69a-4477-bf59-93a00875db4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:44.608151 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652181fa-d69a-4477-bf59-93a00875db4f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:44.626243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-652181fa-d69a-4477-bf59-93a00875db4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:29:44.626243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:29:44.626243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:29:44.626243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:29:44.626243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:29:44.626243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:29:44.626243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:29:44.626243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:29:44.626243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:29:44.626243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:29:44.626243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:29:44.626243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:29:44.626243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:29:44.626243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:29:44.626243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:29:44.627387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:29:44.627387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:29:44.627387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:29:44.627387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:29:44.627387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:29:44.627387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:29:44.627387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:29:44.627387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:29:44.627387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:29:44.627387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:29:44.627387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:29:44.627387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:29:44.627387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:29:44.627387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:29:44.627387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:29:44.627387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:29:44.627387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:29:44.633285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:29:44.633285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:29:44.633285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:29:44.633285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:29:44.633285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 595/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:29:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:29:44.633697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d736e-e521-4a3f-a5cd-04cbc37b346d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:44.705200 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:44.749179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d736e-e521-4a3f-a5cd-04cbc37b346d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:44.787684 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118c79a-9b80-443e-9075-99374f45676b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:44.788494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118c79a-9b80-443e-9075-99374f45676b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:44.788865 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118c79a-9b80-443e-9075-99374f45676b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:44.789616 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118c79a-9b80-443e-9075-99374f45676b None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:44.790468 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118c79a-9b80-443e-9075-99374f45676b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:44.790811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118c79a-9b80-443e-9075-99374f45676b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:44.792191 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118c79a-9b80-443e-9075-99374f45676b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:44.804177 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 621/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:29:44.810629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652181fa-d69a-4477-bf59-93a00875db4f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:44.891088 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:44.929042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652181fa-d69a-4477-bf59-93a00875db4f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:44.964873 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13f720-8933-4604-a8fc-f540eb712753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:44.965666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13f720-8933-4604-a8fc-f540eb712753 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:44.965945 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13f720-8933-4604-a8fc-f540eb712753 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:44.966212 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13f720-8933-4604-a8fc-f540eb712753 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:44.973322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13f720-8933-4604-a8fc-f540eb712753 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:44.974786 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13f720-8933-4604-a8fc-f540eb712753 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:44.989527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-1f13f720-8933-4604-a8fc-f540eb712753 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:29:44.989527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:29:44.989527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:29:44.989527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:29:44.989527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:29:44.989527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:29:44.989527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:29:44.989527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:29:44.989527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:29:44.989527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:29:44.989527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:29:44.989527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:29:44.989527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:29:44.989527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:29:44.989527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:29:44.996494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:29:44.996494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:29:44.996494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:29:44.996494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:29:44.996494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:29:44.996494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:29:44.996494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:29:44.996494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:29:44.996494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:29:44.996494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:29:44.996494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:29:44.996494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:29:44.996494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:29:44.996494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:29:44.996494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:29:44.996494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:29:44.996494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:29:44.999164 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:29:44.999164 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:29:44.999164 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:29:44.999164 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:29:44.999164 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:29:44.999164 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:29:44.999164 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:29:44.999164 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:29:44.999164 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 596/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:29:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:29:44.999794 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118c79a-9b80-443e-9075-99374f45676b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:45.107771 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118c79a-9b80-443e-9075-99374f45676b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:45.130379 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:45.144529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281db87-a91f-445b-9500-d57d14d7c1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:45.145261 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281db87-a91f-445b-9500-d57d14d7c1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:45.145537 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281db87-a91f-445b-9500-d57d14d7c1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:45.145816 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281db87-a91f-445b-9500-d57d14d7c1a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:45.147049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281db87-a91f-445b-9500-d57d14d7c1a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:45.147413 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281db87-a91f-445b-9500-d57d14d7c1a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:45.148898 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281db87-a91f-445b-9500-d57d14d7c1a0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:45.162025 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 622/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:29:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:29:45.168210 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13f720-8933-4604-a8fc-f540eb712753 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:45.282242 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13f720-8933-4604-a8fc-f540eb712753 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:45.314156 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:45.320948 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f6087-2a71-4952-82b5-3e836bb37e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:45.321624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f6087-2a71-4952-82b5-3e836bb37e01 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:45.321995 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f6087-2a71-4952-82b5-3e836bb37e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:45.322200 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f6087-2a71-4952-82b5-3e836bb37e01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:45.323040 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f6087-2a71-4952-82b5-3e836bb37e01 None admin] RBAC: Adding query filter params (role.id=9dc761b84aa745ad920c76ddf9fb0b9e, scope.project.id=af45a1ec7c94408bb638c55fb43fa961, user.id=2f7ea9741a5d409d87b8ebb4390a74ef) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:45.323325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f6087-2a71-4952-82b5-3e836bb37e01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:45.324740 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f6087-2a71-4952-82b5-3e836bb37e01 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:45.331277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 597/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:29:45 2022] GET /identity/v3/role_assignments?user.id=2f7ea9741a5d409d87b8ebb4390a74ef&scope.project.id=af45a1ec7c94408bb638c55fb43fa961&role.id=9dc761b84aa745ad920c76ddf9fb0b9e => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:29:47.577982 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8789c5-6226-4ad0-bebe-9af9d8d522a8 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:47.578644 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8789c5-6226-4ad0-bebe-9af9d8d522a8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:47.578644 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8789c5-6226-4ad0-bebe-9af9d8d522a8 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:47.580143 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 623/1220] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:47.585507 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eac6cf-1532-41b8-a01e-b11e028548e4 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:47.586025 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eac6cf-1532-41b8-a01e-b11e028548e4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:47.586126 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eac6cf-1532-41b8-a01e-b11e028548e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:47.603184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-97eac6cf-1532-41b8-a01e-b11e028548e4 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:47.604352 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-97eac6cf-1532-41b8-a01e-b11e028548e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:47.683498 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 598/1221] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:29:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:29:47.707352 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8789c5-6226-4ad0-bebe-9af9d8d522a8 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:47.820147 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8789c5-6226-4ad0-bebe-9af9d8d522a8 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:47.857020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b662e-0369-4309-a012-83b5dbaffbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:47.857805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b662e-0369-4309-a012-83b5dbaffbc4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:47.857993 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b662e-0369-4309-a012-83b5dbaffbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:47.858263 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b662e-0369-4309-a012-83b5dbaffbc4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:47.869270 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b662e-0369-4309-a012-83b5dbaffbc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:29:47.877579 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-410b662e-0369-4309-a012-83b5dbaffbc4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:29:47.877579 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:29:47.877579 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:29:47.877579 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:29:47.877579 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:29:47.877579 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:29:47.877579 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:29:47.877579 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:29:47.877579 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:29:47.877579 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:29:47.877579 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:29:47.877579 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:29:47.877579 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:29:47.877579 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:29:47.877579 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:29:47.877579 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:29:47.878919 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:29:47.878919 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:29:47.878919 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:29:47.878919 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:29:47.878919 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:29:47.878919 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:29:47.878919 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:29:47.878919 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:29:47.878919 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:29:47.878919 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:29:47.878919 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:29:47.878919 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:29:47.878919 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:29:47.878919 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:29:47.878919 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:29:47.878919 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:29:47.880050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:29:47.880050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:29:47.880050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:29:47.880050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:29:47.880050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:29:47.880050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:29:47.880050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:29:47.880050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:29:47.880050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:29:47.880050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:29:47.880050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:29:47.880050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:29:47.880050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 624/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 13:29:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:29:47.887421 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eac6cf-1532-41b8-a01e-b11e028548e4 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:47.995247 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eac6cf-1532-41b8-a01e-b11e028548e4 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:48.025265 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:48.038837 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e1f29-c851-40c8-b8fc-9c0997eadf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:48.039594 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e1f29-c851-40c8-b8fc-9c0997eadf4c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:48.039931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e1f29-c851-40c8-b8fc-9c0997eadf4c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:48.040275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e1f29-c851-40c8-b8fc-9c0997eadf4c None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:48.041040 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e1f29-c851-40c8-b8fc-9c0997eadf4c None admin] RBAC: Adding query filter params (name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:48.041347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e1f29-c851-40c8-b8fc-9c0997eadf4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:48.042753 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e1f29-c851-40c8-b8fc-9c0997eadf4c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:48.052912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 599/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 13:29:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:29:48.059573 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b662e-0369-4309-a012-83b5dbaffbc4 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:48.110275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:48.172119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b662e-0369-4309-a012-83b5dbaffbc4 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:48.207198 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9e9fa-3442-4d0f-b232-14a12c3fb54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:48.208017 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9e9fa-3442-4d0f-b232-14a12c3fb54e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:48.208288 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9e9fa-3442-4d0f-b232-14a12c3fb54e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:48.208557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9e9fa-3442-4d0f-b232-14a12c3fb54e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:48.219892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9e9fa-3442-4d0f-b232-14a12c3fb54e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:48.221349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9e9fa-3442-4d0f-b232-14a12c3fb54e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:48.241410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-12c9e9fa-3442-4d0f-b232-14a12c3fb54e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:29:48.241410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:29:48.241410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:29:48.241410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:29:48.241410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:29:48.241410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:29:48.241410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:29:48.241410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:29:48.241410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:29:48.241410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:29:48.241410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:29:48.241410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:29:48.241410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:29:48.241410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:29:48.241410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:29:48.242690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:29:48.242690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:29:48.242690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:29:48.242690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:29:48.242690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:29:48.242690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:29:48.242690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:29:48.242690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:29:48.242690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:29:48.242690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:29:48.242690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:29:48.242690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:29:48.242690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:29:48.242690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:29:48.242690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:29:48.242690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:29:48.242690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:29:48.247607 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:29:48.247607 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:29:48.247607 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:29:48.247607 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:29:48.247607 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 625/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:29:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:29:48.249062 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e1f29-c851-40c8-b8fc-9c0997eadf4c None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:48.362376 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e1f29-c851-40c8-b8fc-9c0997eadf4c None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:48.407551 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7f02c-f234-42b8-8ccd-d0303f155804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:48.408249 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7f02c-f234-42b8-8ccd-d0303f155804 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:48.408529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7f02c-f234-42b8-8ccd-d0303f155804 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:48.408800 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7f02c-f234-42b8-8ccd-d0303f155804 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:48.409557 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7f02c-f234-42b8-8ccd-d0303f155804 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:48.409865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7f02c-f234-42b8-8ccd-d0303f155804 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:48.411303 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7f02c-f234-42b8-8ccd-d0303f155804 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:48.424778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 600/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:29:48.430519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9e9fa-3442-4d0f-b232-14a12c3fb54e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:48.556277 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:48.565425 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9e9fa-3442-4d0f-b232-14a12c3fb54e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:48.613668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74e8d0-4f61-449b-8b54-b4fe37d32fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:48.615365 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74e8d0-4f61-449b-8b54-b4fe37d32fbf None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:48.615917 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74e8d0-4f61-449b-8b54-b4fe37d32fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:48.616397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74e8d0-4f61-449b-8b54-b4fe37d32fbf None admin] PATH_INFO: `/v3/users/placement` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:48.626744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74e8d0-4f61-449b-8b54-b4fe37d32fbf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:48.628700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74e8d0-4f61-449b-8b54-b4fe37d32fbf None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:48.649299 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-5a74e8d0-4f61-449b-8b54-b4fe37d32fbf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:29:48.649299 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:29:48.649299 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:29:48.649299 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:29:48.649299 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:29:48.649299 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:29:48.649299 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:29:48.649299 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:29:48.649299 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:29:48.649299 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:29:48.649299 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:29:48.649299 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:29:48.649299 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:29:48.649299 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:29:48.649299 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:29:48.649299 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:29:48.650516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:29:48.650516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:29:48.650516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:29:48.650516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:29:48.650516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:29:48.650516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:29:48.650516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:29:48.650516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:29:48.650516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:29:48.650516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:29:48.650516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:29:48.650516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:29:48.650516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:29:48.650516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:29:48.650516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:29:48.650516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:29:48.650516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:29:48.650516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:29:48.651848 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:29:48.651848 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:29:48.651848 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:29:48.651848 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:29:48.651848 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:29:48.651848 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:29:48.651848 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:29:48.651848 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:29:48.651848 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:29:48.651848 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:29:48.651848 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 626/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:29:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:29:48.656717 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7f02c-f234-42b8-8ccd-d0303f155804 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:48.724477 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:48.785724 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7f02c-f234-42b8-8ccd-d0303f155804 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:48.823120 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15f2bd-40ab-4ac8-a09d-92006452e7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:48.823806 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15f2bd-40ab-4ac8-a09d-92006452e7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:48.824088 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15f2bd-40ab-4ac8-a09d-92006452e7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:48.824368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15f2bd-40ab-4ac8-a09d-92006452e7d1 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:48.825176 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15f2bd-40ab-4ac8-a09d-92006452e7d1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:48.825484 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15f2bd-40ab-4ac8-a09d-92006452e7d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:48.827025 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15f2bd-40ab-4ac8-a09d-92006452e7d1 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:48.845349 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 601/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Jun 2 13:29:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:29:48.851128 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74e8d0-4f61-449b-8b54-b4fe37d32fbf None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:48.956545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74e8d0-4f61-449b-8b54-b4fe37d32fbf None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:48.996057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7334abd-b0e3-4407-8169-62edf215836d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:48.996927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7334abd-b0e3-4407-8169-62edf215836d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:48.997227 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7334abd-b0e3-4407-8169-62edf215836d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:48.997498 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7334abd-b0e3-4407-8169-62edf215836d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:49.009790 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7334abd-b0e3-4407-8169-62edf215836d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:49.011472 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7334abd-b0e3-4407-8169-62edf215836d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:49.030438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-e7334abd-b0e3-4407-8169-62edf215836d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:29:49.030438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:29:49.030438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:29:49.030438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:29:49.030438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:29:49.030438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:29:49.030438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:29:49.030438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:29:49.030438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:29:49.030438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:29:49.030438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:29:49.030438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:29:49.030438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:29:49.030438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:29:49.030438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:29:49.031604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:29:49.031604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:29:49.031604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:29:49.031604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:29:49.031604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:29:49.031604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:29:49.031604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:29:49.031604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:29:49.031604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:29:49.031604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:29:49.031604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:29:49.031604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:29:49.031604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:29:49.031604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:29:49.031604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:29:49.031604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:29:49.031604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:29:49.032818 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:29:49.032818 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:29:49.032818 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:29:49.032818 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:29:49.032818 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 627/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:29:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:29:49.039328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15f2bd-40ab-4ac8-a09d-92006452e7d1 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:49.159450 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15f2bd-40ab-4ac8-a09d-92006452e7d1 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:49.161968 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:49.197304 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07219f9f-4872-407b-835a-9633dbd22406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:49.198088 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07219f9f-4872-407b-835a-9633dbd22406 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:49.198263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07219f9f-4872-407b-835a-9633dbd22406 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:49.198538 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07219f9f-4872-407b-835a-9633dbd22406 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:49.199296 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07219f9f-4872-407b-835a-9633dbd22406 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:49.199603 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07219f9f-4872-407b-835a-9633dbd22406 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:49.201038 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07219f9f-4872-407b-835a-9633dbd22406 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:49.213819 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 602/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:29:49.220032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7334abd-b0e3-4407-8169-62edf215836d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:49.230978 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:49.332084 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7334abd-b0e3-4407-8169-62edf215836d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:49.377346 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5befae-29ab-494e-9ed8-da83133ca8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:49.378420 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5befae-29ab-494e-9ed8-da83133ca8c3 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:49.378819 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5befae-29ab-494e-9ed8-da83133ca8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:49.379252 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5befae-29ab-494e-9ed8-da83133ca8c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:49.387389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5befae-29ab-494e-9ed8-da83133ca8c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:49.389299 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5befae-29ab-494e-9ed8-da83133ca8c3 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:49.405794 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-7f5befae-29ab-494e-9ed8-da83133ca8c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:29:49.405794 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:29:49.405794 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:29:49.405794 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:29:49.405794 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:29:49.405794 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:29:49.405794 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:29:49.405794 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:29:49.405794 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:29:49.405794 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:29:49.405794 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:29:49.405794 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:29:49.405794 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:29:49.405794 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:29:49.405794 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:29:49.407020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:29:49.407020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:29:49.407020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:29:49.407020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:29:49.407020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:29:49.407020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:29:49.407020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:29:49.407020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:29:49.407020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:29:49.407020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:29:49.407020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:29:49.407020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:29:49.407020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:29:49.407020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:29:49.407020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:29:49.407020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:29:49.407020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:29:49.408064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:29:49.408064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:29:49.408064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:29:49.408064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:29:49.408064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:29:49.408064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:29:49.408064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:29:49.408064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:29:49.408064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 628/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:29:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:29:49.413095 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07219f9f-4872-407b-835a-9633dbd22406 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:49.545054 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07219f9f-4872-407b-835a-9633dbd22406 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:49.584998 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493a7ca-88b7-4298-9042-899fe73289e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:49.585723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493a7ca-88b7-4298-9042-899fe73289e4 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:49.586310 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493a7ca-88b7-4298-9042-899fe73289e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:49.586725 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493a7ca-88b7-4298-9042-899fe73289e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:49.587574 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493a7ca-88b7-4298-9042-899fe73289e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:49.587881 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493a7ca-88b7-4298-9042-899fe73289e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:49.589471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493a7ca-88b7-4298-9042-899fe73289e4 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:49.603171 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 603/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:29:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:29:49.609519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5befae-29ab-494e-9ed8-da83133ca8c3 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:49.681421 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:49.717233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5befae-29ab-494e-9ed8-da83133ca8c3 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:49.763508 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6abdf4-ef20-4f69-962a-9e2e57705486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:49.764474 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6abdf4-ef20-4f69-962a-9e2e57705486 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:49.764770 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6abdf4-ef20-4f69-962a-9e2e57705486 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:49.765048 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6abdf4-ef20-4f69-962a-9e2e57705486 None admin] PATH_INFO: `/v3/projects/af45a1ec7c94408bb638c55fb43fa961/users/2f7ea9741a5d409d87b8ebb4390a74ef/roles/9dc761b84aa745ad920c76ddf9fb0b9e` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:49.784662 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6abdf4-ef20-4f69-962a-9e2e57705486 None admin] RBAC: Authorizing `identity:create_grant(project_id=af45a1ec7c94408bb638c55fb43fa961, user_id=2f7ea9741a5d409d87b8ebb4390a74ef, role_id=9dc761b84aa745ad920c76ddf9fb0b9e)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:49.786288 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6abdf4-ef20-4f69-962a-9e2e57705486 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:49.800268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 629/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 13:29:49 2022] PUT /identity/v3/projects/af45a1ec7c94408bb638c55fb43fa961/users/2f7ea9741a5d409d87b8ebb4390a74ef/roles/9dc761b84aa745ad920c76ddf9fb0b9e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:52.205293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee969e1a-d95a-40fe-a7f2-01b7f8e93685 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:52.205885 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee969e1a-d95a-40fe-a7f2-01b7f8e93685 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:52.205885 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee969e1a-d95a-40fe-a7f2-01b7f8e93685 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:52.207280 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 604/1233] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:29:52.213735 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a394543-2903-4816-9d39-fdaad2586cf6 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:52.214418 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a394543-2903-4816-9d39-fdaad2586cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:52.214418 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a394543-2903-4816-9d39-fdaad2586cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:52.233670 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6a394543-2903-4816-9d39-fdaad2586cf6 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:52.235087 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6a394543-2903-4816-9d39-fdaad2586cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:52.309760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 630/1234] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:29:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:29:52.337648 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee969e1a-d95a-40fe-a7f2-01b7f8e93685 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:52.368646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:52.460401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee969e1a-d95a-40fe-a7f2-01b7f8e93685 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:52.508959 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303e4ae-303f-45d5-95dc-a748378b399f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:52.509780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303e4ae-303f-45d5-95dc-a748378b399f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:52.510098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303e4ae-303f-45d5-95dc-a748378b399f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:52.510374 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303e4ae-303f-45d5-95dc-a748378b399f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:52.522769 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303e4ae-303f-45d5-95dc-a748378b399f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:29:52.531548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-4303e4ae-303f-45d5-95dc-a748378b399f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:29:52.531548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:29:52.531548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:29:52.531548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:29:52.531548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:29:52.531548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:29:52.531548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:29:52.531548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:29:52.531548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:29:52.531548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:29:52.531548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:29:52.531548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:29:52.531548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:29:52.531548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:29:52.531548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:29:52.531548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:29:52.532616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:29:52.532616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:29:52.532616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:29:52.532616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:29:52.532616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:29:52.532616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:29:52.532616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:29:52.532616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:29:52.532616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:29:52.532616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:29:52.532616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:29:52.532616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:29:52.532616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:29:52.532616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:29:52.532616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:29:52.532616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:29:52.533480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:29:52.533480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:29:52.533480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:29:52.533480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:29:52.533480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:29:52.533480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:29:52.533480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:29:52.533480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:29:52.533480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:29:52.533480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:29:52.533480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:29:52.533480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:29:52.533480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 605/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 13:29:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:29:52.543039 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a394543-2903-4816-9d39-fdaad2586cf6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:52.602408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:52.659666 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a394543-2903-4816-9d39-fdaad2586cf6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:52.701040 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55637be4-fc0b-4be4-af8b-7d5bec60ae02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:52.701853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55637be4-fc0b-4be4-af8b-7d5bec60ae02 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:52.702044 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55637be4-fc0b-4be4-af8b-7d5bec60ae02 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:52.702374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55637be4-fc0b-4be4-af8b-7d5bec60ae02 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:52.703168 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55637be4-fc0b-4be4-af8b-7d5bec60ae02 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:52.703469 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55637be4-fc0b-4be4-af8b-7d5bec60ae02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:52.705218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55637be4-fc0b-4be4-af8b-7d5bec60ae02 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:52.720352 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 631/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 13:29:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:29:52.721795 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303e4ae-303f-45d5-95dc-a748378b399f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:52.823759 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:52.843349 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303e4ae-303f-45d5-95dc-a748378b399f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:52.885124 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8d4bf-c85b-42f5-8756-561358d2e7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:52.885928 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8d4bf-c85b-42f5-8756-561358d2e7ce None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:52.886206 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8d4bf-c85b-42f5-8756-561358d2e7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:52.886486 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8d4bf-c85b-42f5-8756-561358d2e7ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:52.900454 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8d4bf-c85b-42f5-8756-561358d2e7ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:52.901942 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8d4bf-c85b-42f5-8756-561358d2e7ce None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:52.922042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-69e8d4bf-c85b-42f5-8756-561358d2e7ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:29:52.922042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:29:52.922042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:29:52.922042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:29:52.922042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:29:52.922042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:29:52.922042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:29:52.922042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:29:52.922042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:29:52.922042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:29:52.922042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:29:52.922042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:29:52.922042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:29:52.922042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:29:52.922042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:29:52.923322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:29:52.923322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:29:52.923322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:29:52.923322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:29:52.923322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:29:52.923322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:29:52.923322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:29:52.923322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:29:52.923322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:29:52.923322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:29:52.923322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:29:52.923322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:29:52.923322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:29:52.923322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:29:52.923322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:29:52.923322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:29:52.923322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:29:52.924389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:29:52.924389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:29:52.924389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:29:52.924389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:29:52.924389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 606/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:29:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:29:52.929624 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55637be4-fc0b-4be4-af8b-7d5bec60ae02 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:53.047582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55637be4-fc0b-4be4-af8b-7d5bec60ae02 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:53.058599 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:53.090060 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b2421-0fba-4cbb-ae33-4ed51d5531ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:53.090773 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b2421-0fba-4cbb-ae33-4ed51d5531ba None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:53.091049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b2421-0fba-4cbb-ae33-4ed51d5531ba None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:53.091321 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b2421-0fba-4cbb-ae33-4ed51d5531ba None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:53.092045 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b2421-0fba-4cbb-ae33-4ed51d5531ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:53.092420 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b2421-0fba-4cbb-ae33-4ed51d5531ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:53.093823 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b2421-0fba-4cbb-ae33-4ed51d5531ba None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:53.106316 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 632/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:29:53.112518 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8d4bf-c85b-42f5-8756-561358d2e7ce None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:53.223053 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8d4bf-c85b-42f5-8756-561358d2e7ce None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:53.259457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a3a1e-5ccb-4bd6-b97c-4ea1cca65fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:53.260352 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a3a1e-5ccb-4bd6-b97c-4ea1cca65fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:53.260668 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a3a1e-5ccb-4bd6-b97c-4ea1cca65fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:53.260940 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a3a1e-5ccb-4bd6-b97c-4ea1cca65fd5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:53.263988 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:53.270453 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a3a1e-5ccb-4bd6-b97c-4ea1cca65fd5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:53.272459 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a3a1e-5ccb-4bd6-b97c-4ea1cca65fd5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:53.287097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-bc8a3a1e-5ccb-4bd6-b97c-4ea1cca65fd5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:29:53.287097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:29:53.287097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:29:53.287097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:29:53.287097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:29:53.287097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:29:53.287097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:29:53.287097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:29:53.287097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:29:53.287097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:29:53.287097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:29:53.287097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:29:53.287097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:29:53.287097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:29:53.287097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:29:53.287097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:29:53.288625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:29:53.288625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:29:53.288625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:29:53.288625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:29:53.288625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:29:53.288625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:29:53.288625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:29:53.288625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:29:53.288625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:29:53.288625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:29:53.288625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:29:53.288625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:29:53.288625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:29:53.288625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:29:53.288625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:29:53.288625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:29:53.288625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:29:53.288625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:29:53.289644 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:29:53.289644 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:29:53.289644 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:29:53.289644 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:29:53.289644 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:29:53.289644 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:29:53.289644 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:29:53.289644 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:29:53.289644 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:29:53.289644 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:29:53.289644 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 607/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:29:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:29:53.295578 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b2421-0fba-4cbb-ae33-4ed51d5531ba None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:53.399515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b2421-0fba-4cbb-ae33-4ed51d5531ba None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:53.434413 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925ad49-e600-4a7b-af9e-b5c234b4d8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:53.435254 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925ad49-e600-4a7b-af9e-b5c234b4d8ea None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:53.435559 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925ad49-e600-4a7b-af9e-b5c234b4d8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:53.437123 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925ad49-e600-4a7b-af9e-b5c234b4d8ea None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:53.437123 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925ad49-e600-4a7b-af9e-b5c234b4d8ea None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:53.437123 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925ad49-e600-4a7b-af9e-b5c234b4d8ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:53.438557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925ad49-e600-4a7b-af9e-b5c234b4d8ea None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:53.459739 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 633/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Jun 2 13:29:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:29:53.467846 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a3a1e-5ccb-4bd6-b97c-4ea1cca65fd5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:53.589796 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a3a1e-5ccb-4bd6-b97c-4ea1cca65fd5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:53.632897 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60395f5f-302a-4b5e-880a-2de23facc630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:53.634142 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60395f5f-302a-4b5e-880a-2de23facc630 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:53.634427 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60395f5f-302a-4b5e-880a-2de23facc630 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:53.634724 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60395f5f-302a-4b5e-880a-2de23facc630 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:53.705397 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:53.712634 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60395f5f-302a-4b5e-880a-2de23facc630 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:53.714103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60395f5f-302a-4b5e-880a-2de23facc630 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:53.827899 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 608/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:29:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:29:53.834557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925ad49-e600-4a7b-af9e-b5c234b4d8ea None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:53.866670 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:53.945671 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925ad49-e600-4a7b-af9e-b5c234b4d8ea None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:53.983711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fcbd6-b127-40ff-8c23-86b4faeb9509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:53.984439 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fcbd6-b127-40ff-8c23-86b4faeb9509 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:53.984720 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fcbd6-b127-40ff-8c23-86b4faeb9509 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:53.984986 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fcbd6-b127-40ff-8c23-86b4faeb9509 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:53.996633 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fcbd6-b127-40ff-8c23-86b4faeb9509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:53.998120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fcbd6-b127-40ff-8c23-86b4faeb9509 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:54.016183 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-e23fcbd6-b127-40ff-8c23-86b4faeb9509 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:29:54.016183 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:29:54.016183 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:29:54.016183 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:29:54.016183 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:29:54.016183 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:29:54.016183 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:29:54.016183 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:29:54.016183 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:29:54.016183 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:29:54.016183 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:29:54.016183 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:29:54.016183 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:29:54.016183 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:29:54.016183 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:29:54.017241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:29:54.017241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:29:54.017241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:29:54.017241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:29:54.017241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:29:54.017241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:29:54.017241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:29:54.017241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:29:54.017241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:29:54.017241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:29:54.017241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:29:54.017241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:29:54.017241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:29:54.017241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:29:54.017241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:29:54.017241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:29:54.017241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:29:54.018620 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:29:54.018620 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:29:54.018620 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:29:54.018620 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:29:54.018620 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 634/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:29:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:29:54.024088 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60395f5f-302a-4b5e-880a-2de23facc630 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:54.125778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:54.133848 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60395f5f-302a-4b5e-880a-2de23facc630 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:54.173890 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31832682-68e5-480e-b86a-f3780da4eead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:54.174643 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31832682-68e5-480e-b86a-f3780da4eead None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:54.175027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31832682-68e5-480e-b86a-f3780da4eead None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:54.175302 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31832682-68e5-480e-b86a-f3780da4eead None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:54.176171 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31832682-68e5-480e-b86a-f3780da4eead None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:54.176515 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31832682-68e5-480e-b86a-f3780da4eead None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:54.177986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31832682-68e5-480e-b86a-f3780da4eead None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:54.192425 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 609/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:29:54.198198 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fcbd6-b127-40ff-8c23-86b4faeb9509 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:54.285070 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:54.309868 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fcbd6-b127-40ff-8c23-86b4faeb9509 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:54.349620 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f20a3-3277-4f5f-b94f-5f4e2dcb695d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:54.350709 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f20a3-3277-4f5f-b94f-5f4e2dcb695d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:54.351049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f20a3-3277-4f5f-b94f-5f4e2dcb695d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:54.351485 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f20a3-3277-4f5f-b94f-5f4e2dcb695d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:54.359400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f20a3-3277-4f5f-b94f-5f4e2dcb695d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:54.361116 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f20a3-3277-4f5f-b94f-5f4e2dcb695d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:54.377668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-9a6f20a3-3277-4f5f-b94f-5f4e2dcb695d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:29:54.377668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:29:54.377668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:29:54.377668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:29:54.377668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:29:54.377668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:29:54.377668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:29:54.377668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:29:54.377668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:29:54.377668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:29:54.377668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:29:54.377668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:29:54.377668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:29:54.377668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:29:54.377668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:29:54.379450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:29:54.379450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:29:54.379450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:29:54.379450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:29:54.379450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:29:54.379450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:29:54.379450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:29:54.379450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:29:54.379450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:29:54.379450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:29:54.379450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:29:54.379450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:29:54.379450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:29:54.379450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:29:54.379450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:29:54.379450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:29:54.379450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:29:54.382495 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:29:54.382495 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:29:54.382495 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:29:54.382495 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:29:54.382495 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:29:54.382495 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:29:54.382495 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:29:54.382495 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:29:54.382495 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 635/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:29:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:29:54.387199 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31832682-68e5-480e-b86a-f3780da4eead None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:54.518539 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31832682-68e5-480e-b86a-f3780da4eead None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:54.557895 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29893448-feb9-4ff6-a6ab-c3eb2907c65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:54.558530 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29893448-feb9-4ff6-a6ab-c3eb2907c65a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:54.558831 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29893448-feb9-4ff6-a6ab-c3eb2907c65a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:54.559104 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29893448-feb9-4ff6-a6ab-c3eb2907c65a None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:54.559992 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29893448-feb9-4ff6-a6ab-c3eb2907c65a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:54.560251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29893448-feb9-4ff6-a6ab-c3eb2907c65a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:54.561788 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29893448-feb9-4ff6-a6ab-c3eb2907c65a None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:54.574523 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 610/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:29:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:29:54.580802 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f20a3-3277-4f5f-b94f-5f4e2dcb695d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:54.700119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f20a3-3277-4f5f-b94f-5f4e2dcb695d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:54.734149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd2730-17b1-42e8-8d31-c20573f2e152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:54.734843 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd2730-17b1-42e8-8d31-c20573f2e152 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:54.735117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd2730-17b1-42e8-8d31-c20573f2e152 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:54.735356 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd2730-17b1-42e8-8d31-c20573f2e152 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:54.736297 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd2730-17b1-42e8-8d31-c20573f2e152 None admin] RBAC: Adding query filter params (role.id=9dc761b84aa745ad920c76ddf9fb0b9e, scope.project.id=af45a1ec7c94408bb638c55fb43fa961, user.id=2f7ea9741a5d409d87b8ebb4390a74ef) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:54.736613 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd2730-17b1-42e8-8d31-c20573f2e152 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:54.738033 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd2730-17b1-42e8-8d31-c20573f2e152 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:54.744253 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 636/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:29:54 2022] GET /identity/v3/role_assignments?user.id=2f7ea9741a5d409d87b8ebb4390a74ef&scope.project.id=af45a1ec7c94408bb638c55fb43fa961&role.id=9dc761b84aa745ad920c76ddf9fb0b9e => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:29:57.118750 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653923a-c9fe-443e-ab58-ed95c3cce8b2 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:57.118750 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653923a-c9fe-443e-ab58-ed95c3cce8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:57.118750 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653923a-c9fe-443e-ab58-ed95c3cce8b2 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:57.120999 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 611/1247] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:57.129364 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0126d9d-68e2-4ccf-8618-4f71ef553008 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:57.129828 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0126d9d-68e2-4ccf-8618-4f71ef553008 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:57.129932 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0126d9d-68e2-4ccf-8618-4f71ef553008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:57.136270 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:57.153243 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e0126d9d-68e2-4ccf-8618-4f71ef553008 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:57.154801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e0126d9d-68e2-4ccf-8618-4f71ef553008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:57.234036 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 637/1248] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:29:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:29:57.259169 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653923a-c9fe-443e-ab58-ed95c3cce8b2 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:57.281128 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:57.387915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653923a-c9fe-443e-ab58-ed95c3cce8b2 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:57.429480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed814b-25d2-4625-82e5-328361998096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:57.430436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed814b-25d2-4625-82e5-328361998096 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:57.430810 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed814b-25d2-4625-82e5-328361998096 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:57.431089 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed814b-25d2-4625-82e5-328361998096 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:57.443540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed814b-25d2-4625-82e5-328361998096 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:29:57.452196 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-a6ed814b-25d2-4625-82e5-328361998096 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:29:57.452196 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:29:57.452196 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:29:57.452196 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:29:57.452196 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:29:57.452196 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:29:57.452196 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:29:57.452196 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:29:57.452196 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:29:57.452196 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:29:57.452196 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:29:57.452196 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:29:57.452196 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:29:57.452196 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:29:57.452196 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:29:57.452196 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:29:57.453598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:29:57.453598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:29:57.453598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:29:57.453598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:29:57.453598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:29:57.453598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:29:57.453598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:29:57.453598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:29:57.453598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:29:57.453598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:29:57.453598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:29:57.453598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:29:57.453598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:29:57.453598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:29:57.453598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:29:57.453598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:29:57.454454 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:29:57.454454 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:29:57.454454 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:29:57.454454 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:29:57.454454 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:29:57.454454 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:29:57.454454 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:29:57.454454 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:29:57.454454 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:29:57.454454 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:29:57.454454 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:29:57.454454 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:29:57.454454 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 612/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:29:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:29:57.460256 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0126d9d-68e2-4ccf-8618-4f71ef553008 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:57.581050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0126d9d-68e2-4ccf-8618-4f71ef553008 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:57.610934 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:57.616301 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b15a5e-35bd-4d83-906d-e0c39e823113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:57.617021 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b15a5e-35bd-4d83-906d-e0c39e823113 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:57.617293 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b15a5e-35bd-4d83-906d-e0c39e823113 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:57.617577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b15a5e-35bd-4d83-906d-e0c39e823113 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:57.618309 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b15a5e-35bd-4d83-906d-e0c39e823113 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:57.618639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b15a5e-35bd-4d83-906d-e0c39e823113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:57.620027 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b15a5e-35bd-4d83-906d-e0c39e823113 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:57.629084 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 638/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:29:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:29:57.635463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed814b-25d2-4625-82e5-328361998096 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:57.721273 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:57.746218 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed814b-25d2-4625-82e5-328361998096 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:57.788857 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd17f3-8c1e-431d-a8d4-6a1c77bb148c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:57.789734 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd17f3-8c1e-431d-a8d4-6a1c77bb148c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:57.790176 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd17f3-8c1e-431d-a8d4-6a1c77bb148c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:57.790523 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd17f3-8c1e-431d-a8d4-6a1c77bb148c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:57.801072 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd17f3-8c1e-431d-a8d4-6a1c77bb148c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:57.802504 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd17f3-8c1e-431d-a8d4-6a1c77bb148c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:57.821260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-fddd17f3-8c1e-431d-a8d4-6a1c77bb148c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:29:57.821260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:29:57.821260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:29:57.821260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:29:57.821260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:29:57.821260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:29:57.821260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:29:57.821260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:29:57.821260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:29:57.821260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:29:57.821260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:29:57.821260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:29:57.821260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:29:57.821260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:29:57.821260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:29:57.822328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:29:57.822328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:29:57.822328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:29:57.822328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:29:57.822328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:29:57.822328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:29:57.822328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:29:57.822328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:29:57.822328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:29:57.822328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:29:57.822328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:29:57.822328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:29:57.822328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:29:57.822328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:29:57.822328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:29:57.822328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:29:57.822328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:29:57.823306 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:29:57.823306 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:29:57.823306 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:29:57.823306 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:29:57.823306 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 613/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:29:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:29:57.828756 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b15a5e-35bd-4d83-906d-e0c39e823113 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:57.950019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b15a5e-35bd-4d83-906d-e0c39e823113 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:57.990057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dee128-db1d-4ced-bbfd-5a3e0e92d22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:57.990636 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dee128-db1d-4ced-bbfd-5a3e0e92d22a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:57.990917 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dee128-db1d-4ced-bbfd-5a3e0e92d22a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:57.991188 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dee128-db1d-4ced-bbfd-5a3e0e92d22a None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:57.992026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dee128-db1d-4ced-bbfd-5a3e0e92d22a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:57.992385 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dee128-db1d-4ced-bbfd-5a3e0e92d22a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:57.993843 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dee128-db1d-4ced-bbfd-5a3e0e92d22a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:58.006440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 639/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:29:58.012831 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd17f3-8c1e-431d-a8d4-6a1c77bb148c None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:58.124165 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd17f3-8c1e-431d-a8d4-6a1c77bb148c None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:58.152993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:58.162338 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92016ec8-f754-4da4-8cea-d356c39373dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:58.163442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92016ec8-f754-4da4-8cea-d356c39373dd None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:58.164027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92016ec8-f754-4da4-8cea-d356c39373dd None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:58.164430 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92016ec8-f754-4da4-8cea-d356c39373dd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:58.173242 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92016ec8-f754-4da4-8cea-d356c39373dd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:58.174820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92016ec8-f754-4da4-8cea-d356c39373dd None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:58.191168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-92016ec8-f754-4da4-8cea-d356c39373dd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:29:58.191168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:29:58.191168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:29:58.191168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:29:58.191168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:29:58.191168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:29:58.191168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:29:58.191168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:29:58.191168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:29:58.191168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:29:58.191168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:29:58.191168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:29:58.191168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:29:58.191168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:29:58.191168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:29:58.191168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:29:58.192399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:29:58.192399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:29:58.192399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:29:58.192399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:29:58.192399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:29:58.192399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:29:58.192399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:29:58.192399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:29:58.192399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:29:58.192399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:29:58.192399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:29:58.192399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:29:58.192399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:29:58.192399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:29:58.192399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:29:58.192399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:29:58.192399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:29:58.192399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:29:58.193726 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:29:58.193726 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:29:58.193726 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:29:58.193726 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:29:58.193726 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:29:58.193726 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:29:58.193726 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:29:58.193726 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:29:58.193726 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:29:58.193726 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:29:58.193726 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 614/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:29:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:29:58.198639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dee128-db1d-4ced-bbfd-5a3e0e92d22a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:58.271387 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:58.319517 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dee128-db1d-4ced-bbfd-5a3e0e92d22a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:58.357896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826245a-8db1-436f-92bc-b0172a2e756d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:58.358610 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826245a-8db1-436f-92bc-b0172a2e756d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:58.358878 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826245a-8db1-436f-92bc-b0172a2e756d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:58.359152 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826245a-8db1-436f-92bc-b0172a2e756d None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:58.359987 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826245a-8db1-436f-92bc-b0172a2e756d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:58.360291 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826245a-8db1-436f-92bc-b0172a2e756d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:58.361771 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826245a-8db1-436f-92bc-b0172a2e756d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:58.381718 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 640/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Jun 2 13:29:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:29:58.388098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92016ec8-f754-4da4-8cea-d356c39373dd None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:58.504172 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92016ec8-f754-4da4-8cea-d356c39373dd None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:58.561784 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ca8be-4b44-4f89-8951-e76313469950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:58.562422 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ca8be-4b44-4f89-8951-e76313469950 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:58.562744 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ca8be-4b44-4f89-8951-e76313469950 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:58.563967 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ca8be-4b44-4f89-8951-e76313469950 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:58.633210 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:58.649102 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ca8be-4b44-4f89-8951-e76313469950 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:58.650620 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ca8be-4b44-4f89-8951-e76313469950 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:58.754726 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 615/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:29:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:29:58.760743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826245a-8db1-436f-92bc-b0172a2e756d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:58.864767 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826245a-8db1-436f-92bc-b0172a2e756d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:58.879170 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:58.908946 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af199fa-0544-4e62-9fbc-7be1a0cc7786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:58.909765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af199fa-0544-4e62-9fbc-7be1a0cc7786 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:58.910047 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af199fa-0544-4e62-9fbc-7be1a0cc7786 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:58.910314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af199fa-0544-4e62-9fbc-7be1a0cc7786 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:58.921335 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af199fa-0544-4e62-9fbc-7be1a0cc7786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:58.922826 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af199fa-0544-4e62-9fbc-7be1a0cc7786 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:58.941422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-1af199fa-0544-4e62-9fbc-7be1a0cc7786 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:29:58.941422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:29:58.941422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:29:58.941422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:29:58.941422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:29:58.941422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:29:58.941422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:29:58.941422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:29:58.941422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:29:58.941422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:29:58.941422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:29:58.941422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:29:58.941422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:29:58.941422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:29:58.941422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:29:58.942377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:29:58.942377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:29:58.942377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:29:58.942377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:29:58.942377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:29:58.942377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:29:58.942377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:29:58.942377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:29:58.942377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:29:58.942377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:29:58.942377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:29:58.942377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:29:58.942377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:29:58.942377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:29:58.942377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:29:58.942377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:29:58.942377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:29:58.943343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:29:58.943343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:29:58.943343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:29:58.943343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:29:58.943343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 641/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:29:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:29:58.948846 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ca8be-4b44-4f89-8951-e76313469950 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:59.045964 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:59.058879 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ca8be-4b44-4f89-8951-e76313469950 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:59.100548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782a96e-4b73-4e27-b453-fdb6a96aa892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:59.101479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782a96e-4b73-4e27-b453-fdb6a96aa892 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:59.101955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782a96e-4b73-4e27-b453-fdb6a96aa892 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:59.102328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782a96e-4b73-4e27-b453-fdb6a96aa892 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:59.103340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782a96e-4b73-4e27-b453-fdb6a96aa892 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:59.103724 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782a96e-4b73-4e27-b453-fdb6a96aa892 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:59.105389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782a96e-4b73-4e27-b453-fdb6a96aa892 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:59.116819 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 616/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:29:59.122659 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af199fa-0544-4e62-9fbc-7be1a0cc7786 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:59.241205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af199fa-0544-4e62-9fbc-7be1a0cc7786 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:59.279676 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e48a5-b989-4eb5-b6da-53aeaf4b51a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:59.280486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e48a5-b989-4eb5-b6da-53aeaf4b51a9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:59.280757 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e48a5-b989-4eb5-b6da-53aeaf4b51a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:59.281020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e48a5-b989-4eb5-b6da-53aeaf4b51a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:59.288872 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e48a5-b989-4eb5-b6da-53aeaf4b51a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:59.290596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e48a5-b989-4eb5-b6da-53aeaf4b51a9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:59.306597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-8a3e48a5-b989-4eb5-b6da-53aeaf4b51a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:29:59.306597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:29:59.306597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:29:59.306597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:29:59.306597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:29:59.306597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:29:59.306597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:29:59.306597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:29:59.306597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:29:59.306597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:29:59.306597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:29:59.306597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:29:59.306597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:29:59.306597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:29:59.306597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:29:59.307923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:29:59.307923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:29:59.307923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:29:59.307923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:29:59.307923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:29:59.307923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:29:59.307923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:29:59.307923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:29:59.307923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:29:59.307923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:29:59.307923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:29:59.307923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:29:59.307923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:29:59.307923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:29:59.307923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:29:59.307923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:29:59.307923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:29:59.308850 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:29:59.308850 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:29:59.308850 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:29:59.308850 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:29:59.308850 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:29:59.308850 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:29:59.308850 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:29:59.308850 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:29:59.308850 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 642/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:29:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:29:59.314295 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782a96e-4b73-4e27-b453-fdb6a96aa892 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:59.421131 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782a96e-4b73-4e27-b453-fdb6a96aa892 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:59.457724 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc706e-0f96-4553-99db-87c545506015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:59.458428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc706e-0f96-4553-99db-87c545506015 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:59.458736 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc706e-0f96-4553-99db-87c545506015 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:59.459024 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc706e-0f96-4553-99db-87c545506015 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:59.459805 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc706e-0f96-4553-99db-87c545506015 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:59.460163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc706e-0f96-4553-99db-87c545506015 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:59.461588 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc706e-0f96-4553-99db-87c545506015 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:59.474151 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 617/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:29:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:29:59.482200 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e48a5-b989-4eb5-b6da-53aeaf4b51a9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:59.511446 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:59.590075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e48a5-b989-4eb5-b6da-53aeaf4b51a9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:59.626087 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188b084-0073-4240-911f-fba230ad7017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:59.626784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188b084-0073-4240-911f-fba230ad7017 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:59.627092 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188b084-0073-4240-911f-fba230ad7017 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:59.627355 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188b084-0073-4240-911f-fba230ad7017 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:59.628300 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188b084-0073-4240-911f-fba230ad7017 None admin] RBAC: Adding query filter params (role.id=6edd584a77084fa78240661ea76cddb5, scope.project.id=af45a1ec7c94408bb638c55fb43fa961, user.id=2f7ea9741a5d409d87b8ebb4390a74ef) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:59.628635 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188b084-0073-4240-911f-fba230ad7017 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:59.630305 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188b084-0073-4240-911f-fba230ad7017 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:59.638874 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 643/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:29:59 2022] GET /identity/v3/role_assignments?user.id=2f7ea9741a5d409d87b8ebb4390a74ef&scope.project.id=af45a1ec7c94408bb638c55fb43fa961&role.id=6edd584a77084fa78240661ea76cddb5 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:30:01.897826 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebdd71-ae4a-4634-afd2-8c463e7907ea None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:01.898409 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebdd71-ae4a-4634-afd2-8c463e7907ea None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:01.898616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebdd71-ae4a-4634-afd2-8c463e7907ea None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:01.900041 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 618/1261] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:30:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:30:01.906391 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c2fb6-836f-4545-a514-b106d2a49f74 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:01.907147 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c2fb6-836f-4545-a514-b106d2a49f74 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:01.907290 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c2fb6-836f-4545-a514-b106d2a49f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:01.935578 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ce4c2fb6-836f-4545-a514-b106d2a49f74 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:30:01.937481 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ce4c2fb6-836f-4545-a514-b106d2a49f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:02.015577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 644/1262] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:30:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:30:02.039267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebdd71-ae4a-4634-afd2-8c463e7907ea None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:02.051419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:02.164431 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebdd71-ae4a-4634-afd2-8c463e7907ea None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:02.208705 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b64304-b747-4f2e-b05a-a9bdc5d80112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:02.209884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b64304-b747-4f2e-b05a-a9bdc5d80112 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:02.210288 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b64304-b747-4f2e-b05a-a9bdc5d80112 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:02.210732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b64304-b747-4f2e-b05a-a9bdc5d80112 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:02.221881 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b64304-b747-4f2e-b05a-a9bdc5d80112 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:30:02.229567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-50b64304-b747-4f2e-b05a-a9bdc5d80112 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:30:02.229567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:30:02.229567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:30:02.229567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:30:02.229567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:30:02.229567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:30:02.229567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:30:02.229567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:30:02.229567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:30:02.229567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:30:02.229567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:30:02.229567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:30:02.229567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:30:02.229567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:30:02.229567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:30:02.229567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:30:02.230723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:30:02.230723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:30:02.230723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:30:02.230723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:30:02.230723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:30:02.230723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:30:02.230723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:30:02.230723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:30:02.230723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:30:02.230723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:30:02.230723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:30:02.230723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:30:02.230723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:30:02.230723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:30:02.230723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:30:02.230723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:30:02.231747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:30:02.231747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:30:02.231747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:30:02.231747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:30:02.231747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:30:02.231747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:30:02.231747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:30:02.231747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:30:02.231747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:30:02.231747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:30:02.231747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:30:02.231747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:30:02.231747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 619/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:30:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:30:02.237322 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c2fb6-836f-4545-a514-b106d2a49f74 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:02.256202 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:02.339339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c2fb6-836f-4545-a514-b106d2a49f74 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:02.377853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b109c-1331-4d95-bff9-ec0724372b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:02.378524 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b109c-1331-4d95-bff9-ec0724372b2d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:02.378829 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b109c-1331-4d95-bff9-ec0724372b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:02.379093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b109c-1331-4d95-bff9-ec0724372b2d None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:02.379835 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b109c-1331-4d95-bff9-ec0724372b2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:30:02.380136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b109c-1331-4d95-bff9-ec0724372b2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:02.381499 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b109c-1331-4d95-bff9-ec0724372b2d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:02.390840 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 645/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:30:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:30:02.397606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b64304-b747-4f2e-b05a-a9bdc5d80112 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:02.470835 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:02.507130 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b64304-b747-4f2e-b05a-a9bdc5d80112 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:02.543848 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2823f97-1227-4741-b1e1-feec5ce18b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:02.544642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2823f97-1227-4741-b1e1-feec5ce18b5c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:02.544917 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2823f97-1227-4741-b1e1-feec5ce18b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:02.545182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2823f97-1227-4741-b1e1-feec5ce18b5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:02.555862 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2823f97-1227-4741-b1e1-feec5ce18b5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:02.557303 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2823f97-1227-4741-b1e1-feec5ce18b5c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:02.574313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-a2823f97-1227-4741-b1e1-feec5ce18b5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:30:02.574313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:30:02.574313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:30:02.574313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:30:02.574313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:30:02.574313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:30:02.574313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:30:02.574313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:30:02.574313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:30:02.574313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:30:02.574313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:30:02.574313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:30:02.574313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:30:02.574313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:30:02.574313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:30:02.575405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:30:02.575405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:30:02.575405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:30:02.575405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:30:02.575405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:30:02.575405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:30:02.575405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:30:02.575405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:30:02.575405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:30:02.575405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:30:02.575405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:30:02.575405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:30:02.575405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:30:02.575405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:30:02.575405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:30:02.575405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:30:02.575405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:30:02.576531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:30:02.576531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:30:02.576531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:30:02.576531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:30:02.576531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 620/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:30:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:30:02.582352 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b109c-1331-4d95-bff9-ec0724372b2d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:02.677651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:02.699362 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b109c-1331-4d95-bff9-ec0724372b2d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:02.734741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301e91c-1788-49c1-b268-959bcced0a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:02.735335 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301e91c-1788-49c1-b268-959bcced0a4b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:02.735611 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301e91c-1788-49c1-b268-959bcced0a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:02.735882 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301e91c-1788-49c1-b268-959bcced0a4b None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:02.736593 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301e91c-1788-49c1-b268-959bcced0a4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:30:02.736891 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301e91c-1788-49c1-b268-959bcced0a4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:02.738263 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301e91c-1788-49c1-b268-959bcced0a4b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:02.750120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 646/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:30:02.756632 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2823f97-1227-4741-b1e1-feec5ce18b5c None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:02.860087 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2823f97-1227-4741-b1e1-feec5ce18b5c None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:02.880132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:02.896565 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062730e-5d39-47f0-bc40-56f2f8b09d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:02.897361 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062730e-5d39-47f0-bc40-56f2f8b09d4a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:02.897641 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062730e-5d39-47f0-bc40-56f2f8b09d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:02.897930 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062730e-5d39-47f0-bc40-56f2f8b09d4a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:02.906443 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062730e-5d39-47f0-bc40-56f2f8b09d4a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:02.907904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062730e-5d39-47f0-bc40-56f2f8b09d4a None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:02.921919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-8062730e-5d39-47f0-bc40-56f2f8b09d4a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:30:02.921919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:30:02.921919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:30:02.921919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:30:02.921919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:30:02.921919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:30:02.921919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:30:02.921919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:30:02.921919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:30:02.921919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:30:02.921919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:30:02.921919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:30:02.921919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:30:02.921919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:30:02.921919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:30:02.921919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:30:02.923147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:30:02.923147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:30:02.923147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:30:02.923147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:30:02.923147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:30:02.923147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:30:02.923147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:30:02.923147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:30:02.923147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:30:02.923147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:30:02.923147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:30:02.923147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:30:02.923147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:30:02.923147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:30:02.923147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:30:02.923147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:30:02.923147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:30:02.923147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:30:02.924347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:30:02.924347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:30:02.924347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:30:02.924347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:30:02.924347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:30:02.924347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:30:02.924347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:30:02.924347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:30:02.924347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:30:02.924347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:30:02.924347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 621/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:30:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:30:02.929072 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301e91c-1788-49c1-b268-959bcced0a4b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:03.033140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301e91c-1788-49c1-b268-959bcced0a4b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:03.069291 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ace8dd-e07a-485e-b9ab-8e05c3b2d1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:03.069949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ace8dd-e07a-485e-b9ab-8e05c3b2d1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:03.070220 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ace8dd-e07a-485e-b9ab-8e05c3b2d1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:03.070510 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ace8dd-e07a-485e-b9ab-8e05c3b2d1d1 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:03.071364 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ace8dd-e07a-485e-b9ab-8e05c3b2d1d1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:30:03.071667 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ace8dd-e07a-485e-b9ab-8e05c3b2d1d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:03.073074 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ace8dd-e07a-485e-b9ab-8e05c3b2d1d1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:03.086148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:03.094744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 647/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Jun 2 13:30:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:30:03.100527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062730e-5d39-47f0-bc40-56f2f8b09d4a None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:03.219251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062730e-5d39-47f0-bc40-56f2f8b09d4a None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:03.254511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f257507-563b-4ffb-abfc-031f45a548dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:03.255332 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f257507-563b-4ffb-abfc-031f45a548dd None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:03.255609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f257507-563b-4ffb-abfc-031f45a548dd None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:03.255875 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f257507-563b-4ffb-abfc-031f45a548dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:03.267341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f257507-563b-4ffb-abfc-031f45a548dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:03.268770 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f257507-563b-4ffb-abfc-031f45a548dd None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:03.287329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-6f257507-563b-4ffb-abfc-031f45a548dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:30:03.287329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:30:03.287329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:30:03.287329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:30:03.287329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:30:03.287329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:30:03.287329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:30:03.287329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:30:03.287329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:30:03.287329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:30:03.287329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:30:03.287329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:30:03.287329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:30:03.287329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:30:03.287329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:30:03.288340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:30:03.288340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:30:03.288340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:30:03.288340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:30:03.288340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:30:03.288340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:30:03.288340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:30:03.288340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:30:03.288340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:30:03.288340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:30:03.288340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:30:03.288340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:30:03.288340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:30:03.288340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:30:03.288340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:30:03.288340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:30:03.288340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:30:03.290318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:30:03.290318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:30:03.290318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:30:03.290318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:30:03.290318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 622/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:30:03.298075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ace8dd-e07a-485e-b9ab-8e05c3b2d1d1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:03.424705 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ace8dd-e07a-485e-b9ab-8e05c3b2d1d1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:03.468779 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3dd893-fe14-42be-a6ed-1364585dad4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:03.469641 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3dd893-fe14-42be-a6ed-1364585dad4e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:03.470027 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3dd893-fe14-42be-a6ed-1364585dad4e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:03.470494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3dd893-fe14-42be-a6ed-1364585dad4e None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:03.471473 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3dd893-fe14-42be-a6ed-1364585dad4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:30:03.471831 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3dd893-fe14-42be-a6ed-1364585dad4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:03.473455 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3dd893-fe14-42be-a6ed-1364585dad4e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:03.487047 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 648/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:30:03.492979 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f257507-563b-4ffb-abfc-031f45a548dd None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:03.527746 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:03.598770 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f257507-563b-4ffb-abfc-031f45a548dd None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:03.633556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e5012-d267-4f94-95ed-ce55dff5af5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:03.634351 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e5012-d267-4f94-95ed-ce55dff5af5d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:03.634653 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e5012-d267-4f94-95ed-ce55dff5af5d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:03.634927 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e5012-d267-4f94-95ed-ce55dff5af5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:03.641843 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e5012-d267-4f94-95ed-ce55dff5af5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:03.643309 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e5012-d267-4f94-95ed-ce55dff5af5d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:03.657645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-a13e5012-d267-4f94-95ed-ce55dff5af5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:30:03.657645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:30:03.657645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:30:03.657645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:30:03.657645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:30:03.657645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:30:03.657645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:30:03.657645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:30:03.657645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:30:03.657645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:30:03.657645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:30:03.657645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:30:03.657645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:30:03.657645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:30:03.657645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:30:03.658642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:30:03.658642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:30:03.658642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:30:03.658642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:30:03.658642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:30:03.658642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:30:03.658642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:30:03.658642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:30:03.658642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:30:03.658642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:30:03.658642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:30:03.658642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:30:03.658642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:30:03.658642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:30:03.658642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:30:03.658642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:30:03.658642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:30:03.659864 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:30:03.659864 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:30:03.659864 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:30:03.659864 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:30:03.659864 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:30:03.659864 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:30:03.659864 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:30:03.659864 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:30:03.659864 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 623/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:30:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:30:03.667563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3dd893-fe14-42be-a6ed-1364585dad4e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:03.734516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:03.780666 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3dd893-fe14-42be-a6ed-1364585dad4e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:03.817095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ccd5f-430e-41b7-a916-f90c57c35c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:03.817751 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ccd5f-430e-41b7-a916-f90c57c35c25 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:03.818022 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ccd5f-430e-41b7-a916-f90c57c35c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:03.818285 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ccd5f-430e-41b7-a916-f90c57c35c25 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:03.819101 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ccd5f-430e-41b7-a916-f90c57c35c25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:30:03.819459 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ccd5f-430e-41b7-a916-f90c57c35c25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:03.821027 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ccd5f-430e-41b7-a916-f90c57c35c25 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:03.832603 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 649/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:30:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:30:03.839799 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e5012-d267-4f94-95ed-ce55dff5af5d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:03.946774 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:03.956704 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e5012-d267-4f94-95ed-ce55dff5af5d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:03.991846 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4246c6-47c4-40b6-941b-dc9d516c7d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:03.992846 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4246c6-47c4-40b6-941b-dc9d516c7d96 None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:03.993123 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4246c6-47c4-40b6-941b-dc9d516c7d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:03.993393 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4246c6-47c4-40b6-941b-dc9d516c7d96 None admin] PATH_INFO: `/v3/projects/af45a1ec7c94408bb638c55fb43fa961/users/2f7ea9741a5d409d87b8ebb4390a74ef/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:03.995469 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4246c6-47c4-40b6-941b-dc9d516c7d96 None admin] RBAC: Authorizing `identity:create_grant(project_id=af45a1ec7c94408bb638c55fb43fa961, user_id=2f7ea9741a5d409d87b8ebb4390a74ef, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:03.996893 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4246c6-47c4-40b6-941b-dc9d516c7d96 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:04.018341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 624/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 13:30:03 2022] PUT /identity/v3/projects/af45a1ec7c94408bb638c55fb43fa961/users/2f7ea9741a5d409d87b8ebb4390a74ef/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:30:06.307626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d78a36-41a6-462a-81d5-9142d3b774b6 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:06.308501 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d78a36-41a6-462a-81d5-9142d3b774b6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:06.308501 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d78a36-41a6-462a-81d5-9142d3b774b6 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:06.310628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 650/1274] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:30:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:30:06.316098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72974153-a1fe-4768-a7c4-5647e4b02c4a None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:06.316509 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72974153-a1fe-4768-a7c4-5647e4b02c4a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:06.316631 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72974153-a1fe-4768-a7c4-5647e4b02c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:06.334391 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-72974153-a1fe-4768-a7c4-5647e4b02c4a None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:30:06.335767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-72974153-a1fe-4768-a7c4-5647e4b02c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:06.404970 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 625/1275] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:30:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:30:06.428680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d78a36-41a6-462a-81d5-9142d3b774b6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:06.556966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d78a36-41a6-462a-81d5-9142d3b774b6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:06.576079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:06.594526 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b22f0-08a4-49ac-ac7f-0ddda4b9d335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:06.595364 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b22f0-08a4-49ac-ac7f-0ddda4b9d335 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:06.595643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b22f0-08a4-49ac-ac7f-0ddda4b9d335 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:06.595921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b22f0-08a4-49ac-ac7f-0ddda4b9d335 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:06.606433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b22f0-08a4-49ac-ac7f-0ddda4b9d335 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:30:06.613938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-bb5b22f0-08a4-49ac-ac7f-0ddda4b9d335 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:30:06.613938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:30:06.613938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:30:06.613938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:30:06.613938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:30:06.613938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:30:06.613938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:30:06.613938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:30:06.613938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:30:06.613938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:30:06.613938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:30:06.613938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:30:06.613938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:30:06.613938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:30:06.613938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:30:06.613938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:30:06.615010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:30:06.615010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:30:06.615010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:30:06.615010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:30:06.615010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:30:06.615010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:30:06.615010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:30:06.615010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:30:06.615010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:30:06.615010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:30:06.615010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:30:06.615010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:30:06.615010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:30:06.615010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:30:06.615010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:30:06.615010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:30:06.615862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:30:06.615862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:30:06.615862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:30:06.615862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:30:06.615862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:30:06.615862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:30:06.615862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:30:06.615862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:30:06.615862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:30:06.615862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:30:06.615862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:30:06.615862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:30:06.615862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 651/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 13:30:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:30:06.623728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72974153-a1fe-4768-a7c4-5647e4b02c4a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:06.707715 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:06.734882 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72974153-a1fe-4768-a7c4-5647e4b02c4a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:06.772359 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b4956-3acd-42b2-87a1-61b4c0f1e122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:06.773152 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b4956-3acd-42b2-87a1-61b4c0f1e122 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:06.773419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b4956-3acd-42b2-87a1-61b4c0f1e122 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:06.773664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b4956-3acd-42b2-87a1-61b4c0f1e122 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:06.774404 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b4956-3acd-42b2-87a1-61b4c0f1e122 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:30:06.774736 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b4956-3acd-42b2-87a1-61b4c0f1e122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:06.776090 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b4956-3acd-42b2-87a1-61b4c0f1e122 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:06.784185 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 626/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 13:30:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:30:06.790432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b22f0-08a4-49ac-ac7f-0ddda4b9d335 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:06.898688 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b22f0-08a4-49ac-ac7f-0ddda4b9d335 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:06.935397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262f74d-8ff5-4c16-87ab-8bb20a28f330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:06.936177 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262f74d-8ff5-4c16-87ab-8bb20a28f330 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:06.936452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262f74d-8ff5-4c16-87ab-8bb20a28f330 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:06.936703 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262f74d-8ff5-4c16-87ab-8bb20a28f330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:06.948436 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262f74d-8ff5-4c16-87ab-8bb20a28f330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:06.949901 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262f74d-8ff5-4c16-87ab-8bb20a28f330 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:06.967268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-4262f74d-8ff5-4c16-87ab-8bb20a28f330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:30:06.967268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:30:06.967268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:30:06.967268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:30:06.967268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:30:06.967268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:30:06.967268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:30:06.967268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:30:06.967268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:30:06.967268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:30:06.967268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:30:06.967268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:30:06.967268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:30:06.967268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:30:06.967268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:30:06.968295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:30:06.968295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:30:06.968295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:30:06.968295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:30:06.968295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:30:06.968295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:30:06.968295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:30:06.968295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:30:06.968295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:30:06.968295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:30:06.968295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:30:06.968295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:30:06.968295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:30:06.968295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:30:06.968295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:30:06.968295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:30:06.968295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:30:06.969601 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:30:06.969601 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:30:06.969601 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:30:06.969601 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:30:06.969601 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 652/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:30:06.977304 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b4956-3acd-42b2-87a1-61b4c0f1e122 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:07.082069 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b4956-3acd-42b2-87a1-61b4c0f1e122 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:07.122864 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a6d5d-b291-4080-8215-b16f26cf80d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:07.123522 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a6d5d-b291-4080-8215-b16f26cf80d5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:07.123794 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a6d5d-b291-4080-8215-b16f26cf80d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:07.124062 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a6d5d-b291-4080-8215-b16f26cf80d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:07.124781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a6d5d-b291-4080-8215-b16f26cf80d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:30:07.125079 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a6d5d-b291-4080-8215-b16f26cf80d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:07.126436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a6d5d-b291-4080-8215-b16f26cf80d5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:07.138912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 627/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:30:07.145150 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262f74d-8ff5-4c16-87ab-8bb20a28f330 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:07.178151 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:07.248644 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262f74d-8ff5-4c16-87ab-8bb20a28f330 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:07.283654 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93696092-9696-4d2a-9ac3-07ef9f60f7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:07.284445 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93696092-9696-4d2a-9ac3-07ef9f60f7ae None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:07.284714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93696092-9696-4d2a-9ac3-07ef9f60f7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:07.284973 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93696092-9696-4d2a-9ac3-07ef9f60f7ae None admin] PATH_INFO: `/v3/users/placement` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:07.292716 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93696092-9696-4d2a-9ac3-07ef9f60f7ae None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:07.294149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93696092-9696-4d2a-9ac3-07ef9f60f7ae None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:07.308743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-93696092-9696-4d2a-9ac3-07ef9f60f7ae None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:30:07.308743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:30:07.308743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:30:07.308743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:30:07.308743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:30:07.308743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:30:07.308743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:30:07.308743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:30:07.308743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:30:07.308743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:30:07.308743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:30:07.308743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:30:07.308743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:30:07.308743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:30:07.308743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:30:07.308743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:30:07.310452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:30:07.310452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:30:07.310452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:30:07.310452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:30:07.310452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:30:07.310452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:30:07.310452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:30:07.310452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:30:07.310452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:30:07.310452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:30:07.310452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:30:07.310452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:30:07.310452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:30:07.310452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:30:07.310452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:30:07.310452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:30:07.310452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:30:07.310452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:30:07.312118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:30:07.312118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:30:07.312118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:30:07.312118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:30:07.312118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:30:07.312118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:30:07.312118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:30:07.312118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:30:07.312118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:30:07.312118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:30:07.312118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 653/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:30:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:30:07.319335 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a6d5d-b291-4080-8215-b16f26cf80d5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:07.324851 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:07.436659 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a6d5d-b291-4080-8215-b16f26cf80d5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:07.475975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7a241-deb9-4404-83fc-66ddedd69808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:07.476641 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7a241-deb9-4404-83fc-66ddedd69808 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:07.476921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7a241-deb9-4404-83fc-66ddedd69808 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:07.477195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7a241-deb9-4404-83fc-66ddedd69808 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:07.478018 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7a241-deb9-4404-83fc-66ddedd69808 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:30:07.478324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7a241-deb9-4404-83fc-66ddedd69808 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:07.479784 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7a241-deb9-4404-83fc-66ddedd69808 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:07.496650 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 628/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Jun 2 13:30:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:30:07.502597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93696092-9696-4d2a-9ac3-07ef9f60f7ae None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:07.608336 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:07.620539 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93696092-9696-4d2a-9ac3-07ef9f60f7ae None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:07.659378 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770c4a2-e9cf-446a-b30c-5d36c01b9b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:07.660035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770c4a2-e9cf-446a-b30c-5d36c01b9b74 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:07.660315 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770c4a2-e9cf-446a-b30c-5d36c01b9b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:07.660589 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770c4a2-e9cf-446a-b30c-5d36c01b9b74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:07.732314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770c4a2-e9cf-446a-b30c-5d36c01b9b74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:07.733692 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770c4a2-e9cf-446a-b30c-5d36c01b9b74 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:07.824005 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:07.834609 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 654/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 13:30:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:30:07.844631 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7a241-deb9-4404-83fc-66ddedd69808 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:07.930688 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:07.979026 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7a241-deb9-4404-83fc-66ddedd69808 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:08.014892 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd1464-fd91-4764-ba4d-016196325c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:08.015624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd1464-fd91-4764-ba4d-016196325c54 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:08.015904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd1464-fd91-4764-ba4d-016196325c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:08.016175 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd1464-fd91-4764-ba4d-016196325c54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:08.027656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd1464-fd91-4764-ba4d-016196325c54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:08.029091 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd1464-fd91-4764-ba4d-016196325c54 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:08.047324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-49bd1464-fd91-4764-ba4d-016196325c54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:30:08.047324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:30:08.047324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:30:08.047324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:30:08.047324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:30:08.047324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:30:08.047324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:30:08.047324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:30:08.047324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:30:08.047324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:30:08.047324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:30:08.047324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:30:08.047324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:30:08.047324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:30:08.047324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:30:08.048368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:30:08.048368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:30:08.048368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:30:08.048368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:30:08.048368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:30:08.048368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:30:08.048368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:30:08.048368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:30:08.048368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:30:08.048368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:30:08.048368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:30:08.048368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:30:08.048368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:30:08.048368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:30:08.048368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:30:08.048368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:30:08.048368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:30:08.049330 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:30:08.049330 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:30:08.049330 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:30:08.049330 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:30:08.049330 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 629/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:30:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:30:08.054504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770c4a2-e9cf-446a-b30c-5d36c01b9b74 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:08.171130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770c4a2-e9cf-446a-b30c-5d36c01b9b74 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:08.206458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611e3c1-5529-41a9-ad46-c0482a0f5c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:08.207145 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611e3c1-5529-41a9-ad46-c0482a0f5c55 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:08.207421 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611e3c1-5529-41a9-ad46-c0482a0f5c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:08.207688 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611e3c1-5529-41a9-ad46-c0482a0f5c55 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:08.208404 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611e3c1-5529-41a9-ad46-c0482a0f5c55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:30:08.208703 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611e3c1-5529-41a9-ad46-c0482a0f5c55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:08.210062 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611e3c1-5529-41a9-ad46-c0482a0f5c55 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:08.222293 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 655/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 13:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:30:08.228494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd1464-fd91-4764-ba4d-016196325c54 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:08.344494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd1464-fd91-4764-ba4d-016196325c54 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:08.359079 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:08.382772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bc8f2-6733-4dcd-a350-5fdb8da3d4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:08.383561 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bc8f2-6733-4dcd-a350-5fdb8da3d4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:08.383833 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bc8f2-6733-4dcd-a350-5fdb8da3d4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:08.384102 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bc8f2-6733-4dcd-a350-5fdb8da3d4b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:08.391612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481bc8f2-6733-4dcd-a350-5fdb8da3d4b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:08.393045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481bc8f2-6733-4dcd-a350-5fdb8da3d4b7 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:08.407401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-481bc8f2-6733-4dcd-a350-5fdb8da3d4b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:30:08.407401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:30:08.407401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:30:08.407401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:30:08.407401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:30:08.407401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:30:08.407401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:30:08.407401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:30:08.407401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:30:08.407401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:30:08.407401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:30:08.407401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:30:08.407401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:30:08.407401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:30:08.407401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:30:08.408483 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:30:08.408483 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:30:08.408483 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:30:08.408483 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:30:08.408483 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:30:08.408483 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:30:08.408483 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:30:08.408483 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:30:08.408483 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jun 02 13:30:08.408483 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:30:08.408483 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:30:08.408483 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:30:08.408483 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:30:08.408483 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:30:08.408483 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:30:08.408483 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:30:08.408483 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:30:08.409573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:30:08.409573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:30:08.409573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:30:08.409573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:30:08.409573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:30:08.409573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:30:08.409573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:30:08.409573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jun 02 13:30:08.409573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 630/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 13:30:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:30:08.415064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611e3c1-5529-41a9-ad46-c0482a0f5c55 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:08.471664 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:08.539897 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611e3c1-5529-41a9-ad46-c0482a0f5c55 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:08.583221 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec54614-d9cb-45cc-a67a-db803889b0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:08.583882 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec54614-d9cb-45cc-a67a-db803889b0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:08.584159 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec54614-d9cb-45cc-a67a-db803889b0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:08.584430 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec54614-d9cb-45cc-a67a-db803889b0b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:08.585377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec54614-d9cb-45cc-a67a-db803889b0b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:30:08.585705 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec54614-d9cb-45cc-a67a-db803889b0b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:08.587166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec54614-d9cb-45cc-a67a-db803889b0b6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:08.599895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 656/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 13:30:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:30:08.609216 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bc8f2-6733-4dcd-a350-5fdb8da3d4b7 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:08.718427 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bc8f2-6733-4dcd-a350-5fdb8da3d4b7 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:08.754138 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28feab-5f0b-4ae7-a4a4-93be015f0e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:08.754818 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28feab-5f0b-4ae7-a4a4-93be015f0e57 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:08.755102 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28feab-5f0b-4ae7-a4a4-93be015f0e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:08.755382 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28feab-5f0b-4ae7-a4a4-93be015f0e57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:08.756206 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28feab-5f0b-4ae7-a4a4-93be015f0e57 None admin] RBAC: Adding query filter params (role.id=6edd584a77084fa78240661ea76cddb5, scope.project.id=af45a1ec7c94408bb638c55fb43fa961, user.id=2f7ea9741a5d409d87b8ebb4390a74ef) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:30:08.756520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28feab-5f0b-4ae7-a4a4-93be015f0e57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:08.758458 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28feab-5f0b-4ae7-a4a4-93be015f0e57 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:08.764650 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 631/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 13:30:08 2022] GET /identity/v3/role_assignments?user.id=2f7ea9741a5d409d87b8ebb4390a74ef&scope.project.id=af45a1ec7c94408bb638c55fb43fa961&role.id=6edd584a77084fa78240661ea76cddb5 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:30:10.998169 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f9116-7e3d-461c-91c6-34ee7bf4d636 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:10.998772 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f9116-7e3d-461c-91c6-34ee7bf4d636 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:10.998772 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f9116-7e3d-461c-91c6-34ee7bf4d636 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:11.000105 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 657/1288] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:30:11.006377 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065d91c-944f-41da-894a-fcbb9db17d68 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:11.006870 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065d91c-944f-41da-894a-fcbb9db17d68 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:11.007108 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065d91c-944f-41da-894a-fcbb9db17d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:11.026521 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-f065d91c-944f-41da-894a-fcbb9db17d68 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:30:11.027756 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f065d91c-944f-41da-894a-fcbb9db17d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:11.062637 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:11.104233 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 632/1289] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:30:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:30:11.132168 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f9116-7e3d-461c-91c6-34ee7bf4d636 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:11.242423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f9116-7e3d-461c-91c6-34ee7bf4d636 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:11.253262 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:11.286541 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457d0be-9e19-40b9-958c-f1debf8959b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:11.287376 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457d0be-9e19-40b9-958c-f1debf8959b9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:11.287651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457d0be-9e19-40b9-958c-f1debf8959b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:11.287921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457d0be-9e19-40b9-958c-f1debf8959b9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:11.288561 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457d0be-9e19-40b9-958c-f1debf8959b9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:11.289962 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457d0be-9e19-40b9-958c-f1debf8959b9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:11.302173 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-0457d0be-9e19-40b9-958c-f1debf8959b9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:30:11.302173 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:30:11.302173 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:30:11.302173 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:30:11.302173 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:30:11.302173 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:30:11.302173 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:30:11.302173 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:30:11.302173 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:30:11.302173 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:30:11.302173 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:30:11.302173 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:30:11.302173 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:30:11.302173 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:30:11.302173 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:30:11.302173 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:30:11.302173 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:30:11.303526 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:30:11.303526 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:30:11.303526 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:30:11.303526 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:30:11.303526 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:30:11.303526 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:30:11.303526 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:30:11.303526 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:30:11.303526 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:30:11.303526 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:30:11.303526 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:30:11.303526 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:30:11.303526 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:30:11.303526 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:30:11.303526 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:30:11.303526 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:30:11.305130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:30:11.305130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:30:11.305130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:30:11.305130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:30:11.305130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:30:11.305130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:30:11.305130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:30:11.305130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:30:11.305130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:30:11.305130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:30:11.305130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:30:11.305130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:30:11.305130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:30:11.305130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:30:11.305130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 658/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 2 13:30:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:30:11.310800 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065d91c-944f-41da-894a-fcbb9db17d68 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:11.425430 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065d91c-944f-41da-894a-fcbb9db17d68 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:11.468994 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47712036-bdee-4a07-907c-b15f40e6e723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:11.469795 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47712036-bdee-4a07-907c-b15f40e6e723 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:11.470055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47712036-bdee-4a07-907c-b15f40e6e723 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:11.470430 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47712036-bdee-4a07-907c-b15f40e6e723 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:11.471216 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47712036-bdee-4a07-907c-b15f40e6e723 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:30:11.471548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47712036-bdee-4a07-907c-b15f40e6e723 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:11.473096 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47712036-bdee-4a07-907c-b15f40e6e723 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:11.479479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 633/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Jun 2 13:30:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:30:11.485149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457d0be-9e19-40b9-958c-f1debf8959b9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:11.606801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457d0be-9e19-40b9-958c-f1debf8959b9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:11.643267 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a899e46-0b85-4cc1-8505-c08591a34c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:11.643952 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a899e46-0b85-4cc1-8505-c08591a34c9c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:11.644228 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a899e46-0b85-4cc1-8505-c08591a34c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:11.644496 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a899e46-0b85-4cc1-8505-c08591a34c9c None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:11.645206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a899e46-0b85-4cc1-8505-c08591a34c9c None admin] RBAC: Adding query filter params (type=placement) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:30:11.645871 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a899e46-0b85-4cc1-8505-c08591a34c9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:11.647268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a899e46-0b85-4cc1-8505-c08591a34c9c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:11.652047 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 659/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Jun 2 13:30:11 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:30:13.855409 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76864b2c-0673-4567-ba7c-f0d9cceffa3a None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:13.855989 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76864b2c-0673-4567-ba7c-f0d9cceffa3a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:13.855989 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76864b2c-0673-4567-ba7c-f0d9cceffa3a None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:13.858025 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 634/1293] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:30:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:30:13.866062 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd01e29-e202-4620-9738-d5c1c5aba249 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:13.866508 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd01e29-e202-4620-9738-d5c1c5aba249 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:13.866872 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd01e29-e202-4620-9738-d5c1c5aba249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:13.885353 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-9bd01e29-e202-4620-9738-d5c1c5aba249 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:30:13.886547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9bd01e29-e202-4620-9738-d5c1c5aba249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:13.917160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:13.967626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 660/1294] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:30:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:30:13.991075 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76864b2c-0673-4567-ba7c-f0d9cceffa3a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:14.023819 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:14.108561 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76864b2c-0673-4567-ba7c-f0d9cceffa3a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:14.143261 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90aad04-2dd2-451a-a340-0063485bc348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:14.143851 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90aad04-2dd2-451a-a340-0063485bc348 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:14.144132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90aad04-2dd2-451a-a340-0063485bc348 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:14.144368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90aad04-2dd2-451a-a340-0063485bc348 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:14.145109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90aad04-2dd2-451a-a340-0063485bc348 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:14.146854 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90aad04-2dd2-451a-a340-0063485bc348 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:14.164682 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 635/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 13:30:13 2022] POST /identity/v3/services => generated 246 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:30:16.384457 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5277b3e-eabb-4ec0-a253-2674485a9ddb None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:16.385328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5277b3e-eabb-4ec0-a253-2674485a9ddb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:16.385328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5277b3e-eabb-4ec0-a253-2674485a9ddb None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:16.387572 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 661/1296] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:30:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:30:16.396422 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b484ac9-daa0-497c-8899-029a2628bc93 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:16.396847 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b484ac9-daa0-497c-8899-029a2628bc93 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:16.396992 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b484ac9-daa0-497c-8899-029a2628bc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:16.415062 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-7b484ac9-daa0-497c-8899-029a2628bc93 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:30:16.416254 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7b484ac9-daa0-497c-8899-029a2628bc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:16.498965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 636/1297] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:30:16 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:30:16.522616 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5277b3e-eabb-4ec0-a253-2674485a9ddb None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:16.628134 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5277b3e-eabb-4ec0-a253-2674485a9ddb None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:16.670599 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ee5ae-2cfb-4de4-9be8-94594b1ad448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:16.671453 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ee5ae-2cfb-4de4-9be8-94594b1ad448 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:16.671721 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ee5ae-2cfb-4de4-9be8-94594b1ad448 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:16.671983 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ee5ae-2cfb-4de4-9be8-94594b1ad448 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:16.672636 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ee5ae-2cfb-4de4-9be8-94594b1ad448 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:16.674006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ee5ae-2cfb-4de4-9be8-94594b1ad448 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:16.685976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-a63ee5ae-2cfb-4de4-9be8-94594b1ad448 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:30:16.685976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:30:16.685976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:30:16.685976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:30:16.685976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:30:16.685976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:30:16.685976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:30:16.685976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:30:16.685976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:30:16.685976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:30:16.685976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:30:16.685976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:30:16.685976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:30:16.685976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:30:16.685976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:30:16.685976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:30:16.685976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:30:16.687230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:30:16.687230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:30:16.687230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:30:16.687230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:30:16.687230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:30:16.687230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:30:16.687230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:30:16.687230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:30:16.687230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:30:16.687230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:30:16.687230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:30:16.687230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:30:16.687230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:30:16.687230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:30:16.687230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:30:16.687230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:30:16.688280 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:30:16.688280 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:30:16.688280 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:30:16.688280 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:30:16.688280 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:30:16.688280 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:30:16.688280 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:30:16.688280 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:30:16.688280 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:30:16.688280 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:30:16.688280 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:30:16.688280 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:30:16.688280 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:30:16.688280 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:30:16.688280 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 662/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 2 13:30:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:30:16.695561 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b484ac9-daa0-497c-8899-029a2628bc93 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:16.715914 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:16.803460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b484ac9-daa0-497c-8899-029a2628bc93 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:16.840271 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c41808-c269-4227-af97-fee532fcbad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:16.840928 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c41808-c269-4227-af97-fee532fcbad2 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:16.841212 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c41808-c269-4227-af97-fee532fcbad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:16.841484 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c41808-c269-4227-af97-fee532fcbad2 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:16.842185 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c41808-c269-4227-af97-fee532fcbad2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:30:16.842488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c41808-c269-4227-af97-fee532fcbad2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:16.843891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c41808-c269-4227-af97-fee532fcbad2 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:16.849346 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 637/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Jun 2 13:30:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:30:16.856830 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ee5ae-2cfb-4de4-9be8-94594b1ad448 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:16.902239 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:16.976422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ee5ae-2cfb-4de4-9be8-94594b1ad448 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:17.018365 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b63f5c-6d46-4d7b-b5fb-673f5b809105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:17.019053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b63f5c-6d46-4d7b-b5fb-673f5b809105 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:17.019332 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b63f5c-6d46-4d7b-b5fb-673f5b809105 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:17.019596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b63f5c-6d46-4d7b-b5fb-673f5b809105 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:17.020738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b63f5c-6d46-4d7b-b5fb-673f5b809105 None admin] RBAC: Adding query filter params (interface=public, service_id=d44da463184c49569adfcb784f18a676, region_id=RegionOne) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:30:17.021039 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b63f5c-6d46-4d7b-b5fb-673f5b809105 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:17.022399 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b63f5c-6d46-4d7b-b5fb-673f5b809105 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:17.027733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 663/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jun 2 13:30:16 2022] GET /identity/v3/endpoints?service_id=d44da463184c49569adfcb784f18a676&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:30:17.036121 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c41808-c269-4227-af97-fee532fcbad2 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:17.133538 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:17.153110 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c41808-c269-4227-af97-fee532fcbad2 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:17.188341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fac1c-c2b1-4feb-8b26-d47c35354e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:17.188999 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fac1c-c2b1-4feb-8b26-d47c35354e01 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:17.189278 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fac1c-c2b1-4feb-8b26-d47c35354e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:17.189549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fac1c-c2b1-4feb-8b26-d47c35354e01 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:17.190228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fac1c-c2b1-4feb-8b26-d47c35354e01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:17.191615 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fac1c-c2b1-4feb-8b26-d47c35354e01 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:17.198614 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 638/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 2 13:30:17 2022] GET /identity/v3/services => generated 2191 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:30:19.406273 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a398a-b4fa-4734-aa55-c7cebbaf2921 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:19.406908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a398a-b4fa-4734-aa55-c7cebbaf2921 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:19.406908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a398a-b4fa-4734-aa55-c7cebbaf2921 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:19.408834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 664/1302] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:30:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:30:19.414163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79c27d-8102-455d-af94-ee29bf3778be None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:19.414617 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79c27d-8102-455d-af94-ee29bf3778be None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:19.414722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79c27d-8102-455d-af94-ee29bf3778be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:19.433949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-6d79c27d-8102-455d-af94-ee29bf3778be None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:30:19.435158 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6d79c27d-8102-455d-af94-ee29bf3778be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:19.503394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 639/1303] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:30:19 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:30:19.528007 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a398a-b4fa-4734-aa55-c7cebbaf2921 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:19.639903 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:19.648885 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a398a-b4fa-4734-aa55-c7cebbaf2921 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:19.687818 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf7789-3146-46c1-836c-b0bf39e44df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:19.688660 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf7789-3146-46c1-836c-b0bf39e44df9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:19.688940 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf7789-3146-46c1-836c-b0bf39e44df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:19.689212 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf7789-3146-46c1-836c-b0bf39e44df9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:19.689865 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf7789-3146-46c1-836c-b0bf39e44df9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:19.691255 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf7789-3146-46c1-836c-b0bf39e44df9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:19.705035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-03cf7789-3146-46c1-836c-b0bf39e44df9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:30:19.705035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:30:19.705035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:30:19.705035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:30:19.705035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:30:19.705035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:30:19.705035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:30:19.705035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:30:19.705035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:30:19.705035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:30:19.705035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:30:19.705035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:30:19.705035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:30:19.705035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:30:19.705035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:30:19.705035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:30:19.705035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:30:19.706314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:30:19.706314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:30:19.706314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:30:19.706314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:30:19.706314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:30:19.706314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:30:19.706314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:30:19.706314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:30:19.706314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:30:19.706314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:30:19.706314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:30:19.706314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:30:19.706314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:30:19.706314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:30:19.706314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:30:19.706314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:30:19.708328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:30:19.708328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jun 02 13:30:19.708328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:30:19.708328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:30:19.708328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:30:19.708328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:30:19.708328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:30:19.708328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:30:19.708328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:30:19.708328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:30:19.708328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:30:19.708328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:30:19.708328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:30:19.708328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jun 02 13:30:19.708328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 665/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 2 13:30:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:30:19.714635 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79c27d-8102-455d-af94-ee29bf3778be None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:19.798553 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:19.822008 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79c27d-8102-455d-af94-ee29bf3778be None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:19.860051 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc1a52-e763-4239-8e3a-5100425e2424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:19.860705 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc1a52-e763-4239-8e3a-5100425e2424 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:19.860984 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc1a52-e763-4239-8e3a-5100425e2424 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:19.861253 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc1a52-e763-4239-8e3a-5100425e2424 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:19.861957 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc1a52-e763-4239-8e3a-5100425e2424 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:30:19.862264 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc1a52-e763-4239-8e3a-5100425e2424 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:19.863663 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc1a52-e763-4239-8e3a-5100425e2424 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:19.868985 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 640/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Jun 2 13:30:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:30:19.877819 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf7789-3146-46c1-836c-b0bf39e44df9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:19.984156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf7789-3146-46c1-836c-b0bf39e44df9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:20.019599 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53dac5-ea52-4baf-9803-28d9f791d5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:20.020618 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53dac5-ea52-4baf-9803-28d9f791d5ce None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:20.020901 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53dac5-ea52-4baf-9803-28d9f791d5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:20.021175 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53dac5-ea52-4baf-9803-28d9f791d5ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:20.021912 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53dac5-ea52-4baf-9803-28d9f791d5ce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:20.023705 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53dac5-ea52-4baf-9803-28d9f791d5ce None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:20.045300 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 666/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 2 13:30:19 2022] POST /identity/v3/endpoints => generated 331 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:30:29.865727 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=30 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:30.041991 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:25.009748 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e3d6d-2a4d-455f-8759-dd0d70567a72 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:25.010332 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e3d6d-2a4d-455f-8759-dd0d70567a72 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:25.010332 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e3d6d-2a4d-455f-8759-dd0d70567a72 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:25.011846 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 641/1307] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:25.017443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91587c52-7d07-4f64-a826-a43795a0f2a2 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:25.019224 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91587c52-7d07-4f64-a826-a43795a0f2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:25.019774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91587c52-7d07-4f64-a826-a43795a0f2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:25.192332 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-91587c52-7d07-4f64-a826-a43795a0f2a2 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:25.193700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-91587c52-7d07-4f64-a826-a43795a0f2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:25.320190 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 667/1308] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:25.368422 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e5d44-a437-4d80-b0ce-69c3cedc674c None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:25.368705 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e5d44-a437-4d80-b0ce-69c3cedc674c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:25.369180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e5d44-a437-4d80-b0ce-69c3cedc674c None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:25.370640 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 642/1309] 10.222.0.18 () {54 vars in 964 bytes} [Thu Jun 2 13:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:25.376781 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b8f4f-fe00-4be1-81e3-af8e79290d78 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:25.377069 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b8f4f-fe00-4be1-81e3-af8e79290d78 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:25.377343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b8f4f-fe00-4be1-81e3-af8e79290d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:25.458124 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-5e5b8f4f-fe00-4be1-81e3-af8e79290d78 None None] MFA Rules not processed for user `a072e8e01bc64c9b92579bb8f1d513a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:25.459532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5e5b8f4f-fe00-4be1-81e3-af8e79290d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:25.483640 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:25.558218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 668/1310] 10.222.0.18 () {58 vars in 1061 bytes} [Thu Jun 2 13:31:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:25.567842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e5d44-a437-4d80-b0ce-69c3cedc674c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:25.569851 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-cc0e5d44-a437-4d80-b0ce-69c3cedc674c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:25.693649 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e5d44-a437-4d80-b0ce-69c3cedc674c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:25.772656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e42b76-3b01-41e0-835b-771fe4425e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:25.773208 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e42b76-3b01-41e0-835b-771fe4425e35 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:25.773602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e42b76-3b01-41e0-835b-771fe4425e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:25.773907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e42b76-3b01-41e0-835b-771fe4425e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:25.775730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-47e42b76-3b01-41e0-835b-771fe4425e35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:25.837351 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:25.897842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e42b76-3b01-41e0-835b-771fe4425e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:25.899310 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e42b76-3b01-41e0-835b-771fe4425e35 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:25.918703 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 643/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:31:28.450857 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43080ac-4d3e-4a4e-9471-a232eab06ed8 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:28.451413 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43080ac-4d3e-4a4e-9471-a232eab06ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:28.451413 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43080ac-4d3e-4a4e-9471-a232eab06ed8 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:28.459510 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 669/1312] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:31:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:28.460511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053ecbc-4fbf-42cb-8c45-ded5debdeaa3 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:28.460987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053ecbc-4fbf-42cb-8c45-ded5debdeaa3 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:28.461069 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053ecbc-4fbf-42cb-8c45-ded5debdeaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:28.601776 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-7053ecbc-4fbf-42cb-8c45-ded5debdeaa3 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:28.603060 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7053ecbc-4fbf-42cb-8c45-ded5debdeaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:28.718378 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 644/1313] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:28.758074 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43080ac-4d3e-4a4e-9471-a232eab06ed8 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:28.759681 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d43080ac-4d3e-4a4e-9471-a232eab06ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:28.878486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43080ac-4d3e-4a4e-9471-a232eab06ed8 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:28.954084 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:28.956713 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b3e57-02d7-4e1f-a92c-f471c8724b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:28.957378 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b3e57-02d7-4e1f-a92c-f471c8724b42 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:28.957655 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b3e57-02d7-4e1f-a92c-f471c8724b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:28.958206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b3e57-02d7-4e1f-a92c-f471c8724b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:28.960266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-574b3e57-02d7-4e1f-a92c-f471c8724b42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:29.075738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b3e57-02d7-4e1f-a92c-f471c8724b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:29.077853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b3e57-02d7-4e1f-a92c-f471c8724b42 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:29.098044 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 670/1314] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:31:31.703147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac8bd5-f46f-4135-9d26-24ca077c1d66 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:31.703737 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac8bd5-f46f-4135-9d26-24ca077c1d66 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:31.703737 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac8bd5-f46f-4135-9d26-24ca077c1d66 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:31.705088 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 645/1315] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:31:31.710578 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc95807-b5c6-4aad-87e6-b09801ea4656 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:31.711045 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc95807-b5c6-4aad-87e6-b09801ea4656 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:31.711137 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc95807-b5c6-4aad-87e6-b09801ea4656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:31.782183 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8fc95807-b5c6-4aad-87e6-b09801ea4656 None None] MFA Rules not processed for user `f899f20bb3ec422192ead16d0af584af`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:31.783430 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8fc95807-b5c6-4aad-87e6-b09801ea4656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:31.840077 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:31.887318 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 671/1316] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:31 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:31.930416 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac8bd5-f46f-4135-9d26-24ca077c1d66 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:31.931996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-efac8bd5-f46f-4135-9d26-24ca077c1d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:31.942888 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:32.040028 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac8bd5-f46f-4135-9d26-24ca077c1d66 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:32.117260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dca91c-b342-4e71-ac97-d3fbe7ba4c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:32.117909 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dca91c-b342-4e71-ac97-d3fbe7ba4c68 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:32.118188 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dca91c-b342-4e71-ac97-d3fbe7ba4c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:32.118460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dca91c-b342-4e71-ac97-d3fbe7ba4c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:32.120119 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-20dca91c-b342-4e71-ac97-d3fbe7ba4c68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:32.183756 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:32.243995 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dca91c-b342-4e71-ac97-d3fbe7ba4c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:32.245428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dca91c-b342-4e71-ac97-d3fbe7ba4c68 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:32.265008 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 646/1317] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:31 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:31:35.104788 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb26fb1-de8e-4814-bf80-be90fb5bc33b None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:35.105360 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb26fb1-de8e-4814-bf80-be90fb5bc33b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:35.105360 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb26fb1-de8e-4814-bf80-be90fb5bc33b None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:35.106723 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 672/1318] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:35.114169 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706f7f6-d080-4665-af6f-84f10f77ad64 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:35.114641 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706f7f6-d080-4665-af6f-84f10f77ad64 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:35.114769 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706f7f6-d080-4665-af6f-84f10f77ad64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:35.193595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-3706f7f6-d080-4665-af6f-84f10f77ad64 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:35.194844 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3706f7f6-d080-4665-af6f-84f10f77ad64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:35.307038 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 647/1319] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:35.350484 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb26fb1-de8e-4814-bf80-be90fb5bc33b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:35.353067 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1eb26fb1-de8e-4814-bf80-be90fb5bc33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:35.483947 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb26fb1-de8e-4814-bf80-be90fb5bc33b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:35.562606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187b14c-c703-4505-a616-9f1ff2a291e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:35.563272 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187b14c-c703-4505-a616-9f1ff2a291e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:35.563544 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187b14c-c703-4505-a616-9f1ff2a291e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:35.563814 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187b14c-c703-4505-a616-9f1ff2a291e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:35.565445 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f187b14c-c703-4505-a616-9f1ff2a291e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:35.573202 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:35.683153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187b14c-c703-4505-a616-9f1ff2a291e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:35.684589 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187b14c-c703-4505-a616-9f1ff2a291e8 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:35.702540 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 673/1320] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:31:38.684676 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527bfe1-1030-47cb-819f-37bd2986a1c7 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:38.685272 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527bfe1-1030-47cb-819f-37bd2986a1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:38.685272 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527bfe1-1030-47cb-819f-37bd2986a1c7 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:38.686614 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 648/1321] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:38.692104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2984b63-5bae-40da-abd4-30e436dd9d25 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:38.692516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2984b63-5bae-40da-abd4-30e436dd9d25 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:38.692625 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2984b63-5bae-40da-abd4-30e436dd9d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:38.761826 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c2984b63-5bae-40da-abd4-30e436dd9d25 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:38.763097 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c2984b63-5bae-40da-abd4-30e436dd9d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:38.822625 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:38.861711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 674/1322] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:38.898257 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527bfe1-1030-47cb-819f-37bd2986a1c7 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:38.899836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b527bfe1-1030-47cb-819f-37bd2986a1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:38.919822 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:39.007950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527bfe1-1030-47cb-819f-37bd2986a1c7 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:39.081368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7eb039-e8f4-475b-993e-1fb195405d91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:39.082028 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7eb039-e8f4-475b-993e-1fb195405d91 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:39.082307 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7eb039-e8f4-475b-993e-1fb195405d91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:39.082596 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7eb039-e8f4-475b-993e-1fb195405d91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:39.084356 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ba7eb039-e8f4-475b-993e-1fb195405d91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:39.162833 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:39.206858 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7eb039-e8f4-475b-993e-1fb195405d91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:39.208306 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7eb039-e8f4-475b-993e-1fb195405d91 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:39.229161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 649/1323] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:31:41.574976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3e8a9-f7d0-4f9e-b3fa-4a1e3a7664ca None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:41.575514 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3e8a9-f7d0-4f9e-b3fa-4a1e3a7664ca None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:41.575514 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3e8a9-f7d0-4f9e-b3fa-4a1e3a7664ca None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:41.576808 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 675/1324] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:41.582159 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0b9df-b34d-4e38-8c22-60eedad08d95 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:41.582623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0b9df-b34d-4e38-8c22-60eedad08d95 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:41.582769 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0b9df-b34d-4e38-8c22-60eedad08d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:41.652466 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-e5d0b9df-b34d-4e38-8c22-60eedad08d95 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:41.653761 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e5d0b9df-b34d-4e38-8c22-60eedad08d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:41.750038 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 650/1325] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:41.786564 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3e8a9-f7d0-4f9e-b3fa-4a1e3a7664ca None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:41.788238 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-bee3e8a9-f7d0-4f9e-b3fa-4a1e3a7664ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:41.894606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3e8a9-f7d0-4f9e-b3fa-4a1e3a7664ca None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:41.968706 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094c3d5-f929-4a75-8715-6263f7216117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:41.969349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094c3d5-f929-4a75-8715-6263f7216117 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:41.969626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094c3d5-f929-4a75-8715-6263f7216117 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:41.969896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094c3d5-f929-4a75-8715-6263f7216117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:41.971568 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a094c3d5-f929-4a75-8715-6263f7216117 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:41.988197 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:42.077591 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094c3d5-f929-4a75-8715-6263f7216117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:42.079073 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094c3d5-f929-4a75-8715-6263f7216117 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:42.097265 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 676/1326] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:31:44.384107 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c362d8-44f7-47dc-9128-d2f35579c751 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:44.384740 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c362d8-44f7-47dc-9128-d2f35579c751 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:44.384740 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c362d8-44f7-47dc-9128-d2f35579c751 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:44.386041 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 651/1327] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:44.391522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf14a3a-2a4f-4d32-81a5-7c1e8b40b3ef None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:44.391985 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf14a3a-2a4f-4d32-81a5-7c1e8b40b3ef None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:44.392089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf14a3a-2a4f-4d32-81a5-7c1e8b40b3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:44.461572 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-acf14a3a-2a4f-4d32-81a5-7c1e8b40b3ef None None] MFA Rules not processed for user `f899f20bb3ec422192ead16d0af584af`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:44.462801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-acf14a3a-2a4f-4d32-81a5-7c1e8b40b3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:44.533855 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:44.567550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 677/1328] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:44 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:44.620755 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a38406-7959-4874-9c34-967a8435787b None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:44.621229 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a38406-7959-4874-9c34-967a8435787b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:44.621887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a38406-7959-4874-9c34-967a8435787b None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:44.624407 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 652/1329] 10.222.0.18 () {54 vars in 964 bytes} [Thu Jun 2 13:31:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:44.636176 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a45451-a0e7-4e70-9b66-3dff7ee4e8f1 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:44.636395 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a45451-a0e7-4e70-9b66-3dff7ee4e8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:44.636667 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a45451-a0e7-4e70-9b66-3dff7ee4e8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:44.716447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-30a45451-a0e7-4e70-9b66-3dff7ee4e8f1 None None] MFA Rules not processed for user `a072e8e01bc64c9b92579bb8f1d513a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:44.717668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-30a45451-a0e7-4e70-9b66-3dff7ee4e8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:44.795381 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 678/1330] 10.222.0.18 () {58 vars in 1061 bytes} [Thu Jun 2 13:31:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:44.804280 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a38406-7959-4874-9c34-967a8435787b None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:44.805817 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b2a38406-7959-4874-9c34-967a8435787b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:44.837287 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:44.917492 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a38406-7959-4874-9c34-967a8435787b None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:44.993677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda431a4-1c26-4f31-abd5-9e7f4ba461d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:44.994341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda431a4-1c26-4f31-abd5-9e7f4ba461d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:44.994690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda431a4-1c26-4f31-abd5-9e7f4ba461d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:44.994939 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda431a4-1c26-4f31-abd5-9e7f4ba461d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:44.996614 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-cda431a4-1c26-4f31-abd5-9e7f4ba461d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:45.076810 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:45.110255 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda431a4-1c26-4f31-abd5-9e7f4ba461d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:45.111723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda431a4-1c26-4f31-abd5-9e7f4ba461d8 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:45.130655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 653/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:44 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:31:48.000397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1ba55-830a-471c-a51a-22fdc707e00e None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:48.000878 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1ba55-830a-471c-a51a-22fdc707e00e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:48.000967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1ba55-830a-471c-a51a-22fdc707e00e None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:48.002281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 679/1332] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:48.009353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55037b59-39df-4d55-b5c5-d813fb1efdc4 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:48.010174 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55037b59-39df-4d55-b5c5-d813fb1efdc4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:48.010174 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55037b59-39df-4d55-b5c5-d813fb1efdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:48.086045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-55037b59-39df-4d55-b5c5-d813fb1efdc4 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:48.087302 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-55037b59-39df-4d55-b5c5-d813fb1efdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:48.195487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 654/1333] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:48.232115 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1ba55-830a-471c-a51a-22fdc707e00e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:48.233743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-27e1ba55-830a-471c-a51a-22fdc707e00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:48.306071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:48.344117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1ba55-830a-471c-a51a-22fdc707e00e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:48.425756 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a640c411-af87-43e8-b095-a5cb91991713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:48.426412 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640c411-af87-43e8-b095-a5cb91991713 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:48.426718 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640c411-af87-43e8-b095-a5cb91991713 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:48.426984 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640c411-af87-43e8-b095-a5cb91991713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:48.428762 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a640c411-af87-43e8-b095-a5cb91991713 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:48.545325 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a640c411-af87-43e8-b095-a5cb91991713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:48.546712 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a640c411-af87-43e8-b095-a5cb91991713 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:48.557308 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:48.566540 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 680/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:31:50.841958 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d89d7-cf05-4b4d-a286-a0de1be4e3ea None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:50.842626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d89d7-cf05-4b4d-a286-a0de1be4e3ea None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:50.842626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d89d7-cf05-4b4d-a286-a0de1be4e3ea None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:50.844002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 655/1335] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:31:50.849713 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93799179-43e6-4d8f-8d2c-a3f5183244bc None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:50.850143 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93799179-43e6-4d8f-8d2c-a3f5183244bc None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:50.850252 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93799179-43e6-4d8f-8d2c-a3f5183244bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:50.916705 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-93799179-43e6-4d8f-8d2c-a3f5183244bc None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:50.917933 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-93799179-43e6-4d8f-8d2c-a3f5183244bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:51.019820 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 681/1336] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:51.069409 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d89d7-cf05-4b4d-a286-a0de1be4e3ea None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:51.070985 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a08d89d7-cf05-4b4d-a286-a0de1be4e3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:51.128279 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:51.194909 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d89d7-cf05-4b4d-a286-a0de1be4e3ea None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:51.279161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d68cde-81c7-4443-8aa6-56d12adce815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:51.279854 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d68cde-81c7-4443-8aa6-56d12adce815 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:51.280135 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d68cde-81c7-4443-8aa6-56d12adce815 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:51.280430 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d68cde-81c7-4443-8aa6-56d12adce815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:51.282134 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b9d68cde-81c7-4443-8aa6-56d12adce815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:51.369729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:51.398215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d68cde-81c7-4443-8aa6-56d12adce815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:51.399699 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d68cde-81c7-4443-8aa6-56d12adce815 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:51.419675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 656/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:31:54.184225 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef6759-1655-44e4-90a9-71500d84ee9f None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:54.184836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef6759-1655-44e4-90a9-71500d84ee9f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:54.184836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef6759-1655-44e4-90a9-71500d84ee9f None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:54.186737 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 682/1338] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:31:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:54.194546 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04a568-25a8-4e98-992f-fe318038d935 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:54.194996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04a568-25a8-4e98-992f-fe318038d935 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:54.195110 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04a568-25a8-4e98-992f-fe318038d935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:54.264917 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-1b04a568-25a8-4e98-992f-fe318038d935 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:54.266134 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1b04a568-25a8-4e98-992f-fe318038d935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:54.379388 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 657/1339] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:54.417442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef6759-1655-44e4-90a9-71500d84ee9f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:54.419038 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-79ef6759-1655-44e4-90a9-71500d84ee9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:54.508593 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:54.539000 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef6759-1655-44e4-90a9-71500d84ee9f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:54.618498 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d921a-dcea-45eb-b4c7-ba858b2c2ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:54.619208 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d921a-dcea-45eb-b4c7-ba858b2c2ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:54.619480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d921a-dcea-45eb-b4c7-ba858b2c2ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:54.619749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d921a-dcea-45eb-b4c7-ba858b2c2ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:54.621380 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-be9d921a-dcea-45eb-b4c7-ba858b2c2ea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:54.737633 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d921a-dcea-45eb-b4c7-ba858b2c2ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:54.739115 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d921a-dcea-45eb-b4c7-ba858b2c2ea1 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:54.757663 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 683/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:31:59.271930 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99945fba-bb05-45c3-b810-2d99847c32c8 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:59.272468 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99945fba-bb05-45c3-b810-2d99847c32c8 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:59.272468 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99945fba-bb05-45c3-b810-2d99847c32c8 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:59.273917 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 658/1341] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:31:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:59.279583 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601388d-17e4-424d-b22c-2d48e3ec879d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:59.280012 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601388d-17e4-424d-b22c-2d48e3ec879d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:59.280136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601388d-17e4-424d-b22c-2d48e3ec879d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:59.287160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:59.356544 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0601388d-17e4-424d-b22c-2d48e3ec879d None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:59.357768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0601388d-17e4-424d-b22c-2d48e3ec879d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:59.466288 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 684/1342] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:59.504688 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99945fba-bb05-45c3-b810-2d99847c32c8 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:59.507020 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-99945fba-bb05-45c3-b810-2d99847c32c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:59.560327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:59.606924 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99945fba-bb05-45c3-b810-2d99847c32c8 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:59.610722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ea10a-f016-4bc3-90b8-1329cf631812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:59.611384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ea10a-f016-4bc3-90b8-1329cf631812 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:59.611662 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ea10a-f016-4bc3-90b8-1329cf631812 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:59.611931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ea10a-f016-4bc3-90b8-1329cf631812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:59.621390 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ea10a-f016-4bc3-90b8-1329cf631812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:59.622860 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ea10a-f016-4bc3-90b8-1329cf631812 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:59.635159 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 659/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:32:02.496083 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14372045-8cf3-44ce-a9fc-51df9dff3f28 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:02.496619 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14372045-8cf3-44ce-a9fc-51df9dff3f28 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:02.496619 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14372045-8cf3-44ce-a9fc-51df9dff3f28 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:02.497852 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 685/1344] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:02.503248 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eef856-3e62-43c8-a04b-6607d70b40be None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:02.503673 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eef856-3e62-43c8-a04b-6607d70b40be None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:02.503785 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eef856-3e62-43c8-a04b-6607d70b40be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:02.532718 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-81eef856-3e62-43c8-a04b-6607d70b40be None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:02.533884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-81eef856-3e62-43c8-a04b-6607d70b40be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:02.618496 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 660/1345] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:02 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:02.658428 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14372045-8cf3-44ce-a9fc-51df9dff3f28 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:02.670109 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14372045-8cf3-44ce-a9fc-51df9dff3f28 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:02.673942 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e62be2-6064-4b90-b0d2-596869366475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:02.674602 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e62be2-6064-4b90-b0d2-596869366475 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:02.674873 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e62be2-6064-4b90-b0d2-596869366475 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:02.675138 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e62be2-6064-4b90-b0d2-596869366475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:02.684418 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e62be2-6064-4b90-b0d2-596869366475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:02.685848 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e62be2-6064-4b90-b0d2-596869366475 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:02.696505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 686/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:02 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:32:06.872594 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ee967-90e5-4839-9cc4-d67d7c505fac None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:06.873126 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ee967-90e5-4839-9cc4-d67d7c505fac None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:06.873126 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ee967-90e5-4839-9cc4-d67d7c505fac None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:06.874510 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 661/1347] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:06.880135 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb01b1-d3ee-4e2a-af23-f19d7e3e5fd4 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:06.880617 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb01b1-d3ee-4e2a-af23-f19d7e3e5fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:06.880765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb01b1-d3ee-4e2a-af23-f19d7e3e5fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:06.900357 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a4cb01b1-d3ee-4e2a-af23-f19d7e3e5fd4 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:06.901635 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a4cb01b1-d3ee-4e2a-af23-f19d7e3e5fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:06.910174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 687/1348] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:06.948149 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ee967-90e5-4839-9cc4-d67d7c505fac None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:06.950120 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c18ee967-90e5-4839-9cc4-d67d7c505fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:06.964073 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ee967-90e5-4839-9cc4-d67d7c505fac None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:06.967693 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe580f-6930-4d41-ba27-29081a2d2df0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:06.968329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe580f-6930-4d41-ba27-29081a2d2df0 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:06.968590 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe580f-6930-4d41-ba27-29081a2d2df0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:06.968855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe580f-6930-4d41-ba27-29081a2d2df0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:06.978767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe580f-6930-4d41-ba27-29081a2d2df0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:06.980603 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe580f-6930-4d41-ba27-29081a2d2df0 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:06.991195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 662/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:32:12.490839 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a6ed0-ec1b-436f-92b9-aa446291c191 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:12.491413 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a6ed0-ec1b-436f-92b9-aa446291c191 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:12.491586 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a6ed0-ec1b-436f-92b9-aa446291c191 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:12.493334 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 688/1350] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 13:32:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:12.498445 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a5fb2-142f-4705-9a29-064322e9c0d4 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:12.498891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a5fb2-142f-4705-9a29-064322e9c0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:12.499231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a5fb2-142f-4705-9a29-064322e9c0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:12.579328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d20a5fb2-142f-4705-9a29-064322e9c0d4 None None] MFA Rules not processed for user `2f7ea9741a5d409d87b8ebb4390a74ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:12.580753 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d20a5fb2-142f-4705-9a29-064322e9c0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:12.619295 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:12.688557 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 663/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 13:32:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:16.894481 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=72 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:17.117462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7b338-024a-47a2-b48b-779dd7ca24fb None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:17.118168 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7b338-024a-47a2-b48b-779dd7ca24fb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:17.118168 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7b338-024a-47a2-b48b-779dd7ca24fb None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:17.119903 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 689/1352] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 13:32:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:17.125635 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0586d3-3e2b-49be-bc61-bfd7e1522057 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:17.126245 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0586d3-3e2b-49be-bc61-bfd7e1522057 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:17.126476 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0586d3-3e2b-49be-bc61-bfd7e1522057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:17.150215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-7d0586d3-3e2b-49be-bc61-bfd7e1522057 None None] MFA Rules not processed for user `2f7ea9741a5d409d87b8ebb4390a74ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:17.151439 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7d0586d3-3e2b-49be-bc61-bfd7e1522057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:17.161381 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 664/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 13:32:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:18.618713 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff06a1-fda2-4697-9f78-b96531748626 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:18.619381 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff06a1-fda2-4697-9f78-b96531748626 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:18.619381 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff06a1-fda2-4697-9f78-b96531748626 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:18.620622 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 690/1354] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 13:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:32:18.625686 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a9b6d-f308-4945-9586-b77c25405702 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:18.626118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a9b6d-f308-4945-9586-b77c25405702 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:18.626253 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a9b6d-f308-4945-9586-b77c25405702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:18.647916 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-251a9b6d-f308-4945-9586-b77c25405702 None None] MFA Rules not processed for user `2f7ea9741a5d409d87b8ebb4390a74ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:18.649238 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-251a9b6d-f308-4945-9586-b77c25405702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:18.659113 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 665/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 13:32:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:22.611357 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e66612-c4b9-4e43-9d5f-79e67b91fabd None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:22.611986 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e66612-c4b9-4e43-9d5f-79e67b91fabd None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:22.611986 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e66612-c4b9-4e43-9d5f-79e67b91fabd None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:22.614963 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 691/1356] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:32:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:22.618499 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf46f2-63a7-4daf-bc00-cb19c6ed3fa6 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:22.619623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf46f2-63a7-4daf-bc00-cb19c6ed3fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:22.620294 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf46f2-63a7-4daf-bc00-cb19c6ed3fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:22.639953 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-4acf46f2-63a7-4daf-bc00-cb19c6ed3fa6 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:22.641155 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4acf46f2-63a7-4daf-bc00-cb19c6ed3fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:22.649530 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 666/1357] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:22.706838 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb6646-14b1-42b6-85ee-14300d389d15 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:22.707674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb6646-14b1-42b6-85ee-14300d389d15 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:22.708114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb6646-14b1-42b6-85ee-14300d389d15 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:22.709964 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 692/1358] 10.222.0.18 () {54 vars in 961 bytes} [Thu Jun 2 13:32:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:22.717500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d9321-5638-4cc6-a404-83fccb81dac3 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:22.718281 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d9321-5638-4cc6-a404-83fccb81dac3 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:22.718782 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d9321-5638-4cc6-a404-83fccb81dac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:22.773299 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-197d9321-5638-4cc6-a404-83fccb81dac3 None None] MFA Rules not processed for user `5a0061e2927843cf86769d2beab18743`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:22.774779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-197d9321-5638-4cc6-a404-83fccb81dac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:22.858565 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 667/1359] 10.222.0.18 () {58 vars in 1058 bytes} [Thu Jun 2 13:32:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:32:22.867463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb6646-14b1-42b6-85ee-14300d389d15 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:22.882836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb6646-14b1-42b6-85ee-14300d389d15 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:22.888834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d80c98-d9e0-495c-8a8b-56f5c2795a2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:22.889472 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d80c98-d9e0-495c-8a8b-56f5c2795a2b service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:22.889762 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d80c98-d9e0-495c-8a8b-56f5c2795a2b service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:22.890036 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d80c98-d9e0-495c-8a8b-56f5c2795a2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:22.899681 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d80c98-d9e0-495c-8a8b-56f5c2795a2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:22.901303 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d80c98-d9e0-495c-8a8b-56f5c2795a2b service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:22.912198 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 693/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:32:25.409616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b5f99-465e-40a2-9232-190d6ea3eb04 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:25.410189 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b5f99-465e-40a2-9232-190d6ea3eb04 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:25.410189 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b5f99-465e-40a2-9232-190d6ea3eb04 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:25.411738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 668/1361] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:25.417088 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13870aee-5296-4951-aaf2-c3d1cb11d46f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:25.417577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13870aee-5296-4951-aaf2-c3d1cb11d46f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:25.417672 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13870aee-5296-4951-aaf2-c3d1cb11d46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:25.436300 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-13870aee-5296-4951-aaf2-c3d1cb11d46f None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:25.437522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-13870aee-5296-4951-aaf2-c3d1cb11d46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:25.446354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 694/1362] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:32:25.491010 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b5f99-465e-40a2-9232-190d6ea3eb04 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:25.508450 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b5f99-465e-40a2-9232-190d6ea3eb04 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:25.514168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b55f34-aaf0-4dc0-847e-1c112b1e3e2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:25.514844 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b55f34-aaf0-4dc0-847e-1c112b1e3e2a service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:25.515131 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b55f34-aaf0-4dc0-847e-1c112b1e3e2a service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:25.515412 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b55f34-aaf0-4dc0-847e-1c112b1e3e2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:25.525425 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b55f34-aaf0-4dc0-847e-1c112b1e3e2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:25.527051 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b55f34-aaf0-4dc0-847e-1c112b1e3e2a service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:25.537119 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 669/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:32:28.154988 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f8a3d-809a-4cb5-aadb-a1a8547abe40 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:28.155519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f8a3d-809a-4cb5-aadb-a1a8547abe40 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:28.155519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f8a3d-809a-4cb5-aadb-a1a8547abe40 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:28.157041 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 695/1364] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:28.163737 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18a41d-909e-42e2-8632-ac573c9a47ed None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:28.164162 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18a41d-909e-42e2-8632-ac573c9a47ed None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:28.164307 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18a41d-909e-42e2-8632-ac573c9a47ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:28.184833 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-bb18a41d-909e-42e2-8632-ac573c9a47ed None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:28.186036 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-bb18a41d-909e-42e2-8632-ac573c9a47ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:28.194327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 670/1365] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:32:28.248979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35175bd3-c5eb-4117-a1fa-d9d4b56d7538 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:28.249266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35175bd3-c5eb-4117-a1fa-d9d4b56d7538 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:28.249714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35175bd3-c5eb-4117-a1fa-d9d4b56d7538 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:28.251133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 696/1366] 10.222.0.18 () {54 vars in 961 bytes} [Thu Jun 2 13:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:28.256773 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca923b-5d07-42ad-8c2d-86d1b2cac5a5 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:28.257062 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca923b-5d07-42ad-8c2d-86d1b2cac5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:28.257887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca923b-5d07-42ad-8c2d-86d1b2cac5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:28.277054 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-71ca923b-5d07-42ad-8c2d-86d1b2cac5a5 None None] MFA Rules not processed for user `5a0061e2927843cf86769d2beab18743`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:28.278269 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-71ca923b-5d07-42ad-8c2d-86d1b2cac5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:28.287347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 671/1367] 10.222.0.18 () {58 vars in 1058 bytes} [Thu Jun 2 13:32:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:28.295268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35175bd3-c5eb-4117-a1fa-d9d4b56d7538 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:28.310090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35175bd3-c5eb-4117-a1fa-d9d4b56d7538 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:28.315906 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5e317-d8f2-443c-adc2-bf97c7060181 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:28.316620 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5e317-d8f2-443c-adc2-bf97c7060181 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:28.316984 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5e317-d8f2-443c-adc2-bf97c7060181 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:28.317317 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5e317-d8f2-443c-adc2-bf97c7060181 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:28.325997 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5e317-d8f2-443c-adc2-bf97c7060181 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:28.327689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5e317-d8f2-443c-adc2-bf97c7060181 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:28.337737 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 697/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:32:30.649770 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d06d5d-3298-4ac4-8fda-6e2d10510327 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:30.650381 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d06d5d-3298-4ac4-8fda-6e2d10510327 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:30.650381 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d06d5d-3298-4ac4-8fda-6e2d10510327 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:30.651836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 672/1369] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:30.657407 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ad1eb-b937-4150-be95-0fe9bc2ff237 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:30.658159 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ad1eb-b937-4150-be95-0fe9bc2ff237 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:30.658678 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ad1eb-b937-4150-be95-0fe9bc2ff237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:30.679599 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-546ad1eb-b937-4150-be95-0fe9bc2ff237 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:30.681108 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-546ad1eb-b937-4150-be95-0fe9bc2ff237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:30.692059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 698/1370] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:30.736937 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d06d5d-3298-4ac4-8fda-6e2d10510327 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:30.752592 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d06d5d-3298-4ac4-8fda-6e2d10510327 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:30.758814 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a144add-15d1-4d94-875c-c5a8d593dc2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:30.759982 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a144add-15d1-4d94-875c-c5a8d593dc2b service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:30.760414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a144add-15d1-4d94-875c-c5a8d593dc2b service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:30.760781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a144add-15d1-4d94-875c-c5a8d593dc2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:30.770681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a144add-15d1-4d94-875c-c5a8d593dc2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:30.772398 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a144add-15d1-4d94-875c-c5a8d593dc2b service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:30.783111 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 673/1371] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:32:30.948719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6d1e1-f690-45d2-866d-cdf9b50e2b31 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:30.949009 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6d1e1-f690-45d2-866d-cdf9b50e2b31 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:30.949212 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6d1e1-f690-45d2-866d-cdf9b50e2b31 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:30.950834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 699/1372] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:30.956992 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7cdfa-f803-4218-b0d4-93e1a1d987a6 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:30.957249 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7cdfa-f803-4218-b0d4-93e1a1d987a6 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:30.957714 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7cdfa-f803-4218-b0d4-93e1a1d987a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:30.977851 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-3af7cdfa-f803-4218-b0d4-93e1a1d987a6 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:30.979111 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3af7cdfa-f803-4218-b0d4-93e1a1d987a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:30.987684 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 674/1373] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:31.294112 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd06be-5cee-4c6d-8f0a-f644840280c6 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:31.294387 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd06be-5cee-4c6d-8f0a-f644840280c6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:31.294654 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd06be-5cee-4c6d-8f0a-f644840280c6 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:31.296002 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 700/1374] 10.222.0.18 () {54 vars in 963 bytes} [Thu Jun 2 13:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:31.301259 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c09609-f137-48dc-9be3-6470cd217d6d None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:31.301496 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c09609-f137-48dc-9be3-6470cd217d6d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:31.301802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c09609-f137-48dc-9be3-6470cd217d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:31.310414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:31.355949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-c7c09609-f137-48dc-9be3-6470cd217d6d None None] MFA Rules not processed for user `58b2f0101284461398a95538466002bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:31.357149 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c7c09609-f137-48dc-9be3-6470cd217d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:31.421905 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 675/1375] 10.222.0.18 () {58 vars in 1060 bytes} [Thu Jun 2 13:32:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:31.430145 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd06be-5cee-4c6d-8f0a-f644840280c6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:31.441571 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd06be-5cee-4c6d-8f0a-f644840280c6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:31.446048 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa59ae5-d925-40f3-8d07-50e3fd80952b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:31.446785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa59ae5-d925-40f3-8d07-50e3fd80952b service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:31.447184 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa59ae5-d925-40f3-8d07-50e3fd80952b service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:31.447545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa59ae5-d925-40f3-8d07-50e3fd80952b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:31.459150 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa59ae5-d925-40f3-8d07-50e3fd80952b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:31.461306 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa59ae5-d925-40f3-8d07-50e3fd80952b service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:31.472701 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 701/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:32:33.112943 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca6bbe-288a-4472-922f-61df96df2cee None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:33.113468 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca6bbe-288a-4472-922f-61df96df2cee None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:33.113468 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca6bbe-288a-4472-922f-61df96df2cee None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:33.114969 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 676/1377] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:33.120875 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58edfb-3cfd-4827-a0af-41bd9fe45cef None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:33.121269 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58edfb-3cfd-4827-a0af-41bd9fe45cef None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:33.121460 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58edfb-3cfd-4827-a0af-41bd9fe45cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:33.281230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-9d58edfb-3cfd-4827-a0af-41bd9fe45cef None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:33.282479 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9d58edfb-3cfd-4827-a0af-41bd9fe45cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:33.292457 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 702/1378] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:33.338784 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca6bbe-288a-4472-922f-61df96df2cee None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:33.355641 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca6bbe-288a-4472-922f-61df96df2cee None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:33.361618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271fcc3-0e6f-48ef-886f-71de33644f87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:33.362288 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271fcc3-0e6f-48ef-886f-71de33644f87 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:33.362592 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271fcc3-0e6f-48ef-886f-71de33644f87 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:33.362868 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271fcc3-0e6f-48ef-886f-71de33644f87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:33.372361 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271fcc3-0e6f-48ef-886f-71de33644f87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:33.374042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271fcc3-0e6f-48ef-886f-71de33644f87 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:33.385227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 677/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:32:35.696443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b7f77-0288-4806-871f-ab7a3825279f None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:35.697055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b7f77-0288-4806-871f-ab7a3825279f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:35.697055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b7f77-0288-4806-871f-ab7a3825279f None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:35.698619 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 703/1380] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:35.703997 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d43f4c-49c7-4411-a0e2-3baa4da7871e None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:35.704438 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d43f4c-49c7-4411-a0e2-3baa4da7871e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:35.704533 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d43f4c-49c7-4411-a0e2-3baa4da7871e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:35.724879 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-95d43f4c-49c7-4411-a0e2-3baa4da7871e None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:35.726106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-95d43f4c-49c7-4411-a0e2-3baa4da7871e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:35.735738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 678/1381] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:35.780609 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b7f77-0288-4806-871f-ab7a3825279f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:35.796313 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b7f77-0288-4806-871f-ab7a3825279f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:35.803624 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147b4b0-67a5-41d5-bfd3-322c9abb8ef0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:35.804450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147b4b0-67a5-41d5-bfd3-322c9abb8ef0 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:35.804858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147b4b0-67a5-41d5-bfd3-322c9abb8ef0 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:35.805283 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147b4b0-67a5-41d5-bfd3-322c9abb8ef0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:35.814609 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147b4b0-67a5-41d5-bfd3-322c9abb8ef0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:35.816323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147b4b0-67a5-41d5-bfd3-322c9abb8ef0 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:35.826882 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 704/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:32:38.090845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac8b97-8230-4f31-aaab-b18e90734bfd None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:38.091437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac8b97-8230-4f31-aaab-b18e90734bfd None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:38.091437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac8b97-8230-4f31-aaab-b18e90734bfd None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:38.092860 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 679/1383] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:38.099432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfa857-e07d-42c6-aeeb-a0e24ab491a2 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:38.100409 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfa857-e07d-42c6-aeeb-a0e24ab491a2 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:38.100672 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfa857-e07d-42c6-aeeb-a0e24ab491a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:38.121784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-21cfa857-e07d-42c6-aeeb-a0e24ab491a2 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:38.123152 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-21cfa857-e07d-42c6-aeeb-a0e24ab491a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:38.131771 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 705/1384] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:38.175283 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac8b97-8230-4f31-aaab-b18e90734bfd None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:38.192215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac8b97-8230-4f31-aaab-b18e90734bfd None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:38.198248 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207b6fe-4772-490d-972b-ef447317f22b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:38.198941 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207b6fe-4772-490d-972b-ef447317f22b service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:38.199221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207b6fe-4772-490d-972b-ef447317f22b service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:38.199491 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207b6fe-4772-490d-972b-ef447317f22b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:38.208490 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207b6fe-4772-490d-972b-ef447317f22b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:38.210067 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207b6fe-4772-490d-972b-ef447317f22b service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:38.220883 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 680/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:32:40.654844 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71aa29-322e-4b1f-81af-86be1690d73d None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:40.655410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71aa29-322e-4b1f-81af-86be1690d73d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:40.655695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71aa29-322e-4b1f-81af-86be1690d73d None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:40.657926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 706/1386] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:32:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:40.667140 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d0f67-5ae2-491f-a199-5e1fa73b40d8 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:40.667665 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d0f67-5ae2-491f-a199-5e1fa73b40d8 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:40.667911 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d0f67-5ae2-491f-a199-5e1fa73b40d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:40.695199 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-1a9d0f67-5ae2-491f-a199-5e1fa73b40d8 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:40.696937 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1a9d0f67-5ae2-491f-a199-5e1fa73b40d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:40.708521 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 681/1387] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:40.772625 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71aa29-322e-4b1f-81af-86be1690d73d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:40.797069 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71aa29-322e-4b1f-81af-86be1690d73d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:40.807261 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b599ee2-7b6c-4694-8a87-e94079461991 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:40.808233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b599ee2-7b6c-4694-8a87-e94079461991 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:40.808642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b599ee2-7b6c-4694-8a87-e94079461991 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:40.809015 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b599ee2-7b6c-4694-8a87-e94079461991 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:40.821227 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b599ee2-7b6c-4694-8a87-e94079461991 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:40.823273 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b599ee2-7b6c-4694-8a87-e94079461991 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:40.839724 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 707/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:32:43.448778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8971be-e7a2-415b-8c55-9f1808a932f4 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:43.449375 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8971be-e7a2-415b-8c55-9f1808a932f4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:43.449567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8971be-e7a2-415b-8c55-9f1808a932f4 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:43.452229 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 682/1389] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:32:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:43.458644 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159433b-6855-4ead-9bbe-ce510ff60eb3 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:43.459170 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159433b-6855-4ead-9bbe-ce510ff60eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:43.459170 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159433b-6855-4ead-9bbe-ce510ff60eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:43.482048 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3159433b-6855-4ead-9bbe-ce510ff60eb3 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:43.483594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3159433b-6855-4ead-9bbe-ce510ff60eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:43.492869 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 708/1390] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:43.551899 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8971be-e7a2-415b-8c55-9f1808a932f4 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:43.574250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8971be-e7a2-415b-8c55-9f1808a932f4 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:43.583374 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1486c-bad1-4433-aa19-d1a57b74832d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:43.585741 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1486c-bad1-4433-aa19-d1a57b74832d service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:43.586283 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1486c-bad1-4433-aa19-d1a57b74832d service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:43.586816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1486c-bad1-4433-aa19-d1a57b74832d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:43.601420 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1486c-bad1-4433-aa19-d1a57b74832d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:43.606017 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1486c-bad1-4433-aa19-d1a57b74832d service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:43.617931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 683/1391] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:32:46.013230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c19145-ed93-4f75-8408-b4305c2112c6 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:46.013884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c19145-ed93-4f75-8408-b4305c2112c6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:46.013884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c19145-ed93-4f75-8408-b4305c2112c6 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:46.015324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 709/1392] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:46.021103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaf6ef-6154-4629-95a1-52be459fc15b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:46.021577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaf6ef-6154-4629-95a1-52be459fc15b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:46.021671 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaf6ef-6154-4629-95a1-52be459fc15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:46.041299 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-00eaf6ef-6154-4629-95a1-52be459fc15b None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:46.042680 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-00eaf6ef-6154-4629-95a1-52be459fc15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:46.051245 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 684/1393] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:46.096143 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c19145-ed93-4f75-8408-b4305c2112c6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:46.110916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c19145-ed93-4f75-8408-b4305c2112c6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:46.119089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a00e67-1191-470f-bfb8-f8a996bb43fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:46.119746 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a00e67-1191-470f-bfb8-f8a996bb43fc service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:46.120021 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a00e67-1191-470f-bfb8-f8a996bb43fc service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:46.120281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a00e67-1191-470f-bfb8-f8a996bb43fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:46.129675 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a00e67-1191-470f-bfb8-f8a996bb43fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:46.131607 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a00e67-1191-470f-bfb8-f8a996bb43fc service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:46.142225 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 710/1394] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:32:47.661837 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6a4cb-d3d0-4a54-9158-ac22bed1607b None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:47.662417 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6a4cb-d3d0-4a54-9158-ac22bed1607b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:47.662513 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6a4cb-d3d0-4a54-9158-ac22bed1607b None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:47.664130 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 685/1395] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:47.669457 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fbfbb-62d3-48a7-a92a-99452cdc829e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:47.669887 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fbfbb-62d3-48a7-a92a-99452cdc829e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:47.669991 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fbfbb-62d3-48a7-a92a-99452cdc829e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:47.675983 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=52 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:47.689154 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3b4fbfbb-62d3-48a7-a92a-99452cdc829e None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:47.690341 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3b4fbfbb-62d3-48a7-a92a-99452cdc829e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:47.700276 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 711/1396] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:47.763189 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb7864-d904-42a8-9754-fe674335947c None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:47.763482 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb7864-d904-42a8-9754-fe674335947c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:47.763744 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb7864-d904-42a8-9754-fe674335947c None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:47.765340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 686/1397] 10.222.0.18 () {54 vars in 962 bytes} [Thu Jun 2 13:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:47.770438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4182a-9fb9-49c1-b329-d397a6e9cb9c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:47.771768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4182a-9fb9-49c1-b329-d397a6e9cb9c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:47.772092 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4182a-9fb9-49c1-b329-d397a6e9cb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:47.822137 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-78b4182a-9fb9-49c1-b329-d397a6e9cb9c None None] MFA Rules not processed for user `22df4e0d98e34758963d3b1465a3a377`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:47.823770 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-78b4182a-9fb9-49c1-b329-d397a6e9cb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:47.886023 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 712/1398] 10.222.0.18 () {58 vars in 1059 bytes} [Thu Jun 2 13:32:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:47.893937 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb7864-d904-42a8-9754-fe674335947c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:47.905139 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb7864-d904-42a8-9754-fe674335947c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:47.908711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ed3b3-de2f-49e1-9008-58070970aea9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22df4e0d98e34758963d3b1465a3a377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:47.909355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ed3b3-de2f-49e1-9008-58070970aea9 service glance] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:47.909633 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ed3b3-de2f-49e1-9008-58070970aea9 service glance] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:47.909902 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ed3b3-de2f-49e1-9008-58070970aea9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:47.919281 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ed3b3-de2f-49e1-9008-58070970aea9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:47.920719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ed3b3-de2f-49e1-9008-58070970aea9 service glance] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:47.930297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 687/1399] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:32:48.476322 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fc2f0-36b1-4a4a-b495-2862953db377 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:48.476961 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fc2f0-36b1-4a4a-b495-2862953db377 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:48.476961 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fc2f0-36b1-4a4a-b495-2862953db377 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:48.478222 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 713/1400] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:48.483809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5058bd-a344-4df0-ad0e-482283ee8886 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:48.484115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5058bd-a344-4df0-ad0e-482283ee8886 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:48.484497 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5058bd-a344-4df0-ad0e-482283ee8886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:48.491113 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179c116-98eb-4bb2-8edf-5b65c80bfc5b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:48.491459 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179c116-98eb-4bb2-8edf-5b65c80bfc5b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:48.491792 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179c116-98eb-4bb2-8edf-5b65c80bfc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:48.502171 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-fc5058bd-a344-4df0-ad0e-482283ee8886 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:48.503383 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-fc5058bd-a344-4df0-ad0e-482283ee8886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:48.511916 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 688/1401] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:48.545054 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0179c116-98eb-4bb2-8edf-5b65c80bfc5b None None] MFA Rules not processed for user `cbf7d6db675047cbb3a3f16631c59622`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:48.546355 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0179c116-98eb-4bb2-8edf-5b65c80bfc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:48.556568 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5058bd-a344-4df0-ad0e-482283ee8886 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:48.568804 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5058bd-a344-4df0-ad0e-482283ee8886 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:48.574742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa151b-e34b-4c34-b4d4-8a156cac184a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:48.575377 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa151b-e34b-4c34-b4d4-8a156cac184a service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:48.575797 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa151b-e34b-4c34-b4d4-8a156cac184a service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:48.575935 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa151b-e34b-4c34-b4d4-8a156cac184a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:48.584123 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa151b-e34b-4c34-b4d4-8a156cac184a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:48.585688 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa151b-e34b-4c34-b4d4-8a156cac184a service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:48.595619 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 689/1402] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:32:48.612127 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 714/1403] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 13:32:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:48.660812 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924adaa-0d61-4745-a6c2-3a026166eb6a None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:48.661104 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924adaa-0d61-4745-a6c2-3a026166eb6a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:48.661379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924adaa-0d61-4745-a6c2-3a026166eb6a None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:48.662801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 690/1404] 10.222.0.18 () {54 vars in 942 bytes} [Thu Jun 2 13:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:48.669975 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba28217-5d77-4638-91af-0562532cce39 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:48.670470 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba28217-5d77-4638-91af-0562532cce39 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:48.670558 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba28217-5d77-4638-91af-0562532cce39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:48.732702 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-fba28217-5d77-4638-91af-0562532cce39 None None] MFA Rules not processed for user `8cd0e37b0404419bb5752228bd809be4`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:48.734482 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fba28217-5d77-4638-91af-0562532cce39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:48.750615 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:48.817033 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 715/1405] 10.222.0.18 () {58 vars in 1039 bytes} [Thu Jun 2 13:32:48 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:48.827037 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924adaa-0d61-4745-a6c2-3a026166eb6a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:48.844685 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924adaa-0d61-4745-a6c2-3a026166eb6a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:48.850117 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cb4ce-f34a-449f-b6b5-477e85493e0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd0e37b0404419bb5752228bd809be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:48.850836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cb4ce-f34a-449f-b6b5-477e85493e0a service swift] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:48.851118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cb4ce-f34a-449f-b6b5-477e85493e0a service swift] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:48.851396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cb4ce-f34a-449f-b6b5-477e85493e0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:48.860877 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cb4ce-f34a-449f-b6b5-477e85493e0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:48.862518 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cb4ce-f34a-449f-b6b5-477e85493e0a service swift] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:48.871606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 691/1406] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 13:32:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:32:50.956113 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acd2f2-1923-48dd-bc1b-2f58c8c49b0a None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:50.956732 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acd2f2-1923-48dd-bc1b-2f58c8c49b0a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:50.956732 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acd2f2-1923-48dd-bc1b-2f58c8c49b0a None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:50.958025 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 716/1407] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:50.963811 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb2bbd-46b1-419a-88cc-e16335d8c5a3 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:50.964263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb2bbd-46b1-419a-88cc-e16335d8c5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:50.964562 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb2bbd-46b1-419a-88cc-e16335d8c5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:50.983245 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-58fb2bbd-46b1-419a-88cc-e16335d8c5a3 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:50.984509 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-58fb2bbd-46b1-419a-88cc-e16335d8c5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:50.993437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 692/1408] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:51.037805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88acd2f2-1923-48dd-bc1b-2f58c8c49b0a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:51.052646 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88acd2f2-1923-48dd-bc1b-2f58c8c49b0a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:51.058413 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02000629-1eb2-4489-8528-eb5c40cc64f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:51.059168 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02000629-1eb2-4489-8528-eb5c40cc64f1 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:51.059503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02000629-1eb2-4489-8528-eb5c40cc64f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:51.059839 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02000629-1eb2-4489-8528-eb5c40cc64f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:51.068385 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02000629-1eb2-4489-8528-eb5c40cc64f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:51.070066 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02000629-1eb2-4489-8528-eb5c40cc64f1 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:51.079782 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 717/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:33:00.977597 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=87 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:01.227139 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=30 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:12.417992 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30cbd8-5e8d-42a7-8818-1e0fe4a801a7 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:12.418796 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30cbd8-5e8d-42a7-8818-1e0fe4a801a7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:12.418796 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30cbd8-5e8d-42a7-8818-1e0fe4a801a7 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:12.420084 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 693/1410] 10.222.0.18 () {54 vars in 918 bytes} [Thu Jun 2 13:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:12.426193 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d75c43-b41d-4734-8ff2-9233226da3dc None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:12.426647 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d75c43-b41d-4734-8ff2-9233226da3dc None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:12.426764 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d75c43-b41d-4734-8ff2-9233226da3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:12.453562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e8d75c43-b41d-4734-8ff2-9233226da3dc None None] MFA Rules not processed for user `2f7ea9741a5d409d87b8ebb4390a74ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:12.454810 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e8d75c43-b41d-4734-8ff2-9233226da3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:12.463844 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 718/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Thu Jun 2 13:33:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:33:12.483463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ef03b-c74a-44ed-bcf5-0fbab959fa71 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:12.483747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ef03b-c74a-44ed-bcf5-0fbab959fa71 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:12.484017 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ef03b-c74a-44ed-bcf5-0fbab959fa71 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:12.485385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 694/1412] 10.222.0.18 () {54 vars in 918 bytes} [Thu Jun 2 13:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:12.490106 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232f7a0-e34a-4b3c-af0a-0c500fe1f4d3 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:12.490393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232f7a0-e34a-4b3c-af0a-0c500fe1f4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:12.490696 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232f7a0-e34a-4b3c-af0a-0c500fe1f4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:12.508969 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4232f7a0-e34a-4b3c-af0a-0c500fe1f4d3 None None] MFA Rules not processed for user `5a0061e2927843cf86769d2beab18743`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:12.510129 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4232f7a0-e34a-4b3c-af0a-0c500fe1f4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:12.520414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 719/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Thu Jun 2 13:33:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:33:15.282393 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50376c7a-73a5-4c38-9df5-51b72f480a64 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:15.282981 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50376c7a-73a5-4c38-9df5-51b72f480a64 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:15.282981 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50376c7a-73a5-4c38-9df5-51b72f480a64 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:15.284346 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 695/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:15.290854 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c368fcb-4081-4ce1-a47e-f6f1584532b3 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:15.291287 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c368fcb-4081-4ce1-a47e-f6f1584532b3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:15.291406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c368fcb-4081-4ce1-a47e-f6f1584532b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:15.311101 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2c368fcb-4081-4ce1-a47e-f6f1584532b3 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:15.312373 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2c368fcb-4081-4ce1-a47e-f6f1584532b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:15.321959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 720/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:33:15.370178 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50376c7a-73a5-4c38-9df5-51b72f480a64 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:15.387543 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50376c7a-73a5-4c38-9df5-51b72f480a64 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:15.393470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178f968-8462-43f9-9f40-152334aef78c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:15.394105 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178f968-8462-43f9-9f40-152334aef78c service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:15.394392 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178f968-8462-43f9-9f40-152334aef78c service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:15.394700 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178f968-8462-43f9-9f40-152334aef78c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:15.403390 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178f968-8462-43f9-9f40-152334aef78c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:15.404955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178f968-8462-43f9-9f40-152334aef78c service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:15.414223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 696/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:33:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:33:16.394824 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9addb8-d028-44dc-8f1f-ca7756e971dc None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:16.395473 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9addb8-d028-44dc-8f1f-ca7756e971dc None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:16.395473 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9addb8-d028-44dc-8f1f-ca7756e971dc None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:16.397261 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 721/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:33:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:16.403471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e20c8-98af-42ee-9d3f-fa1762e750f0 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:16.403934 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e20c8-98af-42ee-9d3f-fa1762e750f0 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:16.404048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e20c8-98af-42ee-9d3f-fa1762e750f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:16.423215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-661e20c8-98af-42ee-9d3f-fa1762e750f0 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:16.424419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-661e20c8-98af-42ee-9d3f-fa1762e750f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:16.434109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 697/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:33:16.590188 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9addb8-d028-44dc-8f1f-ca7756e971dc None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:16.609232 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9addb8-d028-44dc-8f1f-ca7756e971dc None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:16.619654 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f8954-949c-439e-8163-6ef4f23da14f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:16.620635 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f8954-949c-439e-8163-6ef4f23da14f service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:16.621000 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f8954-949c-439e-8163-6ef4f23da14f service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:16.621398 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f8954-949c-439e-8163-6ef4f23da14f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:16.630281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f8954-949c-439e-8163-6ef4f23da14f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:16.631935 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f8954-949c-439e-8163-6ef4f23da14f service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:16.642685 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 722/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:33:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:33:17.574876 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcf163-deaa-41de-b233-af3bb9b76a76 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:17.575551 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcf163-deaa-41de-b233-af3bb9b76a76 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:17.575551 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcf163-deaa-41de-b233-af3bb9b76a76 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:17.576594 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 698/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:17.582795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf7aa9-dec1-4d62-96d9-6140a0f09068 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:17.583511 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf7aa9-dec1-4d62-96d9-6140a0f09068 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:17.583655 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf7aa9-dec1-4d62-96d9-6140a0f09068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:17.611674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-bddf7aa9-dec1-4d62-96d9-6140a0f09068 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:17.612940 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-bddf7aa9-dec1-4d62-96d9-6140a0f09068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:17.622861 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 723/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:33:17.772572 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcf163-deaa-41de-b233-af3bb9b76a76 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:17.794154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcf163-deaa-41de-b233-af3bb9b76a76 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:17.802286 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf869a05-6315-4303-b872-54614c345d46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:17.803259 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf869a05-6315-4303-b872-54614c345d46 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:17.803633 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf869a05-6315-4303-b872-54614c345d46 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:17.803946 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf869a05-6315-4303-b872-54614c345d46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:17.814969 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf869a05-6315-4303-b872-54614c345d46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:17.816549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf869a05-6315-4303-b872-54614c345d46 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:17.827204 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 699/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:33:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:33:18.733818 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109e409-b49f-4c00-a690-5e8b8435d147 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:18.734423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109e409-b49f-4c00-a690-5e8b8435d147 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:18.734423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109e409-b49f-4c00-a690-5e8b8435d147 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:18.735743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 724/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:18.741920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c810af-1c54-4735-88c8-5c8deea25b82 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:18.742372 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c810af-1c54-4735-88c8-5c8deea25b82 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:18.742481 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c810af-1c54-4735-88c8-5c8deea25b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:18.762219 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-92c810af-1c54-4735-88c8-5c8deea25b82 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:18.763445 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-92c810af-1c54-4735-88c8-5c8deea25b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:18.772123 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 700/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:33:18.935709 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109e409-b49f-4c00-a690-5e8b8435d147 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:18.957114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109e409-b49f-4c00-a690-5e8b8435d147 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:18.966186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb48c6-6d50-452b-a64a-d0f5568ffe8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:18.967213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb48c6-6d50-452b-a64a-d0f5568ffe8b service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:18.967615 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb48c6-6d50-452b-a64a-d0f5568ffe8b service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:18.967985 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb48c6-6d50-452b-a64a-d0f5568ffe8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:18.981638 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb48c6-6d50-452b-a64a-d0f5568ffe8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:18.983275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb48c6-6d50-452b-a64a-d0f5568ffe8b service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:18.993701 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 725/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:33:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:33:19.941910 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c6a3b-5013-44ea-ad07-dae437096bab None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:19.942814 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c6a3b-5013-44ea-ad07-dae437096bab None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:19.942915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c6a3b-5013-44ea-ad07-dae437096bab None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:19.945071 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 701/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:33:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:19.953085 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6112c1-581f-4ca4-9dc0-b5d91bcb9bd2 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:19.953540 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6112c1-581f-4ca4-9dc0-b5d91bcb9bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:19.953650 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6112c1-581f-4ca4-9dc0-b5d91bcb9bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:19.982035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ec6112c1-581f-4ca4-9dc0-b5d91bcb9bd2 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:19.983222 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ec6112c1-581f-4ca4-9dc0-b5d91bcb9bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:19.992668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 726/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:33:20.143995 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c6a3b-5013-44ea-ad07-dae437096bab None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:20.160243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c6a3b-5013-44ea-ad07-dae437096bab None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:20.166235 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4a699-4bae-4d89-9f20-38cbc3a1a22d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:20.166921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4a699-4bae-4d89-9f20-38cbc3a1a22d service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:20.167197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4a699-4bae-4d89-9f20-38cbc3a1a22d service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:20.167470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4a699-4bae-4d89-9f20-38cbc3a1a22d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:20.176974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4a699-4bae-4d89-9f20-38cbc3a1a22d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:20.178599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4a699-4bae-4d89-9f20-38cbc3a1a22d service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:20.188181 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 702/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:33:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:33:21.039262 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a612f9-d490-4f13-9d78-4a818b0a641f None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:21.040134 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a612f9-d490-4f13-9d78-4a818b0a641f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:21.040134 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a612f9-d490-4f13-9d78-4a818b0a641f None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:21.042237 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 727/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:33:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:21.048826 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4dd48-36ce-4a8f-8667-3d061d084fc4 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:21.049289 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4dd48-36ce-4a8f-8667-3d061d084fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:21.049387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4dd48-36ce-4a8f-8667-3d061d084fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:21.072675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-48a4dd48-36ce-4a8f-8667-3d061d084fc4 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:21.073888 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-48a4dd48-36ce-4a8f-8667-3d061d084fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:21.083559 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 703/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:33:21.233957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a612f9-d490-4f13-9d78-4a818b0a641f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:21.255646 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a612f9-d490-4f13-9d78-4a818b0a641f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:21.265144 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec8fc2-9bcb-45f2-bbf0-eb6386dfe752 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:21.265788 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec8fc2-9bcb-45f2-bbf0-eb6386dfe752 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:21.266101 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec8fc2-9bcb-45f2-bbf0-eb6386dfe752 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:21.266374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec8fc2-9bcb-45f2-bbf0-eb6386dfe752 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:21.275322 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec8fc2-9bcb-45f2-bbf0-eb6386dfe752 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:21.276923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec8fc2-9bcb-45f2-bbf0-eb6386dfe752 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:21.287081 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 728/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:33:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:33:22.143448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e6ed5-e2d0-4b9a-88d0-18443278059b None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:22.143896 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e6ed5-e2d0-4b9a-88d0-18443278059b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:22.144009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e6ed5-e2d0-4b9a-88d0-18443278059b None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:22.145383 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 704/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:22.151003 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cc84a-dcdd-4a7c-9038-0aaf501ce5f1 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:22.151501 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cc84a-dcdd-4a7c-9038-0aaf501ce5f1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:22.151609 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cc84a-dcdd-4a7c-9038-0aaf501ce5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:22.176360 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4d5cc84a-dcdd-4a7c-9038-0aaf501ce5f1 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:22.177549 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4d5cc84a-dcdd-4a7c-9038-0aaf501ce5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:22.186124 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 729/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:33:22.340527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e6ed5-e2d0-4b9a-88d0-18443278059b None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:22.358869 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e6ed5-e2d0-4b9a-88d0-18443278059b None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:22.365704 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a90aff-d45f-4427-850e-5ac62aa85ab1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:22.366346 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a90aff-d45f-4427-850e-5ac62aa85ab1 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:22.366644 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a90aff-d45f-4427-850e-5ac62aa85ab1 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:22.366942 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a90aff-d45f-4427-850e-5ac62aa85ab1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:22.375865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a90aff-d45f-4427-850e-5ac62aa85ab1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:22.377436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a90aff-d45f-4427-850e-5ac62aa85ab1 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:22.387003 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 705/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:33:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:33:23.241679 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aa43e-5427-4a2a-b1d9-183a1522062e None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:23.242289 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aa43e-5427-4a2a-b1d9-183a1522062e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:23.242289 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aa43e-5427-4a2a-b1d9-183a1522062e None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:23.243762 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 730/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:33:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:23.250177 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3556b1-518b-431a-bbea-37bb5f7f19d4 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:23.250673 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3556b1-518b-431a-bbea-37bb5f7f19d4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:23.250790 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3556b1-518b-431a-bbea-37bb5f7f19d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:23.269577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-4e3556b1-518b-431a-bbea-37bb5f7f19d4 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:23.270821 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4e3556b1-518b-431a-bbea-37bb5f7f19d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:23.280126 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 706/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:33:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:33:23.431563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741aa43e-5427-4a2a-b1d9-183a1522062e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:23.455183 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741aa43e-5427-4a2a-b1d9-183a1522062e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:23.462160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3c6da-054a-475e-8d50-60f34538b97f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:23.462834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3c6da-054a-475e-8d50-60f34538b97f service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:23.463107 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3c6da-054a-475e-8d50-60f34538b97f service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:23.463400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3c6da-054a-475e-8d50-60f34538b97f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:23.472411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e3c6da-054a-475e-8d50-60f34538b97f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:23.474008 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e3c6da-054a-475e-8d50-60f34538b97f service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:23.483727 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 731/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:33:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:33:24.338090 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58036046-aa28-4d63-80d6-6a1afbf616c8 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:24.338694 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58036046-aa28-4d63-80d6-6a1afbf616c8 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:24.338694 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58036046-aa28-4d63-80d6-6a1afbf616c8 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:24.340097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 707/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:24.348745 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a563a9-26a1-459a-b4a4-14968c24e73c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:24.349446 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a563a9-26a1-459a-b4a4-14968c24e73c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:24.349650 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a563a9-26a1-459a-b4a4-14968c24e73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:24.371795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-00a563a9-26a1-459a-b4a4-14968c24e73c None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:24.372974 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-00a563a9-26a1-459a-b4a4-14968c24e73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:24.382256 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 732/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:33:24.533964 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58036046-aa28-4d63-80d6-6a1afbf616c8 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:24.557906 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58036046-aa28-4d63-80d6-6a1afbf616c8 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:24.565479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668aca7d-4798-4b6f-98f0-91dd80cfb280 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:24.566115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668aca7d-4798-4b6f-98f0-91dd80cfb280 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:24.566391 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668aca7d-4798-4b6f-98f0-91dd80cfb280 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:24.566694 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668aca7d-4798-4b6f-98f0-91dd80cfb280 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:24.575574 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668aca7d-4798-4b6f-98f0-91dd80cfb280 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:24.577221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668aca7d-4798-4b6f-98f0-91dd80cfb280 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:24.587402 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 708/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:33:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:33:26.687817 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae37796-9bbd-414c-927d-05f4c0d5426c None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:26.688368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae37796-9bbd-414c-927d-05f4c0d5426c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:26.688368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae37796-9bbd-414c-927d-05f4c0d5426c None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:26.689638 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 733/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:26.696103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d30f0-7574-4f7f-858e-96ae7d276683 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:26.696825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d30f0-7574-4f7f-858e-96ae7d276683 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:26.697000 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d30f0-7574-4f7f-858e-96ae7d276683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:26.717648 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-4d3d30f0-7574-4f7f-858e-96ae7d276683 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:26.718904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4d3d30f0-7574-4f7f-858e-96ae7d276683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:26.727120 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 709/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:33:26.766384 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae37796-9bbd-414c-927d-05f4c0d5426c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:26.780089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae37796-9bbd-414c-927d-05f4c0d5426c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:26.784310 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bc5de-45dd-43ab-8c4b-f98cc2e613b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:26.784948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bc5de-45dd-43ab-8c4b-f98cc2e613b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:26.785228 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bc5de-45dd-43ab-8c4b-f98cc2e613b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:26.785495 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bc5de-45dd-43ab-8c4b-f98cc2e613b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:26.794627 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bc5de-45dd-43ab-8c4b-f98cc2e613b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:26.796049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bc5de-45dd-43ab-8c4b-f98cc2e613b7 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:26.806297 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 734/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:33:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:33:29.181597 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19660c-eee7-48ec-8dec-42d7ee1b6b07 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:29.181597 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19660c-eee7-48ec-8dec-42d7ee1b6b07 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:29.182291 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19660c-eee7-48ec-8dec-42d7ee1b6b07 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:29.183178 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 710/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:33:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:29.189276 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60cfac-f4b1-4a9b-a730-3dead0f72509 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:29.189688 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60cfac-f4b1-4a9b-a730-3dead0f72509 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:29.189821 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60cfac-f4b1-4a9b-a730-3dead0f72509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:29.217845 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-de60cfac-f4b1-4a9b-a730-3dead0f72509 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:29.219129 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-de60cfac-f4b1-4a9b-a730-3dead0f72509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:29.232761 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 735/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:33:29.277436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19660c-eee7-48ec-8dec-42d7ee1b6b07 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:29.290148 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19660c-eee7-48ec-8dec-42d7ee1b6b07 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:29.295138 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f19897-01ab-4828-9005-f62ea8d95eab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:29.295800 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f19897-01ab-4828-9005-f62ea8d95eab service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:29.296076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f19897-01ab-4828-9005-f62ea8d95eab service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:29.296344 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f19897-01ab-4828-9005-f62ea8d95eab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:29.307025 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f19897-01ab-4828-9005-f62ea8d95eab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:29.308446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f19897-01ab-4828-9005-f62ea8d95eab service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:29.318746 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 711/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:33:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:33:31.878144 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0a480-faf4-4c88-9de7-d13de3d8acf6 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:31.878875 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0a480-faf4-4c88-9de7-d13de3d8acf6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:31.878875 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0a480-faf4-4c88-9de7-d13de3d8acf6 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:31.880151 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 736/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:31.885655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb829f-faa2-4b3c-9259-e2e35b3e33c8 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:31.886079 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb829f-faa2-4b3c-9259-e2e35b3e33c8 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:31.886079 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb829f-faa2-4b3c-9259-e2e35b3e33c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:31.905851 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-b7bb829f-faa2-4b3c-9259-e2e35b3e33c8 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:31.907102 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b7bb829f-faa2-4b3c-9259-e2e35b3e33c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:31.918618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 712/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:33:31.961323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0a480-faf4-4c88-9de7-d13de3d8acf6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:31.979551 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0a480-faf4-4c88-9de7-d13de3d8acf6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:31.984971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb39ecd-d80e-445c-8e6f-b6834b6d4d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:31.985607 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb39ecd-d80e-445c-8e6f-b6834b6d4d53 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:31.985894 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb39ecd-d80e-445c-8e6f-b6834b6d4d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:31.986159 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb39ecd-d80e-445c-8e6f-b6834b6d4d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:31.996024 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb39ecd-d80e-445c-8e6f-b6834b6d4d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:31.997543 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb39ecd-d80e-445c-8e6f-b6834b6d4d53 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:32.007734 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 737/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:33:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:33:34.374834 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64221fd-045e-42e8-bc43-5ae353d8571d None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:34.375447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64221fd-045e-42e8-bc43-5ae353d8571d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:34.375447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64221fd-045e-42e8-bc43-5ae353d8571d None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:34.376803 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 713/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:33:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:34.383892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a9837-eee0-492e-b85a-f1a57c37db9f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:34.384588 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a9837-eee0-492e-b85a-f1a57c37db9f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:34.385163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a9837-eee0-492e-b85a-f1a57c37db9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:34.413394 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e79a9837-eee0-492e-b85a-f1a57c37db9f None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:34.414616 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e79a9837-eee0-492e-b85a-f1a57c37db9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:34.424742 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 738/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:33:34.464135 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64221fd-045e-42e8-bc43-5ae353d8571d None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:34.476443 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64221fd-045e-42e8-bc43-5ae353d8571d None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:34.481043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83536e-76a3-490e-8723-acde0349ca12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:34.481689 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83536e-76a3-490e-8723-acde0349ca12 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:34.481945 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83536e-76a3-490e-8723-acde0349ca12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:34.482240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83536e-76a3-490e-8723-acde0349ca12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:34.492211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83536e-76a3-490e-8723-acde0349ca12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:34.493640 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83536e-76a3-490e-8723-acde0349ca12 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:34.503377 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 714/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:33:36.946623 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6fd23-9ea3-4209-904c-cdca5c14e743 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:36.947535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6fd23-9ea3-4209-904c-cdca5c14e743 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:36.947535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6fd23-9ea3-4209-904c-cdca5c14e743 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:36.949732 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 739/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:33:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:36.955516 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbbfed-f2f7-4fb6-a023-d280fe1d4464 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:36.955954 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbbfed-f2f7-4fb6-a023-d280fe1d4464 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:36.956149 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbbfed-f2f7-4fb6-a023-d280fe1d4464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:36.974688 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-88bbbfed-f2f7-4fb6-a023-d280fe1d4464 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:36.975875 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-88bbbfed-f2f7-4fb6-a023-d280fe1d4464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:36.984742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 715/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:33:37.026941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6fd23-9ea3-4209-904c-cdca5c14e743 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:37.045102 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6fd23-9ea3-4209-904c-cdca5c14e743 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:37.049843 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6cda8-2ff1-41a3-984c-bc8fbe9f4ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:37.050489 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6cda8-2ff1-41a3-984c-bc8fbe9f4ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:37.050766 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6cda8-2ff1-41a3-984c-bc8fbe9f4ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:37.051059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6cda8-2ff1-41a3-984c-bc8fbe9f4ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:37.060903 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6cda8-2ff1-41a3-984c-bc8fbe9f4ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:37.062170 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6cda8-2ff1-41a3-984c-bc8fbe9f4ce4 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:37.071755 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 740/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:33:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:33:39.451339 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662430b2-c1ad-4d46-9407-320490334c0a None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:39.451935 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662430b2-c1ad-4d46-9407-320490334c0a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:39.452043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662430b2-c1ad-4d46-9407-320490334c0a None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:39.454646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 716/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:33:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:39.461191 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81337f36-dec2-45cc-84a8-fee7af4c387c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:39.461671 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81337f36-dec2-45cc-84a8-fee7af4c387c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:39.461770 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81337f36-dec2-45cc-84a8-fee7af4c387c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:39.480381 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-81337f36-dec2-45cc-84a8-fee7af4c387c None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:39.481563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-81337f36-dec2-45cc-84a8-fee7af4c387c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:39.489813 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 741/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:33:39.528666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662430b2-c1ad-4d46-9407-320490334c0a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:39.541108 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662430b2-c1ad-4d46-9407-320490334c0a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:39.545357 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e8c6a-4c47-418d-95b4-7d0c50ffa046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:39.545996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e8c6a-4c47-418d-95b4-7d0c50ffa046 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:39.546275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e8c6a-4c47-418d-95b4-7d0c50ffa046 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:39.546543 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e8c6a-4c47-418d-95b4-7d0c50ffa046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:39.555711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e8c6a-4c47-418d-95b4-7d0c50ffa046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:39.557127 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e8c6a-4c47-418d-95b4-7d0c50ffa046 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:39.566713 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 717/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:33:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:33:41.863081 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b935e5d-e611-4f11-91b3-6097a15a81e1 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:41.863982 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b935e5d-e611-4f11-91b3-6097a15a81e1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:41.863982 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b935e5d-e611-4f11-91b3-6097a15a81e1 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:41.866972 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 742/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:33:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:41.873535 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89926510-f28a-4684-a7d6-7df7982d2b82 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:41.873981 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89926510-f28a-4684-a7d6-7df7982d2b82 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:41.874085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89926510-f28a-4684-a7d6-7df7982d2b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:41.880348 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=70 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:41.894328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-89926510-f28a-4684-a7d6-7df7982d2b82 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:41.895556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-89926510-f28a-4684-a7d6-7df7982d2b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:41.904326 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 718/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:33:41.945860 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b935e5d-e611-4f11-91b3-6097a15a81e1 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:41.955946 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=73 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:41.965790 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b935e5d-e611-4f11-91b3-6097a15a81e1 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:41.970648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba6247-343c-4078-9b3c-b1930da0e9ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:41.971297 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba6247-343c-4078-9b3c-b1930da0e9ca service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:41.971574 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba6247-343c-4078-9b3c-b1930da0e9ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:41.971841 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba6247-343c-4078-9b3c-b1930da0e9ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:41.981139 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba6247-343c-4078-9b3c-b1930da0e9ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:41.982646 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba6247-343c-4078-9b3c-b1930da0e9ca service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:41.992394 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 743/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:33:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:33:44.289467 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ca7f5-9ce3-4d5b-ab92-8fb1b5fb13ec None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:44.290331 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ca7f5-9ce3-4d5b-ab92-8fb1b5fb13ec None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:44.290331 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ca7f5-9ce3-4d5b-ab92-8fb1b5fb13ec None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:44.292465 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 719/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:33:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:44.298926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b9e7d-7225-4955-b561-9e30b6a912a9 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:44.299714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b9e7d-7225-4955-b561-9e30b6a912a9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:44.299887 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b9e7d-7225-4955-b561-9e30b6a912a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:44.322540 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-cd6b9e7d-7225-4955-b561-9e30b6a912a9 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:44.323752 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cd6b9e7d-7225-4955-b561-9e30b6a912a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:44.332922 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 744/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:33:44.371422 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ca7f5-9ce3-4d5b-ab92-8fb1b5fb13ec None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:44.384086 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ca7f5-9ce3-4d5b-ab92-8fb1b5fb13ec None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:44.388417 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2e9bb-af30-4d0a-b53f-1fb0aa178ebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:44.389425 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2e9bb-af30-4d0a-b53f-1fb0aa178ebb service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:44.389708 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2e9bb-af30-4d0a-b53f-1fb0aa178ebb service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:44.390013 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2e9bb-af30-4d0a-b53f-1fb0aa178ebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:44.400560 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2e9bb-af30-4d0a-b53f-1fb0aa178ebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:44.401990 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2e9bb-af30-4d0a-b53f-1fb0aa178ebb service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:44.415485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 720/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:33:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:33:46.693832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cc7f6-96c1-4e1a-8b6d-050ffd65e0df None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:46.694386 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cc7f6-96c1-4e1a-8b6d-050ffd65e0df None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:46.694386 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cc7f6-96c1-4e1a-8b6d-050ffd65e0df None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:46.695816 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 745/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:46.702192 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89ac10-d7ec-4002-8e39-e40277872787 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:46.702639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89ac10-d7ec-4002-8e39-e40277872787 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:46.702774 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89ac10-d7ec-4002-8e39-e40277872787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:46.721796 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-fa89ac10-d7ec-4002-8e39-e40277872787 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:46.723022 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-fa89ac10-d7ec-4002-8e39-e40277872787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:46.733381 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 721/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:33:46.782403 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cc7f6-96c1-4e1a-8b6d-050ffd65e0df None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:46.797983 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cc7f6-96c1-4e1a-8b6d-050ffd65e0df None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:46.801993 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87794e-b08e-40ea-ba4d-21f937154659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:46.802660 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87794e-b08e-40ea-ba4d-21f937154659 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:46.802932 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87794e-b08e-40ea-ba4d-21f937154659 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:46.803199 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87794e-b08e-40ea-ba4d-21f937154659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:46.812829 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87794e-b08e-40ea-ba4d-21f937154659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:46.814262 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87794e-b08e-40ea-ba4d-21f937154659 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:46.824303 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 746/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:33:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:33:49.078380 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb5e35-bce8-437d-bed7-6adada4651d9 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:49.079366 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb5e35-bce8-437d-bed7-6adada4651d9 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:49.079366 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb5e35-bce8-437d-bed7-6adada4651d9 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:49.081531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 722/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:33:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:49.090642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809eee64-988c-4fca-b877-b269cb4e9e36 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:49.091434 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809eee64-988c-4fca-b877-b269cb4e9e36 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:49.091719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809eee64-988c-4fca-b877-b269cb4e9e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:49.116845 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-809eee64-988c-4fca-b877-b269cb4e9e36 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:49.118060 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-809eee64-988c-4fca-b877-b269cb4e9e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:49.127474 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 747/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:33:49.168084 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb5e35-bce8-437d-bed7-6adada4651d9 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:49.181228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb5e35-bce8-437d-bed7-6adada4651d9 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:49.185940 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ba4fd-e4f2-4cf8-a8d7-df9821ba5d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:49.186602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ba4fd-e4f2-4cf8-a8d7-df9821ba5d14 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:49.186919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ba4fd-e4f2-4cf8-a8d7-df9821ba5d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:49.187186 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ba4fd-e4f2-4cf8-a8d7-df9821ba5d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:49.196950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ba4fd-e4f2-4cf8-a8d7-df9821ba5d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:49.199309 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ba4fd-e4f2-4cf8-a8d7-df9821ba5d14 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:49.210062 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 723/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:33:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:33:59.110760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=17 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:59.205796 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=17 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:20.845325 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc783e-9045-4e2b-884b-7c4f9bb368bc None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:20.845934 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc783e-9045-4e2b-884b-7c4f9bb368bc None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:20.845934 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc783e-9045-4e2b-884b-7c4f9bb368bc None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:20.847942 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 748/1471] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:34:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:20.855875 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379a9d5-a1a9-4ca2-9d13-05f9e7a1e938 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:20.856661 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379a9d5-a1a9-4ca2-9d13-05f9e7a1e938 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:20.856938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379a9d5-a1a9-4ca2-9d13-05f9e7a1e938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:20.877788 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-e379a9d5-a1a9-4ca2-9d13-05f9e7a1e938 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:20.879017 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e379a9d5-a1a9-4ca2-9d13-05f9e7a1e938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:20.887505 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 724/1472] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:34:20.937247 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142e199-0baf-4b94-a49d-3553c1c036ed None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:20.937527 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142e199-0baf-4b94-a49d-3553c1c036ed None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:20.937800 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142e199-0baf-4b94-a49d-3553c1c036ed None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:20.939194 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 749/1473] 10.222.0.18 () {54 vars in 962 bytes} [Thu Jun 2 13:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:20.944170 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9395d-a8c6-471a-93c2-c9680cd03a9d None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:20.944453 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9395d-a8c6-471a-93c2-c9680cd03a9d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:20.944726 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9395d-a8c6-471a-93c2-c9680cd03a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:20.964135 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-c2c9395d-a8c6-471a-93c2-c9680cd03a9d None None] MFA Rules not processed for user `22df4e0d98e34758963d3b1465a3a377`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:20.965333 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c2c9395d-a8c6-471a-93c2-c9680cd03a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:20.973020 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 725/1474] 10.222.0.18 () {58 vars in 1059 bytes} [Thu Jun 2 13:34:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:34:20.980341 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142e199-0baf-4b94-a49d-3553c1c036ed None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:20.992597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142e199-0baf-4b94-a49d-3553c1c036ed None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:20.996703 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49795139-8ea9-4aa2-831d-eea492173a7c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22df4e0d98e34758963d3b1465a3a377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:20.997339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49795139-8ea9-4aa2-831d-eea492173a7c service glance] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:20.997610 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49795139-8ea9-4aa2-831d-eea492173a7c service glance] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:20.997881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49795139-8ea9-4aa2-831d-eea492173a7c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:21.007481 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49795139-8ea9-4aa2-831d-eea492173a7c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:21.008894 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49795139-8ea9-4aa2-831d-eea492173a7c service glance] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:21.018745 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 750/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:34:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:34:23.401920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2db3d6-cd74-4e2e-9ca2-4439a0d477af None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:23.402825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2db3d6-cd74-4e2e-9ca2-4439a0d477af None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:23.402825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2db3d6-cd74-4e2e-9ca2-4439a0d477af None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:23.405232 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 726/1476] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:34:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:23.412942 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b788063-d534-4b31-a786-cb3f460ed740 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:23.413412 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b788063-d534-4b31-a786-cb3f460ed740 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:23.413511 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b788063-d534-4b31-a786-cb3f460ed740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:23.431879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0b788063-d534-4b31-a786-cb3f460ed740 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:23.433068 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0b788063-d534-4b31-a786-cb3f460ed740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:23.442472 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 751/1477] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:34:23.466202 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2db3d6-cd74-4e2e-9ca2-4439a0d477af None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:23.480594 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2db3d6-cd74-4e2e-9ca2-4439a0d477af None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:23.490797 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296df95e-53e2-40ac-983a-63c2e8483f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:23.491449 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296df95e-53e2-40ac-983a-63c2e8483f56 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:23.491725 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296df95e-53e2-40ac-983a-63c2e8483f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:23.491991 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296df95e-53e2-40ac-983a-63c2e8483f56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:23.492724 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296df95e-53e2-40ac-983a-63c2e8483f56 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:23.494450 dv-cinder-836083-8-smb devstack@keystone.service[80238]: WARNING py.warnings [None req-296df95e-53e2-40ac-983a-63c2e8483f56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:34:23.494450 dv-cinder-836083-8-smb devstack@keystone.service[80238]: warnings.warn(msg) Jun 02 13:34:23.494450 dv-cinder-836083-8-smb devstack@keystone.service[80238]: Jun 02 13:34:23.495598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296df95e-53e2-40ac-983a-63c2e8483f56 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:23.515738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 727/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 13:34:23 2022] GET /identity/v3/projects => generated 2553 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:34:25.770100 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fa33c-8863-47b6-848e-e3c515e71b0a None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:25.771006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fa33c-8863-47b6-848e-e3c515e71b0a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:25.771006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fa33c-8863-47b6-848e-e3c515e71b0a None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:25.773543 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 752/1479] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:34:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:25.782839 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4113ae6-7c65-4887-99d2-cb1d638c106a None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:25.783280 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4113ae6-7c65-4887-99d2-cb1d638c106a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:25.783387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4113ae6-7c65-4887-99d2-cb1d638c106a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:25.806989 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-c4113ae6-7c65-4887-99d2-cb1d638c106a None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:25.808181 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c4113ae6-7c65-4887-99d2-cb1d638c106a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:25.817204 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 728/1480] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:34:25.863267 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780fa33c-8863-47b6-848e-e3c515e71b0a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:25.880373 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780fa33c-8863-47b6-848e-e3c515e71b0a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:25.886731 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de8579-3dcf-41e3-a217-23519ecc8acc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:25.887321 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de8579-3dcf-41e3-a217-23519ecc8acc service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:25.887590 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de8579-3dcf-41e3-a217-23519ecc8acc service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:25.887858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de8579-3dcf-41e3-a217-23519ecc8acc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:25.897026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de8579-3dcf-41e3-a217-23519ecc8acc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:25.899028 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de8579-3dcf-41e3-a217-23519ecc8acc service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:25.908978 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 753/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:34:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:34:28.368571 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ee442-2394-4546-a79e-3e91cab75381 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:28.369467 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ee442-2394-4546-a79e-3e91cab75381 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:28.369467 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ee442-2394-4546-a79e-3e91cab75381 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:28.371757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 729/1482] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:34:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:28.378211 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03212459-e094-4a89-b0a0-94d0e15f7379 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:28.378702 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03212459-e094-4a89-b0a0-94d0e15f7379 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:28.378801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03212459-e094-4a89-b0a0-94d0e15f7379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:28.397372 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-03212459-e094-4a89-b0a0-94d0e15f7379 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:28.398953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-03212459-e094-4a89-b0a0-94d0e15f7379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:28.408057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 754/1483] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:34:28.444149 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ee442-2394-4546-a79e-3e91cab75381 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:28.456202 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ee442-2394-4546-a79e-3e91cab75381 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:28.460291 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff545490-955a-4abb-aaaa-733b3c1c5621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:28.460894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff545490-955a-4abb-aaaa-733b3c1c5621 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:28.461271 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff545490-955a-4abb-aaaa-733b3c1c5621 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:28.461640 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff545490-955a-4abb-aaaa-733b3c1c5621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:28.474735 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff545490-955a-4abb-aaaa-733b3c1c5621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:28.476201 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff545490-955a-4abb-aaaa-733b3c1c5621 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:28.486122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 730/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:34:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:34:30.819422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50558ad-3e73-4d00-8634-9fd11cff4942 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:30.820044 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50558ad-3e73-4d00-8634-9fd11cff4942 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:30.820044 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50558ad-3e73-4d00-8634-9fd11cff4942 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:30.821302 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 755/1485] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:30.826844 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43471ccb-2baa-4099-a362-ed0263f58ab7 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:30.827290 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43471ccb-2baa-4099-a362-ed0263f58ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:30.827509 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43471ccb-2baa-4099-a362-ed0263f58ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:30.847144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-43471ccb-2baa-4099-a362-ed0263f58ab7 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:30.848316 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-43471ccb-2baa-4099-a362-ed0263f58ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:30.857478 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 731/1486] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:34:30.895390 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50558ad-3e73-4d00-8634-9fd11cff4942 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:30.907106 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50558ad-3e73-4d00-8634-9fd11cff4942 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:30.910979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b40a0-be2c-4b36-83a2-c7fe1cb74f93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:30.911620 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b40a0-be2c-4b36-83a2-c7fe1cb74f93 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:30.911892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b40a0-be2c-4b36-83a2-c7fe1cb74f93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:30.912153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b40a0-be2c-4b36-83a2-c7fe1cb74f93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:30.922211 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b40a0-be2c-4b36-83a2-c7fe1cb74f93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:30.923670 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b40a0-be2c-4b36-83a2-c7fe1cb74f93 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:30.933329 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 756/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:34:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:34:33.337391 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b8ecf-0d1b-40e3-bb10-a4f39403f8d0 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:33.338343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b8ecf-0d1b-40e3-bb10-a4f39403f8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:33.338343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b8ecf-0d1b-40e3-bb10-a4f39403f8d0 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:33.340570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 732/1488] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:34:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:33.348822 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6302fa8-c61e-4e49-baf8-04771f511103 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:33.349271 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6302fa8-c61e-4e49-baf8-04771f511103 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:33.349365 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6302fa8-c61e-4e49-baf8-04771f511103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:33.368593 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b6302fa8-c61e-4e49-baf8-04771f511103 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:33.369764 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b6302fa8-c61e-4e49-baf8-04771f511103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:33.383536 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 757/1489] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:34:33.424236 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b8ecf-0d1b-40e3-bb10-a4f39403f8d0 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:33.436366 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b8ecf-0d1b-40e3-bb10-a4f39403f8d0 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:33.440503 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112dcd51-ed20-4c98-afa2-c840dedec271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:33.441139 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dcd51-ed20-4c98-afa2-c840dedec271 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:33.441419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dcd51-ed20-4c98-afa2-c840dedec271 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:33.441690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dcd51-ed20-4c98-afa2-c840dedec271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:33.451600 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112dcd51-ed20-4c98-afa2-c840dedec271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:33.453700 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112dcd51-ed20-4c98-afa2-c840dedec271 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:33.463489 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 733/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:34:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:34:35.946278 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b40401-4fe8-4ef1-a87c-830c9aea4303 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:35.947284 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b40401-4fe8-4ef1-a87c-830c9aea4303 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:35.947284 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b40401-4fe8-4ef1-a87c-830c9aea4303 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:35.949368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 758/1491] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 13:34:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:35.956509 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e576d67-423f-4fef-9e6f-1a4b5f832ac5 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:35.956973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e576d67-423f-4fef-9e6f-1a4b5f832ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:35.957082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e576d67-423f-4fef-9e6f-1a4b5f832ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:35.980182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-3e576d67-423f-4fef-9e6f-1a4b5f832ac5 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:35.981385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3e576d67-423f-4fef-9e6f-1a4b5f832ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:35.991290 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 734/1492] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:34:36.033197 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b40401-4fe8-4ef1-a87c-830c9aea4303 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:36.045967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b40401-4fe8-4ef1-a87c-830c9aea4303 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:36.050379 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209517d-aec1-4061-afbb-64df475d21d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:36.051046 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209517d-aec1-4061-afbb-64df475d21d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:36.051341 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209517d-aec1-4061-afbb-64df475d21d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:36.051615 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209517d-aec1-4061-afbb-64df475d21d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:36.062074 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209517d-aec1-4061-afbb-64df475d21d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:36.063534 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209517d-aec1-4061-afbb-64df475d21d4 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:36.073009 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 759/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:34:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:34:45.974644 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=33 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:46.068821 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=33 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:02.313606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bdb32-5254-40df-83c2-a07b9ba0de38 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.314561 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bdb32-5254-40df-83c2-a07b9ba0de38 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.314561 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bdb32-5254-40df-83c2-a07b9ba0de38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.342406 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-4a7bdb32-5254-40df-83c2-a07b9ba0de38 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:02.344366 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4a7bdb32-5254-40df-83c2-a07b9ba0de38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:02.353658 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 735/1494] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:02.361953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620cc54-7733-49cd-a301-0091c6b5b550 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.362435 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620cc54-7733-49cd-a301-0091c6b5b550 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.362539 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620cc54-7733-49cd-a301-0091c6b5b550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.382128 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-5620cc54-7733-49cd-a301-0091c6b5b550 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:02.383349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5620cc54-7733-49cd-a301-0091c6b5b550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:02.392644 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 760/1495] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:02.397337 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bdb32-5254-40df-83c2-a07b9ba0de38 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:02.408287 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bdb32-5254-40df-83c2-a07b9ba0de38 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:02.414331 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47487c1c-f0ae-4bad-9744-30100284704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:02.415051 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47487c1c-f0ae-4bad-9744-30100284704a admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.415329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47487c1c-f0ae-4bad-9744-30100284704a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.415601 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47487c1c-f0ae-4bad-9744-30100284704a admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.416362 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47487c1c-f0ae-4bad-9744-30100284704a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:02.416662 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47487c1c-f0ae-4bad-9744-30100284704a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:02.417673 dv-cinder-836083-8-smb devstack@keystone.service[80238]: WARNING py.warnings [None req-47487c1c-f0ae-4bad-9744-30100284704a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:36:02.417673 dv-cinder-836083-8-smb devstack@keystone.service[80238]: warnings.warn(msg) Jun 02 13:36:02.417673 dv-cinder-836083-8-smb devstack@keystone.service[80238]: Jun 02 13:36:02.418542 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47487c1c-f0ae-4bad-9744-30100284704a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:02.431092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 736/1496] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:02.439223 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620cc54-7733-49cd-a301-0091c6b5b550 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:02.448912 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620cc54-7733-49cd-a301-0091c6b5b550 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:02.454905 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f7489-926b-4c1d-a58b-c543e52ed0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:02.455567 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f7489-926b-4c1d-a58b-c543e52ed0d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.455838 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f7489-926b-4c1d-a58b-c543e52ed0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.456108 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f7489-926b-4c1d-a58b-c543e52ed0d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.456801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f7489-926b-4c1d-a58b-c543e52ed0d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:02.458556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: WARNING py.warnings [None req-400f7489-926b-4c1d-a58b-c543e52ed0d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:36:02.458556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: warnings.warn(msg) Jun 02 13:36:02.458556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: Jun 02 13:36:02.459766 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f7489-926b-4c1d-a58b-c543e52ed0d8 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:02.505698 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 761/1497] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:02 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:02.512059 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47487c1c-f0ae-4bad-9744-30100284704a admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:02.524238 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47487c1c-f0ae-4bad-9744-30100284704a admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:02.583592 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630d72c-fec9-4e98-a35c-a67b5e583c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:02.584186 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630d72c-fec9-4e98-a35c-a67b5e583c73 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.584469 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630d72c-fec9-4e98-a35c-a67b5e583c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.584742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630d72c-fec9-4e98-a35c-a67b5e583c73 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.585422 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630d72c-fec9-4e98-a35c-a67b5e583c73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:02.586444 dv-cinder-836083-8-smb devstack@keystone.service[80238]: WARNING py.warnings [None req-7630d72c-fec9-4e98-a35c-a67b5e583c73 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:36:02.586444 dv-cinder-836083-8-smb devstack@keystone.service[80238]: warnings.warn(msg) Jun 02 13:36:02.586444 dv-cinder-836083-8-smb devstack@keystone.service[80238]: Jun 02 13:36:02.587690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630d72c-fec9-4e98-a35c-a67b5e583c73 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:02.611592 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 737/1498] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:02 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:02.615955 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f7489-926b-4c1d-a58b-c543e52ed0d8 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:02.626621 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f7489-926b-4c1d-a58b-c543e52ed0d8 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:02.631918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7ef81-7061-45ce-a136-f6568c872daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:02.632603 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7ef81-7061-45ce-a136-f6568c872daf admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.632932 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7ef81-7061-45ce-a136-f6568c872daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.633207 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7ef81-7061-45ce-a136-f6568c872daf admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.633935 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7ef81-7061-45ce-a136-f6568c872daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:02.635047 dv-cinder-836083-8-smb devstack@keystone.service[80237]: WARNING py.warnings [None req-28e7ef81-7061-45ce-a136-f6568c872daf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:36:02.635047 dv-cinder-836083-8-smb devstack@keystone.service[80237]: warnings.warn(msg) Jun 02 13:36:02.635047 dv-cinder-836083-8-smb devstack@keystone.service[80237]: Jun 02 13:36:02.635921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7ef81-7061-45ce-a136-f6568c872daf admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:02.649790 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 762/1499] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:02.654021 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630d72c-fec9-4e98-a35c-a67b5e583c73 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:02.664716 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630d72c-fec9-4e98-a35c-a67b5e583c73 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:02.670121 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eaf471-292b-438c-84b4-d494388e1952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:02.670816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaf471-292b-438c-84b4-d494388e1952 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.671096 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaf471-292b-438c-84b4-d494388e1952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.671368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaf471-292b-438c-84b4-d494388e1952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.672095 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eaf471-292b-438c-84b4-d494388e1952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:02.673549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: WARNING py.warnings [None req-99eaf471-292b-438c-84b4-d494388e1952 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:36:02.673549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: warnings.warn(msg) Jun 02 13:36:02.673549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: Jun 02 13:36:02.674432 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eaf471-292b-438c-84b4-d494388e1952 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:02.687687 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 738/1500] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:02.691931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7ef81-7061-45ce-a136-f6568c872daf admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:02.702291 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7ef81-7061-45ce-a136-f6568c872daf admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:02.707200 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a433753-50e4-4005-924b-2ad143c0daf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:02.708098 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a433753-50e4-4005-924b-2ad143c0daf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.708362 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a433753-50e4-4005-924b-2ad143c0daf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.708634 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a433753-50e4-4005-924b-2ad143c0daf0 admin admin] PATH_INFO: `/v3/projects/5cd2488dfbf24d019f7efcb9cb5fcf18/users/a76177d1ab0545f4b488d8800b4fe3da/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.723722 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a433753-50e4-4005-924b-2ad143c0daf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd2488dfbf24d019f7efcb9cb5fcf18, user_id=a76177d1ab0545f4b488d8800b4fe3da, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:02.724762 dv-cinder-836083-8-smb devstack@keystone.service[80237]: WARNING py.warnings [None req-9a433753-50e4-4005-924b-2ad143c0daf0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:36:02.724762 dv-cinder-836083-8-smb devstack@keystone.service[80237]: warnings.warn(msg) Jun 02 13:36:02.724762 dv-cinder-836083-8-smb devstack@keystone.service[80237]: Jun 02 13:36:02.726662 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a433753-50e4-4005-924b-2ad143c0daf0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:02.741323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 763/1501] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:02 2022] PUT /identity/v3/projects/5cd2488dfbf24d019f7efcb9cb5fcf18/users/a76177d1ab0545f4b488d8800b4fe3da/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:02.754040 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c8a7c-bdb6-47b7-a1a6-7a5bd897e7f5 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.754326 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c8a7c-bdb6-47b7-a1a6-7a5bd897e7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.754619 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c8a7c-bdb6-47b7-a1a6-7a5bd897e7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.784038 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-173c8a7c-bdb6-47b7-a1a6-7a5bd897e7f5 None None] MFA Rules not processed for user `a76177d1ab0545f4b488d8800b4fe3da`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:02.785865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-173c8a7c-bdb6-47b7-a1a6-7a5bd897e7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:02.855987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 739/1502] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:36:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:02.869625 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b9050-8011-4408-97cd-63277b405929 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.869909 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b9050-8011-4408-97cd-63277b405929 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.870195 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b9050-8011-4408-97cd-63277b405929 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.871573 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 764/1503] 10.222.0.18 () {54 vars in 963 bytes} [Thu Jun 2 13:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:02.876918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368842a1-492f-4279-82e0-0a3984b93264 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.877206 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368842a1-492f-4279-82e0-0a3984b93264 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.877475 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368842a1-492f-4279-82e0-0a3984b93264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.896616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-368842a1-492f-4279-82e0-0a3984b93264 None None] MFA Rules not processed for user `58b2f0101284461398a95538466002bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:02.898153 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-368842a1-492f-4279-82e0-0a3984b93264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:02.952631 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:02.962294 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 740/1504] 10.222.0.18 () {58 vars in 1060 bytes} [Thu Jun 2 13:36:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:02.970088 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b9050-8011-4408-97cd-63277b405929 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:02.982191 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b9050-8011-4408-97cd-63277b405929 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:02.986006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd87014-0dad-443d-a6c8-5b7cddbcb386 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:02.986670 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd87014-0dad-443d-a6c8-5b7cddbcb386 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.986953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd87014-0dad-443d-a6c8-5b7cddbcb386 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.987226 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd87014-0dad-443d-a6c8-5b7cddbcb386 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.995687 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd87014-0dad-443d-a6c8-5b7cddbcb386 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:02.997111 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd87014-0dad-443d-a6c8-5b7cddbcb386 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:03.005999 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 765/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:03.050920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f40d5-f153-4526-98c3-c0e68d08fc79 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:03.051210 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f40d5-f153-4526-98c3-c0e68d08fc79 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:03.051488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f40d5-f153-4526-98c3-c0e68d08fc79 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:03.052795 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 741/1506] 10.222.0.18 () {52 vars in 829 bytes} [Thu Jun 2 13:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:03.056621 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd87014-0dad-443d-a6c8-5b7cddbcb386 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:03.123504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd87014-0dad-443d-a6c8-5b7cddbcb386 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:03.129501 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d551aeb-56d6-4ee8-a4da-563e4ed69cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:03.130381 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d551aeb-56d6-4ee8-a4da-563e4ed69cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:03.130733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d551aeb-56d6-4ee8-a4da-563e4ed69cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:03.130959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d551aeb-56d6-4ee8-a4da-563e4ed69cfc admin admin] PATH_INFO: `/v3/users/a76177d1ab0545f4b488d8800b4fe3da` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:03.132458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d551aeb-56d6-4ee8-a4da-563e4ed69cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a76177d1ab0545f4b488d8800b4fe3da)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:03.133479 dv-cinder-836083-8-smb devstack@keystone.service[80237]: WARNING py.warnings [None req-3d551aeb-56d6-4ee8-a4da-563e4ed69cfc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:36:03.133479 dv-cinder-836083-8-smb devstack@keystone.service[80237]: warnings.warn(msg) Jun 02 13:36:03.133479 dv-cinder-836083-8-smb devstack@keystone.service[80237]: Jun 02 13:36:03.134704 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d551aeb-56d6-4ee8-a4da-563e4ed69cfc admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:03.206019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3d551aeb-56d6-4ee8-a4da-563e4ed69cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a76177d1ab0545f4b488d8800b4fe3da'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:03.215114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3d551aeb-56d6-4ee8-a4da-563e4ed69cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a76177d1ab0545f4b488d8800b4fe3da'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:03.215747 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3d551aeb-56d6-4ee8-a4da-563e4ed69cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a76177d1ab0545f4b488d8800b4fe3da'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:03.236581 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3d551aeb-56d6-4ee8-a4da-563e4ed69cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a76177d1ab0545f4b488d8800b4fe3da'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:03.237342 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3d551aeb-56d6-4ee8-a4da-563e4ed69cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a76177d1ab0545f4b488d8800b4fe3da'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:03.247491 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:03.259630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 766/1507] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:36:03 2022] DELETE /identity/v3/users/a76177d1ab0545f4b488d8800b4fe3da => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:03.264185 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6542b1e-7453-4cb5-9a55-f4825d5492c9 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:03.264472 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6542b1e-7453-4cb5-9a55-f4825d5492c9 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:03.264748 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6542b1e-7453-4cb5-9a55-f4825d5492c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:03.283316 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-f6542b1e-7453-4cb5-9a55-f4825d5492c9 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:03.284523 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f6542b1e-7453-4cb5-9a55-f4825d5492c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:03.345393 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 742/1508] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:03.358460 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d551aeb-56d6-4ee8-a4da-563e4ed69cfc admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:03.360054 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3d551aeb-56d6-4ee8-a4da-563e4ed69cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:03.423068 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d551aeb-56d6-4ee8-a4da-563e4ed69cfc admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:03.428138 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489a702-575a-4970-8da6-b66129e643c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:03.429348 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489a702-575a-4970-8da6-b66129e643c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:03.429740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489a702-575a-4970-8da6-b66129e643c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:03.430087 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489a702-575a-4970-8da6-b66129e643c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:03.447006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489a702-575a-4970-8da6-b66129e643c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:03.449265 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489a702-575a-4970-8da6-b66129e643c0 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:03.460845 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 767/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:03.817343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6542b1e-7453-4cb5-9a55-f4825d5492c9 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:03.818901 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f6542b1e-7453-4cb5-9a55-f4825d5492c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:03.832383 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6542b1e-7453-4cb5-9a55-f4825d5492c9 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:03.837628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db05f5c-4f37-40d7-ad4d-32e346a2e28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:03.838540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db05f5c-4f37-40d7-ad4d-32e346a2e28d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:03.838841 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db05f5c-4f37-40d7-ad4d-32e346a2e28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:03.839121 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db05f5c-4f37-40d7-ad4d-32e346a2e28d admin admin] PATH_INFO: `/v3/projects/5cd2488dfbf24d019f7efcb9cb5fcf18` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:03.840317 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db05f5c-4f37-40d7-ad4d-32e346a2e28d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd2488dfbf24d019f7efcb9cb5fcf18)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:03.841487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: WARNING py.warnings [None req-1db05f5c-4f37-40d7-ad4d-32e346a2e28d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:36:03.841487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: warnings.warn(msg) Jun 02 13:36:03.841487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: Jun 02 13:36:03.842954 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db05f5c-4f37-40d7-ad4d-32e346a2e28d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:03.906481 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1db05f5c-4f37-40d7-ad4d-32e346a2e28d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd2488dfbf24d019f7efcb9cb5fcf18', 'request_id': 'req-1db05f5c-4f37-40d7-ad4d-32e346a2e28d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:03.913192 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1db05f5c-4f37-40d7-ad4d-32e346a2e28d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd2488dfbf24d019f7efcb9cb5fcf18', 'request_id': 'req-1db05f5c-4f37-40d7-ad4d-32e346a2e28d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:03.926800 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1db05f5c-4f37-40d7-ad4d-32e346a2e28d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd2488dfbf24d019f7efcb9cb5fcf18', 'request_id': 'req-1db05f5c-4f37-40d7-ad4d-32e346a2e28d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:03.944433 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1db05f5c-4f37-40d7-ad4d-32e346a2e28d admin admin] The token cache is being invalidate because project 5cd2488dfbf24d019f7efcb9cb5fcf18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:36:03.944674 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1db05f5c-4f37-40d7-ad4d-32e346a2e28d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:03.945657 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1db05f5c-4f37-40d7-ad4d-32e346a2e28d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:03.948244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 743/1510] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:36:03 2022] DELETE /identity/v3/projects/5cd2488dfbf24d019f7efcb9cb5fcf18 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:13.456258 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=29 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:13.939361 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:48.855530 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feb08f-ec81-43c5-b9ae-416b48ac373d None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:48.856153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feb08f-ec81-43c5-b9ae-416b48ac373d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:48.856153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feb08f-ec81-43c5-b9ae-416b48ac373d None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:48.857463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 768/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:37:48.863592 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08e13c-7af0-4472-87f7-a1811c47c44d None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:48.864384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08e13c-7af0-4472-87f7-a1811c47c44d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:48.864539 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08e13c-7af0-4472-87f7-a1811c47c44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:48.889543 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-cd08e13c-7af0-4472-87f7-a1811c47c44d None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:48.890791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-cd08e13c-7af0-4472-87f7-a1811c47c44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:48.958807 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 744/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:49.129150 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27feb08f-ec81-43c5-b9ae-416b48ac373d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:49.131555 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-27feb08f-ec81-43c5-b9ae-416b48ac373d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:49.212588 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27feb08f-ec81-43c5-b9ae-416b48ac373d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:49.219127 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b1c48-8b08-486c-a654-b2d62dffc0fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:49.219773 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b1c48-8b08-486c-a654-b2d62dffc0fb service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:49.220049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b1c48-8b08-486c-a654-b2d62dffc0fb service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:49.220320 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b1c48-8b08-486c-a654-b2d62dffc0fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:49.229837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b1c48-8b08-486c-a654-b2d62dffc0fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:49.231512 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b1c48-8b08-486c-a654-b2d62dffc0fb service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:49.241986 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 769/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:49.992194 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17060cb-45af-47f9-bb49-7419cd9182c7 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:49.992799 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17060cb-45af-47f9-bb49-7419cd9182c7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:49.992799 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17060cb-45af-47f9-bb49-7419cd9182c7 None None] PATH_INFO: `/v3` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:49.994198 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 745/1514] 10.222.0.57 () {54 vars in 925 bytes} [Thu Jun 2 13:37:49 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:50.001859 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba468807-d926-4fd6-bf18-3d8efd39b698 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:50.002323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba468807-d926-4fd6-bf18-3d8efd39b698 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:50.002427 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba468807-d926-4fd6-bf18-3d8efd39b698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:50.022775 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ba468807-d926-4fd6-bf18-3d8efd39b698 None None] MFA Rules not processed for user `2f7ea9741a5d409d87b8ebb4390a74ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:50.024047 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ba468807-d926-4fd6-bf18-3d8efd39b698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:50.090852 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 770/1515] 10.222.0.57 () {58 vars in 1015 bytes} [Thu Jun 2 13:37:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:50.119313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6986c-3759-45fe-bf1b-ebf46834a230 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:50.119739 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6986c-3759-45fe-bf1b-ebf46834a230 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:50.120168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6986c-3759-45fe-bf1b-ebf46834a230 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:50.122306 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 746/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:37:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:37:50.129092 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc2541-eda4-4ef8-85ac-50a43c6a512b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:50.129379 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc2541-eda4-4ef8-85ac-50a43c6a512b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:50.129898 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc2541-eda4-4ef8-85ac-50a43c6a512b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:50.150404 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d9cc2541-eda4-4ef8-85ac-50a43c6a512b None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:50.151655 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d9cc2541-eda4-4ef8-85ac-50a43c6a512b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:50.160582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 771/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:50.313335 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6986c-3759-45fe-bf1b-ebf46834a230 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:50.329287 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6986c-3759-45fe-bf1b-ebf46834a230 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:50.335189 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd0171-c466-403f-b867-4c664980a406 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:50.335821 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd0171-c466-403f-b867-4c664980a406 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:50.336102 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd0171-c466-403f-b867-4c664980a406 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:50.336373 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd0171-c466-403f-b867-4c664980a406 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:50.344753 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd0171-c466-403f-b867-4c664980a406 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:50.346344 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd0171-c466-403f-b867-4c664980a406 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:50.356320 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 747/1518] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:59.340187 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9d258-2715-4e17-ae90-96ab035ffb5e None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:59.340789 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9d258-2715-4e17-ae90-96ab035ffb5e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:59.340789 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9d258-2715-4e17-ae90-96ab035ffb5e None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:59.342108 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 772/1519] 10.222.0.18 () {54 vars in 960 bytes} [Thu Jun 2 13:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:37:59.348217 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b088c7-fdd1-42c5-b7c9-eb34cb809b65 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:59.348671 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b088c7-fdd1-42c5-b7c9-eb34cb809b65 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:59.348807 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b088c7-fdd1-42c5-b7c9-eb34cb809b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:59.372615 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-33b088c7-fdd1-42c5-b7c9-eb34cb809b65 None None] MFA Rules not processed for user `2f7ea9741a5d409d87b8ebb4390a74ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:59.373812 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-33b088c7-fdd1-42c5-b7c9-eb34cb809b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:59.384606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 748/1520] 10.222.0.18 () {58 vars in 1057 bytes} [Thu Jun 2 13:37:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:59.392865 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9d258-2715-4e17-ae90-96ab035ffb5e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:59.414756 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9d258-2715-4e17-ae90-96ab035ffb5e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:59.421162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af041924-ba7c-4f40-b8a0-a5a0952093be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f7ea9741a5d409d87b8ebb4390a74ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:59.422087 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af041924-ba7c-4f40-b8a0-a5a0952093be service placement] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:59.422449 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af041924-ba7c-4f40-b8a0-a5a0952093be service placement] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:59.422961 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af041924-ba7c-4f40-b8a0-a5a0952093be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:59.438170 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af041924-ba7c-4f40-b8a0-a5a0952093be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:59.440852 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af041924-ba7c-4f40-b8a0-a5a0952093be service placement] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:59.452854 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 773/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:38:01.674420 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3f027-f6b5-42a5-b898-a429c2fd02f0 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:01.675007 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3f027-f6b5-42a5-b898-a429c2fd02f0 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:01.675007 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3f027-f6b5-42a5-b898-a429c2fd02f0 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:01.676278 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 749/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:38:01.682617 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e7e78-265e-472b-a970-d2a919d4d627 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:01.683362 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e7e78-265e-472b-a970-d2a919d4d627 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:01.683572 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e7e78-265e-472b-a970-d2a919d4d627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:01.708299 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4f9e7e78-265e-472b-a970-d2a919d4d627 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:01.709615 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4f9e7e78-265e-472b-a970-d2a919d4d627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:01.718713 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 774/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:01.895596 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3f027-f6b5-42a5-b898-a429c2fd02f0 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:01.912294 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3f027-f6b5-42a5-b898-a429c2fd02f0 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:01.918305 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c1c1e-02a1-47b4-b8ea-3db1569c943e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:01.918977 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c1c1e-02a1-47b4-b8ea-3db1569c943e service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:01.919261 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c1c1e-02a1-47b4-b8ea-3db1569c943e service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:01.919536 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c1c1e-02a1-47b4-b8ea-3db1569c943e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:01.929898 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c1c1e-02a1-47b4-b8ea-3db1569c943e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:01.931479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c1c1e-02a1-47b4-b8ea-3db1569c943e service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:01.941357 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 750/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:38:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:38:02.854870 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09b381-daf8-433f-b68e-738a1ecdf2a8 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:02.855857 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09b381-daf8-433f-b68e-738a1ecdf2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:02.855857 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09b381-daf8-433f-b68e-738a1ecdf2a8 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:02.858144 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 775/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:38:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:38:02.863942 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533db6a3-9342-4fbb-878f-9bfa13c30ce6 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:02.864393 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533db6a3-9342-4fbb-878f-9bfa13c30ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:02.864543 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533db6a3-9342-4fbb-878f-9bfa13c30ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:02.885539 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-533db6a3-9342-4fbb-878f-9bfa13c30ce6 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:02.886655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-533db6a3-9342-4fbb-878f-9bfa13c30ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:02.897585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 751/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:38:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:03.052527 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09b381-daf8-433f-b68e-738a1ecdf2a8 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:03.073501 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09b381-daf8-433f-b68e-738a1ecdf2a8 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:03.079619 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45379e2f-0e4d-4998-8ead-7f009fe0d8f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:03.080257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45379e2f-0e4d-4998-8ead-7f009fe0d8f8 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:03.080531 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45379e2f-0e4d-4998-8ead-7f009fe0d8f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:03.080801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45379e2f-0e4d-4998-8ead-7f009fe0d8f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:03.089179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45379e2f-0e4d-4998-8ead-7f009fe0d8f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:03.090793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45379e2f-0e4d-4998-8ead-7f009fe0d8f8 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:03.100757 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 776/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:38:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:38:07.158803 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287472f-3267-49df-8aaf-4cf6e70a14ef None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:07.159663 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287472f-3267-49df-8aaf-4cf6e70a14ef None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:07.159663 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287472f-3267-49df-8aaf-4cf6e70a14ef None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:07.161852 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 752/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:38:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:38:07.171333 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e052f-7e54-4956-afd7-4ab56a5d3fe8 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:07.171758 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e052f-7e54-4956-afd7-4ab56a5d3fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:07.171960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e052f-7e54-4956-afd7-4ab56a5d3fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:07.196226 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-949e052f-7e54-4956-afd7-4ab56a5d3fe8 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:07.197441 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-949e052f-7e54-4956-afd7-4ab56a5d3fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:07.206917 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 777/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:07.246485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287472f-3267-49df-8aaf-4cf6e70a14ef None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:07.248783 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d287472f-3267-49df-8aaf-4cf6e70a14ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:07.313910 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287472f-3267-49df-8aaf-4cf6e70a14ef None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:07.317790 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2619e-ed43-48fa-b659-9bfb071ad787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:07.318440 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2619e-ed43-48fa-b659-9bfb071ad787 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:07.318762 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2619e-ed43-48fa-b659-9bfb071ad787 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:07.319034 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2619e-ed43-48fa-b659-9bfb071ad787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:07.328797 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d2619e-ed43-48fa-b659-9bfb071ad787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:07.330265 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d2619e-ed43-48fa-b659-9bfb071ad787 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:07.340931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 753/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:38:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:38:09.582267 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe95ca4-9f22-40e8-a50f-13f9b651ccc2 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:09.583295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe95ca4-9f22-40e8-a50f-13f9b651ccc2 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:09.583295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe95ca4-9f22-40e8-a50f-13f9b651ccc2 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:09.585410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 778/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:38:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:38:09.593610 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd92f63-46f1-4782-b45e-2712e939b3d1 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:09.594083 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd92f63-46f1-4782-b45e-2712e939b3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:09.594186 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd92f63-46f1-4782-b45e-2712e939b3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:09.616624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-cfd92f63-46f1-4782-b45e-2712e939b3d1 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:09.617869 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-cfd92f63-46f1-4782-b45e-2712e939b3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:09.628512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 754/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:09.674597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe95ca4-9f22-40e8-a50f-13f9b651ccc2 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:09.676513 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1fe95ca4-9f22-40e8-a50f-13f9b651ccc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:09.691236 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe95ca4-9f22-40e8-a50f-13f9b651ccc2 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:09.695426 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49fd8e-884b-448e-a5ee-4ba239921bf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:09.696067 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49fd8e-884b-448e-a5ee-4ba239921bf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:09.696346 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49fd8e-884b-448e-a5ee-4ba239921bf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:09.696615 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49fd8e-884b-448e-a5ee-4ba239921bf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:09.705978 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49fd8e-884b-448e-a5ee-4ba239921bf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:09.707446 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49fd8e-884b-448e-a5ee-4ba239921bf0 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:09.717491 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 779/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:38:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:38:13.528556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7ae64-63e1-43c2-9f55-ba8a771cc9e0 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:13.529152 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7ae64-63e1-43c2-9f55-ba8a771cc9e0 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:13.529152 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7ae64-63e1-43c2-9f55-ba8a771cc9e0 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:13.530507 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 755/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:38:13.536785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00804d2-b3e2-48e0-81c6-ae3197a78cf6 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:13.537248 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00804d2-b3e2-48e0-81c6-ae3197a78cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:13.537357 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00804d2-b3e2-48e0-81c6-ae3197a78cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:13.547024 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=91 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:13.560800 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a00804d2-b3e2-48e0-81c6-ae3197a78cf6 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:13.562146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a00804d2-b3e2-48e0-81c6-ae3197a78cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:13.571168 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 780/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:13.841541 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7ae64-63e1-43c2-9f55-ba8a771cc9e0 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:13.843655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-dde7ae64-63e1-43c2-9f55-ba8a771cc9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:13.903681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7ae64-63e1-43c2-9f55-ba8a771cc9e0 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:13.908046 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d85062-b957-40e3-9278-2dde45d60857 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:13.908689 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d85062-b957-40e3-9278-2dde45d60857 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:13.908967 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d85062-b957-40e3-9278-2dde45d60857 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:13.909233 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d85062-b957-40e3-9278-2dde45d60857 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:13.918959 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d85062-b957-40e3-9278-2dde45d60857 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:13.920552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d85062-b957-40e3-9278-2dde45d60857 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:13.925459 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:13.930440 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 756/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:38:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:38:16.188233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2559e1-c38f-4c36-9f98-6202cdd5a694 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:16.189096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2559e1-c38f-4c36-9f98-6202cdd5a694 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:16.189096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2559e1-c38f-4c36-9f98-6202cdd5a694 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:16.191421 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 781/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:38:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:38:16.200164 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f65bb-8b01-4ee4-a4ad-270357c9c384 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:16.200630 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f65bb-8b01-4ee4-a4ad-270357c9c384 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:16.200742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f65bb-8b01-4ee4-a4ad-270357c9c384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:16.221101 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-0d7f65bb-8b01-4ee4-a4ad-270357c9c384 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:16.222277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0d7f65bb-8b01-4ee4-a4ad-270357c9c384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:16.230884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 757/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:38:16.501689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2559e1-c38f-4c36-9f98-6202cdd5a694 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:16.504743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4b2559e1-c38f-4c36-9f98-6202cdd5a694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:16.522799 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2559e1-c38f-4c36-9f98-6202cdd5a694 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:16.527349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad967c-cd01-4ac9-82fc-514f10c99cde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:16.527997 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad967c-cd01-4ac9-82fc-514f10c99cde service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:16.528284 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad967c-cd01-4ac9-82fc-514f10c99cde service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:16.528555 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad967c-cd01-4ac9-82fc-514f10c99cde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:16.538838 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad967c-cd01-4ac9-82fc-514f10c99cde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:16.540267 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad967c-cd01-4ac9-82fc-514f10c99cde service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:16.550744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 782/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:38:26.215676 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:26.546287 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=8 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:50.307817 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b903d0b-e49f-4fcc-9c0e-067b03946de8 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:50.308480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b903d0b-e49f-4fcc-9c0e-067b03946de8 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:50.308480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b903d0b-e49f-4fcc-9c0e-067b03946de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:50.341884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-5b903d0b-e49f-4fcc-9c0e-067b03946de8 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:50.343576 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5b903d0b-e49f-4fcc-9c0e-067b03946de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:50.358013 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 758/1540] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:50.367114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509e5ba-0f6c-4a73-b943-8cb73ee0e930 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:50.367723 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509e5ba-0f6c-4a73-b943-8cb73ee0e930 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:50.367723 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509e5ba-0f6c-4a73-b943-8cb73ee0e930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:50.398785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a509e5ba-0f6c-4a73-b943-8cb73ee0e930 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:50.400022 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a509e5ba-0f6c-4a73-b943-8cb73ee0e930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:50.416179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 783/1541] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:50.421382 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b903d0b-e49f-4fcc-9c0e-067b03946de8 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:50.432100 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b903d0b-e49f-4fcc-9c0e-067b03946de8 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:50.441978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c81207-a5ba-4a1f-aeab-2a85347a1877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:50.443151 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c81207-a5ba-4a1f-aeab-2a85347a1877 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:50.443669 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c81207-a5ba-4a1f-aeab-2a85347a1877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:50.444258 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c81207-a5ba-4a1f-aeab-2a85347a1877 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:50.445202 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c81207-a5ba-4a1f-aeab-2a85347a1877 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:50.445719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c81207-a5ba-4a1f-aeab-2a85347a1877 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:50.447593 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c81207-a5ba-4a1f-aeab-2a85347a1877 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:50.466384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 759/1542] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:50.475726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509e5ba-0f6c-4a73-b943-8cb73ee0e930 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:50.488930 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509e5ba-0f6c-4a73-b943-8cb73ee0e930 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:50.498761 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f5095-05dd-41b3-a74c-75722d792201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:50.499607 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f5095-05dd-41b3-a74c-75722d792201 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:50.499889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f5095-05dd-41b3-a74c-75722d792201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:50.500155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f5095-05dd-41b3-a74c-75722d792201 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:50.500859 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f5095-05dd-41b3-a74c-75722d792201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:50.502928 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f5095-05dd-41b3-a74c-75722d792201 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:50.554960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 784/1543] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:39:50 2022] POST /identity/v3/projects => generated 365 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:39:50.559927 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c81207-a5ba-4a1f-aeab-2a85347a1877 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:50.572285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c81207-a5ba-4a1f-aeab-2a85347a1877 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:50.622596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0fad9-69e5-4056-b2c3-e666e2e36d2c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:50.622596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0fad9-69e5-4056-b2c3-e666e2e36d2c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:50.622596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0fad9-69e5-4056-b2c3-e666e2e36d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:50.657492 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c71de-aff9-48c7-a0fe-c8b53810f6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:50.658183 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c71de-aff9-48c7-a0fe-c8b53810f6bc admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:50.658461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c71de-aff9-48c7-a0fe-c8b53810f6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:50.658754 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c71de-aff9-48c7-a0fe-c8b53810f6bc admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:50.659460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c71de-aff9-48c7-a0fe-c8b53810f6bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:50.659587 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-55e0fad9-69e5-4056-b2c3-e666e2e36d2c None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:50.660966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-55e0fad9-69e5-4056-b2c3-e666e2e36d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:50.661476 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c71de-aff9-48c7-a0fe-c8b53810f6bc admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:50.682526 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 785/1544] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:39:50.691697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e9e39-fe54-4404-a90c-62fe59ed7655 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:50.691971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e9e39-fe54-4404-a90c-62fe59ed7655 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:50.692243 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e9e39-fe54-4404-a90c-62fe59ed7655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:50.702470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 760/1545] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:39:50 2022] POST /identity/v3/users => generated 283 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:39:50.707433 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c71de-aff9-48c7-a0fe-c8b53810f6bc admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:50.718411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c71de-aff9-48c7-a0fe-c8b53810f6bc admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:50.724711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f38e9e39-fe54-4404-a90c-62fe59ed7655 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:50.726049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f38e9e39-fe54-4404-a90c-62fe59ed7655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:50.734841 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7c921-f906-41fe-8a58-41212896fbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:50.734841 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7c921-f906-41fe-8a58-41212896fbb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:50.734841 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7c921-f906-41fe-8a58-41212896fbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:50.734841 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7c921-f906-41fe-8a58-41212896fbb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:50.735305 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7c921-f906-41fe-8a58-41212896fbb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:50.737008 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7c921-f906-41fe-8a58-41212896fbb6 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:50.740989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 786/1546] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:39:50.745986 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e9e39-fe54-4404-a90c-62fe59ed7655 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:50.761013 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e9e39-fe54-4404-a90c-62fe59ed7655 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:50.762006 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 761/1547] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:39:50.765669 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7c921-f906-41fe-8a58-41212896fbb6 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:50.774161 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d0e58-9e70-4b98-a024-5cc420e8331c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:50.774874 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d0e58-9e70-4b98-a024-5cc420e8331c admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:50.775153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d0e58-9e70-4b98-a024-5cc420e8331c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:50.775421 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d0e58-9e70-4b98-a024-5cc420e8331c admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:50.776159 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d0e58-9e70-4b98-a024-5cc420e8331c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:50.776459 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d0e58-9e70-4b98-a024-5cc420e8331c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:50.777631 dv-cinder-836083-8-smb devstack@keystone.service[80237]: WARNING py.warnings [None req-039d0e58-9e70-4b98-a024-5cc420e8331c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:39:50.777631 dv-cinder-836083-8-smb devstack@keystone.service[80237]: warnings.warn(msg) Jun 02 13:39:50.777631 dv-cinder-836083-8-smb devstack@keystone.service[80237]: Jun 02 13:39:50.778511 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d0e58-9e70-4b98-a024-5cc420e8331c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:50.780902 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7c921-f906-41fe-8a58-41212896fbb6 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:50.791603 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee6866-349d-4d28-83b4-2e9389801ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:50.793326 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee6866-349d-4d28-83b4-2e9389801ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:50.793877 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee6866-349d-4d28-83b4-2e9389801ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:50.794160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee6866-349d-4d28-83b4-2e9389801ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:50.795117 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee6866-349d-4d28-83b4-2e9389801ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:50.796768 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee6866-349d-4d28-83b4-2e9389801ad8 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:50.801039 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 787/1548] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:39:50.819007 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d0e58-9e70-4b98-a024-5cc420e8331c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:50.822182 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 762/1549] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:39:50.828480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee6866-349d-4d28-83b4-2e9389801ad8 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:50.833596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d0e58-9e70-4b98-a024-5cc420e8331c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:50.846161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee6866-349d-4d28-83b4-2e9389801ad8 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:50.852383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611d923-01c3-4c00-b00b-cf632a21a6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:50.853075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611d923-01c3-4c00-b00b-cf632a21a6a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:50.853356 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611d923-01c3-4c00-b00b-cf632a21a6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:50.855756 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f39dcc-3ca5-4fcd-9b3d-001de22f2725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:50.857411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f39dcc-3ca5-4fcd-9b3d-001de22f2725 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:50.857693 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f39dcc-3ca5-4fcd-9b3d-001de22f2725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:50.857972 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f39dcc-3ca5-4fcd-9b3d-001de22f2725 admin admin] PATH_INFO: `/v3/projects/8521c9f5b5094bf8b0570886769ca559/users/5f5d6ef71bad4b62b59e41e972bc3961/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:50.859066 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611d923-01c3-4c00-b00b-cf632a21a6a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:50.859946 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611d923-01c3-4c00-b00b-cf632a21a6a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:50.861866 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611d923-01c3-4c00-b00b-cf632a21a6a9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:50.885349 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f39dcc-3ca5-4fcd-9b3d-001de22f2725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8521c9f5b5094bf8b0570886769ca559, user_id=5f5d6ef71bad4b62b59e41e972bc3961, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:50.886398 dv-cinder-836083-8-smb devstack@keystone.service[80238]: WARNING py.warnings [None req-f2f39dcc-3ca5-4fcd-9b3d-001de22f2725 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:39:50.886398 dv-cinder-836083-8-smb devstack@keystone.service[80238]: warnings.warn(msg) Jun 02 13:39:50.886398 dv-cinder-836083-8-smb devstack@keystone.service[80238]: Jun 02 13:39:50.888622 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f39dcc-3ca5-4fcd-9b3d-001de22f2725 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:50.914597 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 763/1550] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:39:50 2022] PUT /identity/v3/projects/8521c9f5b5094bf8b0570886769ca559/users/5f5d6ef71bad4b62b59e41e972bc3961/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:39:50.915982 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1225d-63ec-49de-9d44-3875e19c07fc None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:50.916267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1225d-63ec-49de-9d44-3875e19c07fc None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:50.916538 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1225d-63ec-49de-9d44-3875e19c07fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:50.931136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 788/1551] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:39:50 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:39:50.932844 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc68fea-3939-453a-803a-b5dfd4e03137 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:50.933143 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc68fea-3939-453a-803a-b5dfd4e03137 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:50.933414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc68fea-3939-453a-803a-b5dfd4e03137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:50.940274 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-55c1225d-63ec-49de-9d44-3875e19c07fc None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:50.941469 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-55c1225d-63ec-49de-9d44-3875e19c07fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:50.977411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-dfc68fea-3939-453a-803a-b5dfd4e03137 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:50.978651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-dfc68fea-3939-453a-803a-b5dfd4e03137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:51.008787 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 764/1552] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:51.010211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c267943-cf35-44c1-b195-cba7cdce7dd3 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.010482 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c267943-cf35-44c1-b195-cba7cdce7dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.010787 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c267943-cf35-44c1-b195-cba7cdce7dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.029499 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-2c267943-cf35-44c1-b195-cba7cdce7dd3 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:51.030719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2c267943-cf35-44c1-b195-cba7cdce7dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:51.038550 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 765/1553] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:51.046069 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c50c80-07f6-405b-b1d8-ad7256b8be78 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.046069 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c50c80-07f6-405b-b1d8-ad7256b8be78 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.046069 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c50c80-07f6-405b-b1d8-ad7256b8be78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.054014 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 789/1554] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:51.055063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc68fea-3939-453a-803a-b5dfd4e03137 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:51.064556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc68fea-3939-453a-803a-b5dfd4e03137 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:51.067138 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-b7c50c80-07f6-405b-b1d8-ad7256b8be78 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:51.068435 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b7c50c80-07f6-405b-b1d8-ad7256b8be78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:51.069355 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b76fb-b5fb-4206-b2ba-f5c5d5c0ac4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:51.069967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b76fb-b5fb-4206-b2ba-f5c5d5c0ac4e admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.070241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b76fb-b5fb-4206-b2ba-f5c5d5c0ac4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.070507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b76fb-b5fb-4206-b2ba-f5c5d5c0ac4e admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.071230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b76fb-b5fb-4206-b2ba-f5c5d5c0ac4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:51.072246 dv-cinder-836083-8-smb devstack@keystone.service[80237]: WARNING py.warnings [None req-a15b76fb-b5fb-4206-b2ba-f5c5d5c0ac4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:39:51.072246 dv-cinder-836083-8-smb devstack@keystone.service[80237]: warnings.warn(msg) Jun 02 13:39:51.072246 dv-cinder-836083-8-smb devstack@keystone.service[80237]: Jun 02 13:39:51.073431 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b76fb-b5fb-4206-b2ba-f5c5d5c0ac4e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:51.076397 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 766/1555] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:51.077670 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c3e72-406f-4ca8-9f10-e584564cebc7 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.077959 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c3e72-406f-4ca8-9f10-e584564cebc7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.078229 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c3e72-406f-4ca8-9f10-e584564cebc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.098415 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:51.099540 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 790/1556] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:39:51 2022] POST /identity/v3/users => generated 286 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:39:51.102103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2616c-4342-4c64-8339-6c3277aa175c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.102807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2616c-4342-4c64-8339-6c3277aa175c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.103194 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2616c-4342-4c64-8339-6c3277aa175c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.108219 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-278c3e72-406f-4ca8-9f10-e584564cebc7 None None] MFA Rules not processed for user `5f5d6ef71bad4b62b59e41e972bc3961`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:51.109724 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-278c3e72-406f-4ca8-9f10-e584564cebc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:51.124513 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2bb2616c-4342-4c64-8339-6c3277aa175c None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:51.125671 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2bb2616c-4342-4c64-8339-6c3277aa175c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:51.134262 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 791/1557] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:51.135801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865912b4-ea1b-48a4-a20a-cfe908c5f3a8 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.136090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865912b4-ea1b-48a4-a20a-cfe908c5f3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.136493 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865912b4-ea1b-48a4-a20a-cfe908c5f3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.159602 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-865912b4-ea1b-48a4-a20a-cfe908c5f3a8 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:51.160590 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-865912b4-ea1b-48a4-a20a-cfe908c5f3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:51.168657 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 792/1558] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:51.169923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4f32f-7f2b-4d8b-93bf-7649b13ea4cb None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.170206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4f32f-7f2b-4d8b-93bf-7649b13ea4cb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.170475 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4f32f-7f2b-4d8b-93bf-7649b13ea4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.177360 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 767/1559] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:51.178674 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a72717-7f61-418f-9940-398e5d3949aa None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.179720 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a72717-7f61-418f-9940-398e5d3949aa None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.179720 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a72717-7f61-418f-9940-398e5d3949aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.189823 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-fea4f32f-7f2b-4d8b-93bf-7649b13ea4cb None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:51.191063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fea4f32f-7f2b-4d8b-93bf-7649b13ea4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:51.197527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-76a72717-7f61-418f-9940-398e5d3949aa None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:51.198723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-76a72717-7f61-418f-9940-398e5d3949aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:51.199558 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 793/1560] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:51.200823 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fda2b-ddec-4856-ab3d-8b1e55e02cdb None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.201201 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fda2b-ddec-4856-ab3d-8b1e55e02cdb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.201388 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fda2b-ddec-4856-ab3d-8b1e55e02cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.208589 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 768/1561] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:51.212093 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f26bf-b9e8-4ca9-a241-fdc1fd1a15f3 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.212384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f26bf-b9e8-4ca9-a241-fdc1fd1a15f3 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.212666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f26bf-b9e8-4ca9-a241-fdc1fd1a15f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.219497 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a78fda2b-ddec-4856-ab3d-8b1e55e02cdb None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:51.220750 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a78fda2b-ddec-4856-ab3d-8b1e55e02cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:51.229497 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 794/1562] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:51.230135 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fda2b-ddec-4856-ab3d-8b1e55e02cdb None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:51.230913 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-f91f26bf-b9e8-4ca9-a241-fdc1fd1a15f3 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:51.232065 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f91f26bf-b9e8-4ca9-a241-fdc1fd1a15f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:51.239923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fda2b-ddec-4856-ab3d-8b1e55e02cdb None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:51.240152 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 769/1563] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:51.241865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e647b-2e72-4f65-a3f4-8cf5f7a3ad65 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.242145 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e647b-2e72-4f65-a3f4-8cf5f7a3ad65 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.242416 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e647b-2e72-4f65-a3f4-8cf5f7a3ad65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.246511 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119dd74-28f1-4422-bed9-7c8727dc1625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:51.247200 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119dd74-28f1-4422-bed9-7c8727dc1625 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.247480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119dd74-28f1-4422-bed9-7c8727dc1625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.247755 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119dd74-28f1-4422-bed9-7c8727dc1625 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.248488 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119dd74-28f1-4422-bed9-7c8727dc1625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:51.250088 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119dd74-28f1-4422-bed9-7c8727dc1625 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:51.260516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 795/1564] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:39:51.261752 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-801e647b-2e72-4f65-a3f4-8cf5f7a3ad65 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:51.261912 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79166216-080c-4934-9bfa-de81e0a3fc44 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.262122 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79166216-080c-4934-9bfa-de81e0a3fc44 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.262334 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79166216-080c-4934-9bfa-de81e0a3fc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.262947 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-801e647b-2e72-4f65-a3f4-8cf5f7a3ad65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:51.272198 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 770/1565] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:51.273134 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e647b-2e72-4f65-a3f4-8cf5f7a3ad65 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:51.282793 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e647b-2e72-4f65-a3f4-8cf5f7a3ad65 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:51.286835 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-79166216-080c-4934-9bfa-de81e0a3fc44 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:51.287910 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f2a4e-6a22-402a-a79b-cf240960052c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:51.288056 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-79166216-080c-4934-9bfa-de81e0a3fc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:51.288544 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f2a4e-6a22-402a-a79b-cf240960052c admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.288856 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f2a4e-6a22-402a-a79b-cf240960052c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.289491 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f2a4e-6a22-402a-a79b-cf240960052c admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.289974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f2a4e-6a22-402a-a79b-cf240960052c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:51.291098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: WARNING py.warnings [None req-995f2a4e-6a22-402a-a79b-cf240960052c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:39:51.291098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: warnings.warn(msg) Jun 02 13:39:51.291098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: Jun 02 13:39:51.292288 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f2a4e-6a22-402a-a79b-cf240960052c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:51.297022 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 796/1566] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:51.298094 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79166216-080c-4934-9bfa-de81e0a3fc44 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:51.307895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79166216-080c-4934-9bfa-de81e0a3fc44 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:51.312849 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd69275-e714-404b-b528-d9d7b9a1cdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:51.313517 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd69275-e714-404b-b528-d9d7b9a1cdd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.313790 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd69275-e714-404b-b528-d9d7b9a1cdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.314056 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd69275-e714-404b-b528-d9d7b9a1cdd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.314817 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd69275-e714-404b-b528-d9d7b9a1cdd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:51.315205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd69275-e714-404b-b528-d9d7b9a1cdd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:51.316748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd69275-e714-404b-b528-d9d7b9a1cdd5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:51.325399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 771/1567] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:39:51 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:39:51.326284 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f2a4e-6a22-402a-a79b-cf240960052c admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:51.334617 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 797/1568] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:51.334617 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd69275-e714-404b-b528-d9d7b9a1cdd5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:51.343888 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd69275-e714-404b-b528-d9d7b9a1cdd5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:51.349405 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:51.391419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f2a4e-6a22-402a-a79b-cf240960052c admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:51.398020 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b3cc3-3246-45f5-b77f-ff49f769702b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:51.398742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b3cc3-3246-45f5-b77f-ff49f769702b admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.399028 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b3cc3-3246-45f5-b77f-ff49f769702b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.399303 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b3cc3-3246-45f5-b77f-ff49f769702b admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.400041 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b3cc3-3246-45f5-b77f-ff49f769702b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:51.400352 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b3cc3-3246-45f5-b77f-ff49f769702b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:51.401963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b3cc3-3246-45f5-b77f-ff49f769702b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:51.406546 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfb34a-b0ea-468a-a4ed-45f348d664c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:51.407291 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfb34a-b0ea-468a-a4ed-45f348d664c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.407573 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfb34a-b0ea-468a-a4ed-45f348d664c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.407873 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfb34a-b0ea-468a-a4ed-45f348d664c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.408605 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfb34a-b0ea-468a-a4ed-45f348d664c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:51.408918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfb34a-b0ea-468a-a4ed-45f348d664c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:51.410489 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfb34a-b0ea-468a-a4ed-45f348d664c8 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:51.413878 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 772/1569] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:51.414515 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b3cc3-3246-45f5-b77f-ff49f769702b admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:51.425933 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b3cc3-3246-45f5-b77f-ff49f769702b admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:51.427006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 798/1570] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:51.427760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfb34a-b0ea-468a-a4ed-45f348d664c8 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:51.436867 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f04314-12a9-418a-9b1c-069e883509ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:51.437536 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f04314-12a9-418a-9b1c-069e883509ef admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.437819 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f04314-12a9-418a-9b1c-069e883509ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.438096 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f04314-12a9-418a-9b1c-069e883509ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.438859 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f04314-12a9-418a-9b1c-069e883509ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:51.439170 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f04314-12a9-418a-9b1c-069e883509ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:51.440840 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f04314-12a9-418a-9b1c-069e883509ef admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:51.443414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfb34a-b0ea-468a-a4ed-45f348d664c8 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:51.448557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff81048-a320-4f79-8f4c-adbb8720b922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:51.455061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 773/1571] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:51.455437 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff81048-a320-4f79-8f4c-adbb8720b922 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.455716 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff81048-a320-4f79-8f4c-adbb8720b922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.455883 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f04314-12a9-418a-9b1c-069e883509ef admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:51.455970 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff81048-a320-4f79-8f4c-adbb8720b922 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.456801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff81048-a320-4f79-8f4c-adbb8720b922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:51.458436 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff81048-a320-4f79-8f4c-adbb8720b922 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:51.466012 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f04314-12a9-418a-9b1c-069e883509ef admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:51.470040 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 799/1572] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:39:51.471021 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff81048-a320-4f79-8f4c-adbb8720b922 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:51.471385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a949d9-f412-40db-a3f3-bdefc82a9a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:51.472163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a949d9-f412-40db-a3f3-bdefc82a9a9d admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.472596 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a949d9-f412-40db-a3f3-bdefc82a9a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.472936 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a949d9-f412-40db-a3f3-bdefc82a9a9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.473771 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a949d9-f412-40db-a3f3-bdefc82a9a9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:51.474163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a949d9-f412-40db-a3f3-bdefc82a9a9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:51.475989 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a949d9-f412-40db-a3f3-bdefc82a9a9d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:51.484523 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff81048-a320-4f79-8f4c-adbb8720b922 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:51.489400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b8838-8da9-4295-b996-b415f30a6b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:51.489944 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 774/1573] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:51.490087 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b8838-8da9-4295-b996-b415f30a6b7a admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.490412 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b8838-8da9-4295-b996-b415f30a6b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.490740 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a949d9-f412-40db-a3f3-bdefc82a9a9d admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:51.490834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b8838-8da9-4295-b996-b415f30a6b7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.491501 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b8838-8da9-4295-b996-b415f30a6b7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:51.491812 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b8838-8da9-4295-b996-b415f30a6b7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:51.493422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b8838-8da9-4295-b996-b415f30a6b7a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:51.510930 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 800/1574] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:51.511128 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a949d9-f412-40db-a3f3-bdefc82a9a9d admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:51.511256 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b8838-8da9-4295-b996-b415f30a6b7a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:51.514692 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc590ab2-1a18-4ad5-93ec-fa6da086a9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:51.515361 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc590ab2-1a18-4ad5-93ec-fa6da086a9cd admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.515754 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc590ab2-1a18-4ad5-93ec-fa6da086a9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.515910 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc590ab2-1a18-4ad5-93ec-fa6da086a9cd admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.516595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc590ab2-1a18-4ad5-93ec-fa6da086a9cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:51.518503 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc590ab2-1a18-4ad5-93ec-fa6da086a9cd admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:51.520931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b8838-8da9-4295-b996-b415f30a6b7a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:51.525349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0065641-1162-4173-b56b-2d9597194f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:51.526087 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0065641-1162-4173-b56b-2d9597194f94 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.526266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0065641-1162-4173-b56b-2d9597194f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.526534 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0065641-1162-4173-b56b-2d9597194f94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.527255 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0065641-1162-4173-b56b-2d9597194f94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:51.529200 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0065641-1162-4173-b56b-2d9597194f94 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:51.540593 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 775/1575] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:39:51 2022] POST /identity/v3/users => generated 289 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:39:51.541393 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc590ab2-1a18-4ad5-93ec-fa6da086a9cd admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:51.550901 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc590ab2-1a18-4ad5-93ec-fa6da086a9cd admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:51.555531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59669beb-419e-43fa-8bb8-5e2b8b31980c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:51.556171 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59669beb-419e-43fa-8bb8-5e2b8b31980c admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.559848 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59669beb-419e-43fa-8bb8-5e2b8b31980c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.560002 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 801/1576] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:39:51 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:39:51.560117 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59669beb-419e-43fa-8bb8-5e2b8b31980c admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.560219 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0065641-1162-4173-b56b-2d9597194f94 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:51.560316 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59669beb-419e-43fa-8bb8-5e2b8b31980c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:51.560316 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59669beb-419e-43fa-8bb8-5e2b8b31980c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:51.563388 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:51.589407 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 776/1577] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:39:51 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:39:51.590253 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59669beb-419e-43fa-8bb8-5e2b8b31980c admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:51.625970 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0065641-1162-4173-b56b-2d9597194f94 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:51.651680 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59669beb-419e-43fa-8bb8-5e2b8b31980c admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:51.656304 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa250baa-496b-4337-b9c1-7fad686259a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:51.656975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa250baa-496b-4337-b9c1-7fad686259a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.657260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa250baa-496b-4337-b9c1-7fad686259a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.657668 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa250baa-496b-4337-b9c1-7fad686259a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.658362 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa250baa-496b-4337-b9c1-7fad686259a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:51.660331 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa250baa-496b-4337-b9c1-7fad686259a2 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:51.689344 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 777/1578] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:39:51 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:39:51.689577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad798c02-5a09-4310-93d3-0ca485a76ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:51.689699 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa250baa-496b-4337-b9c1-7fad686259a2 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:51.689805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad798c02-5a09-4310-93d3-0ca485a76ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.689805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad798c02-5a09-4310-93d3-0ca485a76ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.689805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad798c02-5a09-4310-93d3-0ca485a76ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.689805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad798c02-5a09-4310-93d3-0ca485a76ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:51.690760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad798c02-5a09-4310-93d3-0ca485a76ce5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:51.699270 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:51.717986 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 802/1579] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:39:51 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:39:51.718853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad798c02-5a09-4310-93d3-0ca485a76ce5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:51.753883 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa250baa-496b-4337-b9c1-7fad686259a2 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:51.782520 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad798c02-5a09-4310-93d3-0ca485a76ce5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:51.787604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d15fc9-0710-49a6-bc3a-8d7ddb9e7220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:51.788568 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d15fc9-0710-49a6-bc3a-8d7ddb9e7220 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.788847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d15fc9-0710-49a6-bc3a-8d7ddb9e7220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.789123 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d15fc9-0710-49a6-bc3a-8d7ddb9e7220 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.789928 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d15fc9-0710-49a6-bc3a-8d7ddb9e7220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:51.792026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d15fc9-0710-49a6-bc3a-8d7ddb9e7220 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:51.810522 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a919a-4f36-4b90-a186-a539c3583971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:51.811509 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a919a-4f36-4b90-a186-a539c3583971 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.811790 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a919a-4f36-4b90-a186-a539c3583971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.812015 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a919a-4f36-4b90-a186-a539c3583971 admin admin] PATH_INFO: `/v3/projects/4ec89f41e677400eb16db60774ac21a4/users/687fb05f5c7b4ff19e21d5eec63fa717/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.820063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 803/1580] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:39:51 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:39:51.820911 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d15fc9-0710-49a6-bc3a-8d7ddb9e7220 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:51.831002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a919a-4f36-4b90-a186-a539c3583971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec89f41e677400eb16db60774ac21a4, user_id=687fb05f5c7b4ff19e21d5eec63fa717, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:51.833878 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a919a-4f36-4b90-a186-a539c3583971 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:51.847845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 778/1581] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:39:51 2022] PUT /identity/v3/projects/4ec89f41e677400eb16db60774ac21a4/users/687fb05f5c7b4ff19e21d5eec63fa717/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:39:51.856842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a919a-4f36-4b90-a186-a539c3583971 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:51.861781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:51.885283 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d15fc9-0710-49a6-bc3a-8d7ddb9e7220 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:51.923362 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a919a-4f36-4b90-a186-a539c3583971 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:51.929237 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97547b15-3b2e-46d6-aa8b-ea00aa3e5ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:51.929924 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97547b15-3b2e-46d6-aa8b-ea00aa3e5ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.930218 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97547b15-3b2e-46d6-aa8b-ea00aa3e5ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.930474 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97547b15-3b2e-46d6-aa8b-ea00aa3e5ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.931244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97547b15-3b2e-46d6-aa8b-ea00aa3e5ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:51.932866 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97547b15-3b2e-46d6-aa8b-ea00aa3e5ca6 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:51.943366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea59e3-e088-4d01-a2d0-4ce45ae92d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:51.944123 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea59e3-e088-4d01-a2d0-4ce45ae92d41 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.944411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea59e3-e088-4d01-a2d0-4ce45ae92d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.944686 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea59e3-e088-4d01-a2d0-4ce45ae92d41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.945379 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea59e3-e088-4d01-a2d0-4ce45ae92d41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:51.946772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 779/1582] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:39:51.947551 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea59e3-e088-4d01-a2d0-4ce45ae92d41 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:51.947701 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97547b15-3b2e-46d6-aa8b-ea00aa3e5ca6 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:51.957080 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97547b15-3b2e-46d6-aa8b-ea00aa3e5ca6 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:51.962235 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7041d19-9e39-41b0-b4a0-e0079763cb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:51.963004 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7041d19-9e39-41b0-b4a0-e0079763cb41 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:51.963280 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7041d19-9e39-41b0-b4a0-e0079763cb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:51.963606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7041d19-9e39-41b0-b4a0-e0079763cb41 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:51.964248 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7041d19-9e39-41b0-b4a0-e0079763cb41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:51.966234 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7041d19-9e39-41b0-b4a0-e0079763cb41 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:51.974982 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 804/1583] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:39:51 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:39:51.976009 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea59e3-e088-4d01-a2d0-4ce45ae92d41 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:51.988577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:51.993544 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 780/1584] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:39:51 2022] POST /identity/v3/users => generated 295 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:39:51.994375 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7041d19-9e39-41b0-b4a0-e0079763cb41 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:52.004128 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7041d19-9e39-41b0-b4a0-e0079763cb41 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.054355 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea59e3-e088-4d01-a2d0-4ce45ae92d41 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.059582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7a73c-7fbc-4af6-a7cf-716916ecf7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.060305 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7a73c-7fbc-4af6-a7cf-716916ecf7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.060578 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7a73c-7fbc-4af6-a7cf-716916ecf7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.060843 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7a73c-7fbc-4af6-a7cf-716916ecf7a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.061527 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7a73c-7fbc-4af6-a7cf-716916ecf7a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:52.063500 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7a73c-7fbc-4af6-a7cf-716916ecf7a7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:52.066545 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ed8b5-8407-441d-a3c9-b344ffb3f7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.067253 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ed8b5-8407-441d-a3c9-b344ffb3f7ed admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.067539 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ed8b5-8407-441d-a3c9-b344ffb3f7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.067811 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ed8b5-8407-441d-a3c9-b344ffb3f7ed admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.068495 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ed8b5-8407-441d-a3c9-b344ffb3f7ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:52.070376 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ed8b5-8407-441d-a3c9-b344ffb3f7ed admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:52.084718 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 805/1585] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:39:51 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:39:52.085519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7a73c-7fbc-4af6-a7cf-716916ecf7a7 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:52.092879 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 781/1586] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:39:51 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:39:52.093668 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ed8b5-8407-441d-a3c9-b344ffb3f7ed admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:52.095866 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7a73c-7fbc-4af6-a7cf-716916ecf7a7 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.101498 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae8271-f588-41a5-be14-a3f2149deec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.102131 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae8271-f588-41a5-be14-a3f2149deec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.102519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae8271-f588-41a5-be14-a3f2149deec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.102830 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae8271-f588-41a5-be14-a3f2149deec1 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.103239 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ed8b5-8407-441d-a3c9-b344ffb3f7ed admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.103551 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae8271-f588-41a5-be14-a3f2149deec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:52.105470 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae8271-f588-41a5-be14-a3f2149deec1 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:52.108046 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90e877-a256-4609-9e70-2419fef876c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.108706 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90e877-a256-4609-9e70-2419fef876c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.108986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90e877-a256-4609-9e70-2419fef876c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.109254 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90e877-a256-4609-9e70-2419fef876c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.109923 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90e877-a256-4609-9e70-2419fef876c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:52.111821 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90e877-a256-4609-9e70-2419fef876c2 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:52.131924 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 806/1587] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:39:52 2022] POST /identity/v3/users => generated 290 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:39:52.136849 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 782/1588] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:39:52 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:39:52.137016 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0727f-723e-4857-a946-33c6a297ff50 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.137016 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0727f-723e-4857-a946-33c6a297ff50 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.137194 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0727f-723e-4857-a946-33c6a297ff50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.137411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90e877-a256-4609-9e70-2419fef876c2 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:52.148611 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90e877-a256-4609-9e70-2419fef876c2 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.155839 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e65c40-07b6-404f-9cdf-9dccb60bbd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.156876 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e65c40-07b6-404f-9cdf-9dccb60bbd5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.157158 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e65c40-07b6-404f-9cdf-9dccb60bbd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.157424 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e65c40-07b6-404f-9cdf-9dccb60bbd5a admin admin] PATH_INFO: `/v3/projects/879d1d9f805a4b25b86a05efb3f5a230/users/8722d259c77f450aa3aba3441b505efc/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.164674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-03b0727f-723e-4857-a946-33c6a297ff50 None None] MFA Rules not processed for user `687fb05f5c7b4ff19e21d5eec63fa717`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:52.165969 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-03b0727f-723e-4857-a946-33c6a297ff50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:52.173511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e65c40-07b6-404f-9cdf-9dccb60bbd5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=879d1d9f805a4b25b86a05efb3f5a230, user_id=8722d259c77f450aa3aba3441b505efc, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:52.176270 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e65c40-07b6-404f-9cdf-9dccb60bbd5a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:52.190792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 783/1589] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:39:52 2022] PUT /identity/v3/projects/879d1d9f805a4b25b86a05efb3f5a230/users/8722d259c77f450aa3aba3441b505efc/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:39:52.192523 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e65c40-07b6-404f-9cdf-9dccb60bbd5a admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:52.225939 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:52.232538 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 807/1590] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:52.235684 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0727f-723e-4857-a946-33c6a297ff50 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:52.250060 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0727f-723e-4857-a946-33c6a297ff50 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.254806 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee679ce-48c2-4b93-b628-1003340caeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.255533 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee679ce-48c2-4b93-b628-1003340caeaa admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.255836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee679ce-48c2-4b93-b628-1003340caeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.256056 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee679ce-48c2-4b93-b628-1003340caeaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.256857 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee679ce-48c2-4b93-b628-1003340caeaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:52.258373 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee679ce-48c2-4b93-b628-1003340caeaa admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:52.262373 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e65c40-07b6-404f-9cdf-9dccb60bbd5a admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.272888 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 808/1591] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:39:52.272888 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee679ce-48c2-4b93-b628-1003340caeaa admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:52.273170 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f1a36-0370-42aa-ba0b-8ee8247ed907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.273170 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f1a36-0370-42aa-ba0b-8ee8247ed907 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.273170 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f1a36-0370-42aa-ba0b-8ee8247ed907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.273170 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f1a36-0370-42aa-ba0b-8ee8247ed907 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.274662 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f1a36-0370-42aa-ba0b-8ee8247ed907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:52.276595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f1a36-0370-42aa-ba0b-8ee8247ed907 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:52.282324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee679ce-48c2-4b93-b628-1003340caeaa admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.286981 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44fb28-644b-4c9f-add4-2cab5f1494a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.287641 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44fb28-644b-4c9f-add4-2cab5f1494a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.287921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44fb28-644b-4c9f-add4-2cab5f1494a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.288186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44fb28-644b-4c9f-add4-2cab5f1494a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.288906 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44fb28-644b-4c9f-add4-2cab5f1494a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:52.290481 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44fb28-644b-4c9f-add4-2cab5f1494a7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:52.297833 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 784/1592] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:39:52 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:39:52.298884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f1a36-0370-42aa-ba0b-8ee8247ed907 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:52.304320 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 809/1593] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:39:52.304320 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44fb28-644b-4c9f-add4-2cab5f1494a7 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:52.308869 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f1a36-0370-42aa-ba0b-8ee8247ed907 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.311432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44fb28-644b-4c9f-add4-2cab5f1494a7 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.313369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9affd-34ec-4282-a5c0-d9d1fbb82bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.314036 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9affd-34ec-4282-a5c0-d9d1fbb82bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.314318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9affd-34ec-4282-a5c0-d9d1fbb82bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.314631 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9affd-34ec-4282-a5c0-d9d1fbb82bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.315357 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9affd-34ec-4282-a5c0-d9d1fbb82bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:52.316112 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4ad69-74ab-40e1-8a3d-37e05fb81e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.316756 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4ad69-74ab-40e1-8a3d-37e05fb81e16 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.316941 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9affd-34ec-4282-a5c0-d9d1fbb82bc7 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:52.317037 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4ad69-74ab-40e1-8a3d-37e05fb81e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.317287 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4ad69-74ab-40e1-8a3d-37e05fb81e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.318103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4ad69-74ab-40e1-8a3d-37e05fb81e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:52.319688 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4ad69-74ab-40e1-8a3d-37e05fb81e16 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:52.327095 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 785/1594] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:39:52.327895 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9affd-34ec-4282-a5c0-d9d1fbb82bc7 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:52.330611 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 810/1595] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:39:52.330746 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4ad69-74ab-40e1-8a3d-37e05fb81e16 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:52.340189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4ad69-74ab-40e1-8a3d-37e05fb81e16 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.341459 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9affd-34ec-4282-a5c0-d9d1fbb82bc7 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.344777 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56405a34-3865-429a-9c7a-4b7efbe13cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.345526 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56405a34-3865-429a-9c7a-4b7efbe13cea admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.345807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56405a34-3865-429a-9c7a-4b7efbe13cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.346079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56405a34-3865-429a-9c7a-4b7efbe13cea admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.346236 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80aa8dd-d1bf-4bd2-8e7b-beaf38a27d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.346912 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56405a34-3865-429a-9c7a-4b7efbe13cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:52.347015 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80aa8dd-d1bf-4bd2-8e7b-beaf38a27d2e admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.347262 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80aa8dd-d1bf-4bd2-8e7b-beaf38a27d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.347542 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80aa8dd-d1bf-4bd2-8e7b-beaf38a27d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.348271 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80aa8dd-d1bf-4bd2-8e7b-beaf38a27d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:52.348485 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56405a34-3865-429a-9c7a-4b7efbe13cea admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:52.349939 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80aa8dd-d1bf-4bd2-8e7b-beaf38a27d2e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:52.362050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 811/1596] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:39:52.362050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a162f1a-860b-45ff-9041-c4b6c51c2e13 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.362050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a162f1a-860b-45ff-9041-c4b6c51c2e13 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.362393 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 786/1597] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:39:52.362485 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a162f1a-860b-45ff-9041-c4b6c51c2e13 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.362957 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80aa8dd-d1bf-4bd2-8e7b-beaf38a27d2e admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:52.363092 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 812/1598] 10.222.0.18 () {54 vars in 961 bytes} [Thu Jun 2 13:39:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:39:52.363092 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a162f1a-860b-45ff-9041-c4b6c51c2e13 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:52.373594 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80aa8dd-d1bf-4bd2-8e7b-beaf38a27d2e admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.375062 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a162f1a-860b-45ff-9041-c4b6c51c2e13 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.378279 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70155fd-da25-466e-a78f-918ac42681af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.379031 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70155fd-da25-466e-a78f-918ac42681af admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.379312 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70155fd-da25-466e-a78f-918ac42681af admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.379582 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70155fd-da25-466e-a78f-918ac42681af admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.379697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b3d0b-04f4-4a7d-ac83-546d09a28df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.380365 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b3d0b-04f4-4a7d-ac83-546d09a28df0 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.380474 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70155fd-da25-466e-a78f-918ac42681af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:52.380658 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b3d0b-04f4-4a7d-ac83-546d09a28df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.380915 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b3d0b-04f4-4a7d-ac83-546d09a28df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.381640 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b3d0b-04f4-4a7d-ac83-546d09a28df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:52.382061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70155fd-da25-466e-a78f-918ac42681af admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:52.383342 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b3d0b-04f4-4a7d-ac83-546d09a28df0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:52.392369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 787/1599] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:39:52.393175 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70155fd-da25-466e-a78f-918ac42681af admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:52.393979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 813/1600] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:39:52.394839 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b3d0b-04f4-4a7d-ac83-546d09a28df0 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:52.407259 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70155fd-da25-466e-a78f-918ac42681af admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.407461 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b3d0b-04f4-4a7d-ac83-546d09a28df0 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.411816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63413e-2015-4771-944a-80ed5e8e70cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.412028 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25587788-3f9a-46ea-8386-f8bf87ecbd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.412573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63413e-2015-4771-944a-80ed5e8e70cb admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.412715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25587788-3f9a-46ea-8386-f8bf87ecbd39 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.412858 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63413e-2015-4771-944a-80ed5e8e70cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.412954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25587788-3f9a-46ea-8386-f8bf87ecbd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.413137 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63413e-2015-4771-944a-80ed5e8e70cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.413241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25587788-3f9a-46ea-8386-f8bf87ecbd39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.413892 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63413e-2015-4771-944a-80ed5e8e70cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:52.414007 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25587788-3f9a-46ea-8386-f8bf87ecbd39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:52.415506 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25587788-3f9a-46ea-8386-f8bf87ecbd39 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:52.415642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63413e-2015-4771-944a-80ed5e8e70cb admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:52.425845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 788/1601] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:39:52.426491 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 814/1602] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:39:52.426714 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63413e-2015-4771-944a-80ed5e8e70cb admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:52.427839 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25587788-3f9a-46ea-8386-f8bf87ecbd39 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:52.433111 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:52.438542 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25587788-3f9a-46ea-8386-f8bf87ecbd39 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.439447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63413e-2015-4771-944a-80ed5e8e70cb admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.444244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe41c2c-9260-4af8-b30f-bddc8fb60c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.444413 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd0980-a8a3-4e9b-8539-13884dba38db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.444903 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe41c2c-9260-4af8-b30f-bddc8fb60c57 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.445191 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd0980-a8a3-4e9b-8539-13884dba38db admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.445310 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe41c2c-9260-4af8-b30f-bddc8fb60c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.445465 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd0980-a8a3-4e9b-8539-13884dba38db admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.445565 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe41c2c-9260-4af8-b30f-bddc8fb60c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.445732 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd0980-a8a3-4e9b-8539-13884dba38db admin admin] PATH_INFO: `/v3/projects/879d1d9f805a4b25b86a05efb3f5a230/users/8722d259c77f450aa3aba3441b505efc/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.446253 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe41c2c-9260-4af8-b30f-bddc8fb60c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:52.447710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd0980-a8a3-4e9b-8539-13884dba38db admin admin] RBAC: Authorizing `identity:create_grant(project_id=879d1d9f805a4b25b86a05efb3f5a230, user_id=8722d259c77f450aa3aba3441b505efc, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:52.447856 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe41c2c-9260-4af8-b30f-bddc8fb60c57 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:52.450308 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd0980-a8a3-4e9b-8539-13884dba38db admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:52.459356 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 789/1603] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:39:52.460262 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe41c2c-9260-4af8-b30f-bddc8fb60c57 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:52.460592 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 815/1604] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:39:52 2022] PUT /identity/v3/projects/879d1d9f805a4b25b86a05efb3f5a230/users/8722d259c77f450aa3aba3441b505efc/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:39:52.461849 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f118d-3c7c-4c1a-9e97-24c83879d1df None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.462225 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f118d-3c7c-4c1a-9e97-24c83879d1df None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.462399 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f118d-3c7c-4c1a-9e97-24c83879d1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.472416 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe41c2c-9260-4af8-b30f-bddc8fb60c57 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.481641 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b35f118d-3c7c-4c1a-9e97-24c83879d1df None None] MFA Rules not processed for user `5a0061e2927843cf86769d2beab18743`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:52.482965 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b35f118d-3c7c-4c1a-9e97-24c83879d1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:52.529071 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7adef99-abcd-4df2-879d-0f134e1ec1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.529763 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adef99-abcd-4df2-879d-0f134e1ec1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.530077 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adef99-abcd-4df2-879d-0f134e1ec1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.530362 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adef99-abcd-4df2-879d-0f134e1ec1b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.531126 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7adef99-abcd-4df2-879d-0f134e1ec1b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:52.532740 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7adef99-abcd-4df2-879d-0f134e1ec1b7 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:52.543037 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 790/1605] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:39:52.543810 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7adef99-abcd-4df2-879d-0f134e1ec1b7 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:52.552970 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 816/1606] 10.222.0.18 () {58 vars in 1058 bytes} [Thu Jun 2 13:39:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:52.553468 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7adef99-abcd-4df2-879d-0f134e1ec1b7 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.557541 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f118d-3c7c-4c1a-9e97-24c83879d1df None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:52.558266 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497cfe7c-02ce-4fbf-9bc3-dcd3da6ed758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.559363 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cfe7c-02ce-4fbf-9bc3-dcd3da6ed758 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.559907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cfe7c-02ce-4fbf-9bc3-dcd3da6ed758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.560035 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cfe7c-02ce-4fbf-9bc3-dcd3da6ed758 admin admin] PATH_INFO: `/v3/projects/f2b2788f013842c188657c8bcb59d869/users/78290c0b02cd4cf2844decf6e7569535/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.568363 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f118d-3c7c-4c1a-9e97-24c83879d1df None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.572867 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb7086-7144-49e4-b0e9-65906b7d5e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.573812 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb7086-7144-49e4-b0e9-65906b7d5e88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.574111 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb7086-7144-49e4-b0e9-65906b7d5e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.574379 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb7086-7144-49e4-b0e9-65906b7d5e88 admin admin] PATH_INFO: `/v3/projects/5ec953e62d1042de93e1e56b91ab083d/users/f0f9f36f32754886b5a66a88c229f147/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.575947 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497cfe7c-02ce-4fbf-9bc3-dcd3da6ed758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2b2788f013842c188657c8bcb59d869, user_id=78290c0b02cd4cf2844decf6e7569535, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:52.578699 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497cfe7c-02ce-4fbf-9bc3-dcd3da6ed758 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:52.590049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb7086-7144-49e4-b0e9-65906b7d5e88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ec953e62d1042de93e1e56b91ab083d, user_id=f0f9f36f32754886b5a66a88c229f147, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:52.592867 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 791/1607] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:39:52 2022] PUT /identity/v3/projects/f2b2788f013842c188657c8bcb59d869/users/78290c0b02cd4cf2844decf6e7569535/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:39:52.593735 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497cfe7c-02ce-4fbf-9bc3-dcd3da6ed758 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:52.593859 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb7086-7144-49e4-b0e9-65906b7d5e88 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:52.608748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 817/1608] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:39:52 2022] PUT /identity/v3/projects/5ec953e62d1042de93e1e56b91ab083d/users/f0f9f36f32754886b5a66a88c229f147/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:39:52.611510 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb7086-7144-49e4-b0e9-65906b7d5e88 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:52.644190 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:52.669393 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497cfe7c-02ce-4fbf-9bc3-dcd3da6ed758 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.679995 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb7086-7144-49e4-b0e9-65906b7d5e88 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.684645 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d4ce2-8235-47fc-a381-0f2732e79aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.685542 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d4ce2-8235-47fc-a381-0f2732e79aaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.685818 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d4ce2-8235-47fc-a381-0f2732e79aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.686080 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d4ce2-8235-47fc-a381-0f2732e79aaf admin admin] PATH_INFO: `/v3/projects/898189f142c046fa847b171d0bfba16a/users/bb90d2315ce54db8820d4943b1a8c53c/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.701157 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d4ce2-8235-47fc-a381-0f2732e79aaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=898189f142c046fa847b171d0bfba16a, user_id=bb90d2315ce54db8820d4943b1a8c53c, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:52.703886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d4ce2-8235-47fc-a381-0f2732e79aaf admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:52.722689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 818/1609] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:39:52 2022] PUT /identity/v3/projects/898189f142c046fa847b171d0bfba16a/users/bb90d2315ce54db8820d4943b1a8c53c/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:39:52.723675 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d4ce2-8235-47fc-a381-0f2732e79aaf admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:52.725811 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e548a1-d684-4fdc-9025-f53d8c55f6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.726488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e548a1-d684-4fdc-9025-f53d8c55f6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.726796 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e548a1-d684-4fdc-9025-f53d8c55f6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.727067 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e548a1-d684-4fdc-9025-f53d8c55f6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.727789 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e548a1-d684-4fdc-9025-f53d8c55f6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:52.729385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e548a1-d684-4fdc-9025-f53d8c55f6c6 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:52.739622 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 792/1610] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:39:52.740935 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add17b2-443a-440b-aa6e-dabb39bad819 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.741215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add17b2-443a-440b-aa6e-dabb39bad819 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.741594 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add17b2-443a-440b-aa6e-dabb39bad819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.768148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:52.775010 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-8add17b2-443a-440b-aa6e-dabb39bad819 None None] MFA Rules not processed for user `8722d259c77f450aa3aba3441b505efc`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:52.776709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8add17b2-443a-440b-aa6e-dabb39bad819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:52.791741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d4ce2-8235-47fc-a381-0f2732e79aaf admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.797149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ca805-cb92-4266-bfab-c1d1321de883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.798057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ca805-cb92-4266-bfab-c1d1321de883 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.798339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ca805-cb92-4266-bfab-c1d1321de883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.798767 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ca805-cb92-4266-bfab-c1d1321de883 admin admin] PATH_INFO: `/v3/projects/4c456e95a5d34674a02f12f4eb76d2a0/users/e3a5c3879b064a65b080faf964155c09/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.813670 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ca805-cb92-4266-bfab-c1d1321de883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c456e95a5d34674a02f12f4eb76d2a0, user_id=e3a5c3879b064a65b080faf964155c09, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:52.816392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ca805-cb92-4266-bfab-c1d1321de883 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:52.830389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 819/1611] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:39:52 2022] PUT /identity/v3/projects/4c456e95a5d34674a02f12f4eb76d2a0/users/e3a5c3879b064a65b080faf964155c09/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:39:52.831598 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ca805-cb92-4266-bfab-c1d1321de883 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:52.846403 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 793/1612] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:52 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:52.850749 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add17b2-443a-440b-aa6e-dabb39bad819 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:52.901997 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ca805-cb92-4266-bfab-c1d1321de883 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.907318 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16457ef-5da3-45c5-bfbf-35a3161d7709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.908219 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16457ef-5da3-45c5-bfbf-35a3161d7709 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.908493 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16457ef-5da3-45c5-bfbf-35a3161d7709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.908762 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16457ef-5da3-45c5-bfbf-35a3161d7709 admin admin] PATH_INFO: `/v3/projects/53fedc6ae99343a58a50790023f03c5e/users/e1cd9b4bda834e90b366d83445c85810/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.911729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:52.918295 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add17b2-443a-440b-aa6e-dabb39bad819 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.923818 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16457ef-5da3-45c5-bfbf-35a3161d7709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53fedc6ae99343a58a50790023f03c5e, user_id=e1cd9b4bda834e90b366d83445c85810, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:52.926499 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16457ef-5da3-45c5-bfbf-35a3161d7709 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:52.939423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 820/1613] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:39:52 2022] PUT /identity/v3/projects/53fedc6ae99343a58a50790023f03c5e/users/e1cd9b4bda834e90b366d83445c85810/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:39:52.940577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f2908-88d2-4e41-b35d-616d0835b3c1 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.940859 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f2908-88d2-4e41-b35d-616d0835b3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.941129 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f2908-88d2-4e41-b35d-616d0835b3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.960598 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-188f2908-88d2-4e41-b35d-616d0835b3c1 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:52.961787 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-188f2908-88d2-4e41-b35d-616d0835b3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:52.983388 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39479a7-ee5e-4791-9213-bf85743e7e48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.984053 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39479a7-ee5e-4791-9213-bf85743e7e48 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.984331 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39479a7-ee5e-4791-9213-bf85743e7e48 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.984604 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39479a7-ee5e-4791-9213-bf85743e7e48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:53.020863 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 821/1614] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:53.022324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fe05c-e7b0-47e1-9c96-0730cfb93428 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:53.022844 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fe05c-e7b0-47e1-9c96-0730cfb93428 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:53.023237 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fe05c-e7b0-47e1-9c96-0730cfb93428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:53.041302 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f63fe05c-e7b0-47e1-9c96-0730cfb93428 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:53.042639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f63fe05c-e7b0-47e1-9c96-0730cfb93428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:53.043977 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39479a7-ee5e-4791-9213-bf85743e7e48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:53.045592 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39479a7-ee5e-4791-9213-bf85743e7e48 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:53.050858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 822/1615] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:53.054250 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea8428-a41b-4985-bbd4-d024a87a66e3 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:53.054250 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea8428-a41b-4985-bbd4-d024a87a66e3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:53.054250 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea8428-a41b-4985-bbd4-d024a87a66e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:53.060387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 794/1616] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:39:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:39:53.060660 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39479a7-ee5e-4791-9213-bf85743e7e48 service nova] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:53.070660 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e0ea8428-a41b-4985-bbd4-d024a87a66e3 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:53.071363 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39479a7-ee5e-4791-9213-bf85743e7e48 service nova] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:53.071885 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e0ea8428-a41b-4985-bbd4-d024a87a66e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:53.076173 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8a33d-7196-4598-8095-574d358cb752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:53.077128 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8a33d-7196-4598-8095-574d358cb752 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:53.077464 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8a33d-7196-4598-8095-574d358cb752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:53.077802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8a33d-7196-4598-8095-574d358cb752 admin admin] PATH_INFO: `/v3/projects/fee2e71523d742e08240c25f5ec24fc0/users/a7ca43dea0744d159130177a1d790a39/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:53.079587 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 823/1617] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:53.083989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad40b8-c9ca-4c6a-89c0-3b4c09d570c4 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:53.084276 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad40b8-c9ca-4c6a-89c0-3b4c09d570c4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:53.084548 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad40b8-c9ca-4c6a-89c0-3b4c09d570c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:53.101876 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8a33d-7196-4598-8095-574d358cb752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee2e71523d742e08240c25f5ec24fc0, user_id=a7ca43dea0744d159130177a1d790a39, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:53.102980 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-30ad40b8-c9ca-4c6a-89c0-3b4c09d570c4 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:53.104117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-30ad40b8-c9ca-4c6a-89c0-3b4c09d570c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:53.105561 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8a33d-7196-4598-8095-574d358cb752 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:53.113400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 824/1618] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:53.114872 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad40b8-c9ca-4c6a-89c0-3b4c09d570c4 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:53.124988 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 795/1619] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:39:53 2022] PUT /identity/v3/projects/fee2e71523d742e08240c25f5ec24fc0/users/a7ca43dea0744d159130177a1d790a39/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:39:53.126367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf655d-22a2-4f63-b0ac-396a34660cf8 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:53.126784 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf655d-22a2-4f63-b0ac-396a34660cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:53.127151 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf655d-22a2-4f63-b0ac-396a34660cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:53.147888 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-8baf655d-22a2-4f63-b0ac-396a34660cf8 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:53.149327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8baf655d-22a2-4f63-b0ac-396a34660cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:53.151803 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:53.181247 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad40b8-c9ca-4c6a-89c0-3b4c09d570c4 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:53.212983 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 796/1620] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:53.216855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf655d-22a2-4f63-b0ac-396a34660cf8 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:53.233962 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:53.243104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f5361-5ce2-4120-9810-2cb33a6a0b65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:53.244105 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f5361-5ce2-4120-9810-2cb33a6a0b65 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:53.244426 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f5361-5ce2-4120-9810-2cb33a6a0b65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:53.244697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f5361-5ce2-4120-9810-2cb33a6a0b65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:53.275066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf655d-22a2-4f63-b0ac-396a34660cf8 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:53.278773 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502e995-fdf5-4848-ad03-fc275346fcac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:53.279439 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502e995-fdf5-4848-ad03-fc275346fcac service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:53.279731 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502e995-fdf5-4848-ad03-fc275346fcac service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:53.279981 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502e995-fdf5-4848-ad03-fc275346fcac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:53.289286 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502e995-fdf5-4848-ad03-fc275346fcac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:53.290796 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502e995-fdf5-4848-ad03-fc275346fcac service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:53.301397 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 797/1621] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:39:53.302262 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502e995-fdf5-4848-ad03-fc275346fcac service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:53.310489 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502e995-fdf5-4848-ad03-fc275346fcac service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:53.312242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f5361-5ce2-4120-9810-2cb33a6a0b65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:53.313743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f5361-5ce2-4120-9810-2cb33a6a0b65 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:53.314149 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16212b-e03e-4942-996a-fc624c396a54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:53.314821 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16212b-e03e-4942-996a-fc624c396a54 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:53.315111 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16212b-e03e-4942-996a-fc624c396a54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:53.315387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16212b-e03e-4942-996a-fc624c396a54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:53.324313 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 825/1622] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:39:53 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:39:53.325135 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f5361-5ce2-4120-9810-2cb33a6a0b65 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:53.327370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16212b-e03e-4942-996a-fc624c396a54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:53.328911 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16212b-e03e-4942-996a-fc624c396a54 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:53.335137 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f5361-5ce2-4120-9810-2cb33a6a0b65 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:53.339153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915f24e-0173-41dd-b6d5-e975553a8bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:53.339797 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 798/1623] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:39:53.340167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915f24e-0173-41dd-b6d5-e975553a8bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:53.340494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16212b-e03e-4942-996a-fc624c396a54 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:53.340610 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915f24e-0173-41dd-b6d5-e975553a8bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:53.340893 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915f24e-0173-41dd-b6d5-e975553a8bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:53.348503 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16212b-e03e-4942-996a-fc624c396a54 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:53.352906 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7006d60-1118-42e1-bb0a-30a842f10012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:53.353341 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915f24e-0173-41dd-b6d5-e975553a8bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:53.353751 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7006d60-1118-42e1-bb0a-30a842f10012 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:53.354105 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7006d60-1118-42e1-bb0a-30a842f10012 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:53.354399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7006d60-1118-42e1-bb0a-30a842f10012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:53.355148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915f24e-0173-41dd-b6d5-e975553a8bc4 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:53.366977 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7006d60-1118-42e1-bb0a-30a842f10012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:53.367699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 826/1624] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:39:53.368896 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7006d60-1118-42e1-bb0a-30a842f10012 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:53.369395 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a8b23-59dd-42e3-8422-2864781f6c00 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:53.369748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a8b23-59dd-42e3-8422-2864781f6c00 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:53.370143 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a8b23-59dd-42e3-8422-2864781f6c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:53.381120 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 799/1625] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:39:53.381978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7006d60-1118-42e1-bb0a-30a842f10012 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:53.390936 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7006d60-1118-42e1-bb0a-30a842f10012 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:53.395997 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4337d76-151f-4447-a54f-5f1b8bb8e3f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:53.396834 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4337d76-151f-4447-a54f-5f1b8bb8e3f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:53.397201 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4337d76-151f-4447-a54f-5f1b8bb8e3f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:53.397542 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4337d76-151f-4447-a54f-5f1b8bb8e3f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:53.407295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-394a8b23-59dd-42e3-8422-2864781f6c00 None None] MFA Rules not processed for user `a7ca43dea0744d159130177a1d790a39`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:53.408676 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-394a8b23-59dd-42e3-8422-2864781f6c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:53.409750 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4337d76-151f-4447-a54f-5f1b8bb8e3f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:53.412034 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4337d76-151f-4447-a54f-5f1b8bb8e3f8 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:53.424909 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 800/1626] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:39:53.426873 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b39bd-ed38-4765-a0cc-25435ffb2c9b None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:53.427591 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b39bd-ed38-4765-a0cc-25435ffb2c9b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:53.428041 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b39bd-ed38-4765-a0cc-25435ffb2c9b None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:53.430926 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 801/1627] 10.222.0.18 () {54 vars in 912 bytes} [Thu Jun 2 13:39:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:39:53.437918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4875ef-8672-4463-a7db-004f2425673c None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:53.438219 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4875ef-8672-4463-a7db-004f2425673c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:53.439806 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4875ef-8672-4463-a7db-004f2425673c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:53.483212 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-8a4875ef-8672-4463-a7db-004f2425673c None None] MFA Rules not processed for user `5a0061e2927843cf86769d2beab18743`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:53.485967 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8a4875ef-8672-4463-a7db-004f2425673c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:53.492162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 827/1628] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:53.495816 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a8b23-59dd-42e3-8422-2864781f6c00 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:53.504845 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a8b23-59dd-42e3-8422-2864781f6c00 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:53.509571 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462402e6-919b-4b4a-a5f9-8acc30b9d1bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:53.510394 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462402e6-919b-4b4a-a5f9-8acc30b9d1bc service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:53.510707 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462402e6-919b-4b4a-a5f9-8acc30b9d1bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:53.511083 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462402e6-919b-4b4a-a5f9-8acc30b9d1bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:53.518226 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:53.591054 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462402e6-919b-4b4a-a5f9-8acc30b9d1bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:53.594193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 802/1629] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 13:39:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:53.595190 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462402e6-919b-4b4a-a5f9-8acc30b9d1bc service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:53.596160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4875ef-8672-4463-a7db-004f2425673c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:53.615580 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 828/1630] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:39:53 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:39:53.616781 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462402e6-919b-4b4a-a5f9-8acc30b9d1bc service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:53.620487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4875ef-8672-4463-a7db-004f2425673c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:53.631761 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8ad70-a9c1-459e-b177-6202c198e8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:53.632911 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8ad70-a9c1-459e-b177-6202c198e8de admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:53.632911 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8ad70-a9c1-459e-b177-6202c198e8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:53.633218 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8ad70-a9c1-459e-b177-6202c198e8de admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:53.634431 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa8ad70-a9c1-459e-b177-6202c198e8de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:53.638483 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa8ad70-a9c1-459e-b177-6202c198e8de admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:53.641176 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462402e6-919b-4b4a-a5f9-8acc30b9d1bc service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:53.648037 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5a023-c459-427f-8742-14d639455092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:53.650142 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5a023-c459-427f-8742-14d639455092 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:53.650142 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5a023-c459-427f-8742-14d639455092 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:53.650142 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5a023-c459-427f-8742-14d639455092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:53.668622 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5a023-c459-427f-8742-14d639455092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:53.671080 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5a023-c459-427f-8742-14d639455092 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:53.688945 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 829/1631] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:39:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:39:53.695332 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 803/1632] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:39:53 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:39:53.697971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5a023-c459-427f-8742-14d639455092 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:53.711706 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5a023-c459-427f-8742-14d639455092 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:53.814802 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97475142-3f06-44f1-b121-15fbd89a343f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:53.815532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97475142-3f06-44f1-b121-15fbd89a343f admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:53.815884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97475142-3f06-44f1-b121-15fbd89a343f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:53.816165 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97475142-3f06-44f1-b121-15fbd89a343f admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:53.817080 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97475142-3f06-44f1-b121-15fbd89a343f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:53.819596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97475142-3f06-44f1-b121-15fbd89a343f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:53.855599 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 830/1633] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:39:53 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:39:53.859912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8ad70-a9c1-459e-b177-6202c198e8de admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:53.880371 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8ad70-a9c1-459e-b177-6202c198e8de admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:53.885449 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc577ff-2db4-40b5-9b30-47eb6988d922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:53.886136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc577ff-2db4-40b5-9b30-47eb6988d922 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:53.886415 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc577ff-2db4-40b5-9b30-47eb6988d922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:53.886714 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc577ff-2db4-40b5-9b30-47eb6988d922 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:53.887452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc577ff-2db4-40b5-9b30-47eb6988d922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:53.889816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc577ff-2db4-40b5-9b30-47eb6988d922 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:53.918109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 804/1634] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:39:53.922762 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97475142-3f06-44f1-b121-15fbd89a343f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:53.940414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97475142-3f06-44f1-b121-15fbd89a343f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:53.953651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244afdd0-35d4-42c6-bdf2-bfe56a66f6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:53.958366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244afdd0-35d4-42c6-bdf2-bfe56a66f6cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:53.960166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244afdd0-35d4-42c6-bdf2-bfe56a66f6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:53.960550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244afdd0-35d4-42c6-bdf2-bfe56a66f6cc admin admin] PATH_INFO: `/v3/projects/71d31b17ecd040dfbc2a651e832b6b40/users/5c5f32360c014e85b34fc43c8b0dfbf9/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:53.998712 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244afdd0-35d4-42c6-bdf2-bfe56a66f6cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d31b17ecd040dfbc2a651e832b6b40, user_id=5c5f32360c014e85b34fc43c8b0dfbf9, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:54.007084 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244afdd0-35d4-42c6-bdf2-bfe56a66f6cc admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:54.084141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 831/1635] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:39:53 2022] PUT /identity/v3/projects/71d31b17ecd040dfbc2a651e832b6b40/users/5c5f32360c014e85b34fc43c8b0dfbf9/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:39:54.088079 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc577ff-2db4-40b5-9b30-47eb6988d922 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:54.108915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc577ff-2db4-40b5-9b30-47eb6988d922 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:54.193883 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:54.227176 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d7de8-4d70-4fb8-b74e-df4fcc821e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:54.228048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d7de8-4d70-4fb8-b74e-df4fcc821e17 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:54.228414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d7de8-4d70-4fb8-b74e-df4fcc821e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:54.228697 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d7de8-4d70-4fb8-b74e-df4fcc821e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:54.229703 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d7de8-4d70-4fb8-b74e-df4fcc821e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:54.231576 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d7de8-4d70-4fb8-b74e-df4fcc821e17 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:54.246614 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 805/1636] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:39:54.250390 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244afdd0-35d4-42c6-bdf2-bfe56a66f6cc admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:54.262048 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244afdd0-35d4-42c6-bdf2-bfe56a66f6cc admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:54.268480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84614f2-1f5f-4209-bdfc-ebd2257397b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:54.269603 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84614f2-1f5f-4209-bdfc-ebd2257397b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:54.270437 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84614f2-1f5f-4209-bdfc-ebd2257397b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:54.271244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84614f2-1f5f-4209-bdfc-ebd2257397b3 admin admin] PATH_INFO: `/v3/projects/71d31b17ecd040dfbc2a651e832b6b40/users/5c5f32360c014e85b34fc43c8b0dfbf9/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:54.274253 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84614f2-1f5f-4209-bdfc-ebd2257397b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d31b17ecd040dfbc2a651e832b6b40, user_id=5c5f32360c014e85b34fc43c8b0dfbf9, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:54.277206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84614f2-1f5f-4209-bdfc-ebd2257397b3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:54.290150 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 832/1637] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:39:54 2022] PUT /identity/v3/projects/71d31b17ecd040dfbc2a651e832b6b40/users/5c5f32360c014e85b34fc43c8b0dfbf9/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:39:54.303399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed676fb-d55d-4d5b-88bf-aa722362c2b7 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:54.303399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed676fb-d55d-4d5b-88bf-aa722362c2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:54.303399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed676fb-d55d-4d5b-88bf-aa722362c2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:54.341559 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-bed676fb-d55d-4d5b-88bf-aa722362c2b7 None None] MFA Rules not processed for user `5c5f32360c014e85b34fc43c8b0dfbf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:54.342729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-bed676fb-d55d-4d5b-88bf-aa722362c2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:54.507045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 806/1638] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:54.521028 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84614f2-1f5f-4209-bdfc-ebd2257397b3 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:54.633957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:54.641906 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84614f2-1f5f-4209-bdfc-ebd2257397b3 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:54.651492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f8e8e-c615-4681-8f9d-a74a92adf290 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:54.652765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f8e8e-c615-4681-8f9d-a74a92adf290 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:54.654950 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f8e8e-c615-4681-8f9d-a74a92adf290 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:54.655535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f8e8e-c615-4681-8f9d-a74a92adf290 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:54.670835 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f8e8e-c615-4681-8f9d-a74a92adf290 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:54.672485 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f8e8e-c615-4681-8f9d-a74a92adf290 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:54.697401 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 833/1639] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:39:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:39:55.139304 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140a159-2003-42bc-8c5e-b3c869ccae51 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:55.139594 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140a159-2003-42bc-8c5e-b3c869ccae51 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:55.139869 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140a159-2003-42bc-8c5e-b3c869ccae51 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:55.141608 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 807/1640] 10.222.0.18 () {54 vars in 961 bytes} [Thu Jun 2 13:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:39:55.151084 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c439d-97de-47df-95df-53715eec089d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:55.151370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c439d-97de-47df-95df-53715eec089d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:55.151643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c439d-97de-47df-95df-53715eec089d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:55.192113 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-610c439d-97de-47df-95df-53715eec089d None None] MFA Rules not processed for user `5a0061e2927843cf86769d2beab18743`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:55.193574 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-610c439d-97de-47df-95df-53715eec089d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:55.354505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 834/1641] 10.222.0.18 () {58 vars in 1058 bytes} [Thu Jun 2 13:39:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:55.361806 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d988cc-2b32-4315-859a-c81a0a1433ab None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:55.362330 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d988cc-2b32-4315-859a-c81a0a1433ab None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:55.362429 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d988cc-2b32-4315-859a-c81a0a1433ab None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:55.364014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 808/1642] 10.222.0.18 () {54 vars in 912 bytes} [Thu Jun 2 13:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:39:55.370729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a168e49-d3b8-40ad-aca8-009a2b71c3f0 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:55.371053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a168e49-d3b8-40ad-aca8-009a2b71c3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:55.371358 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a168e49-d3b8-40ad-aca8-009a2b71c3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:55.407715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0a168e49-d3b8-40ad-aca8-009a2b71c3f0 None None] MFA Rules not processed for user `5a0061e2927843cf86769d2beab18743`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:55.408983 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0a168e49-d3b8-40ad-aca8-009a2b71c3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:55.431600 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 835/1643] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 13:39:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:39:55.465869 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d988cc-2b32-4315-859a-c81a0a1433ab None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:55.486521 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d988cc-2b32-4315-859a-c81a0a1433ab None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:55.490812 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848eec1-2aa1-4e5e-9b77-8d779f54e868 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:55.491479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848eec1-2aa1-4e5e-9b77-8d779f54e868 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:55.491756 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848eec1-2aa1-4e5e-9b77-8d779f54e868 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:55.492029 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848eec1-2aa1-4e5e-9b77-8d779f54e868 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:55.518929 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848eec1-2aa1-4e5e-9b77-8d779f54e868 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:55.521120 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848eec1-2aa1-4e5e-9b77-8d779f54e868 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:55.544964 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 809/1644] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:39:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:39:55.692085 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a168e49-d3b8-40ad-aca8-009a2b71c3f0 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:55.832407 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a168e49-d3b8-40ad-aca8-009a2b71c3f0 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:55.853231 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf6f1d-d61e-47d8-b42e-fd64eccee8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:55.854238 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf6f1d-d61e-47d8-b42e-fd64eccee8be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:55.854496 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf6f1d-d61e-47d8-b42e-fd64eccee8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:55.854903 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf6f1d-d61e-47d8-b42e-fd64eccee8be admin admin] PATH_INFO: `/v3/users/a7ca43dea0744d159130177a1d790a39` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:55.858704 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf6f1d-d61e-47d8-b42e-fd64eccee8be admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7ca43dea0744d159130177a1d790a39)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:55.860895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf6f1d-d61e-47d8-b42e-fd64eccee8be admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:55.953887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244bdfa-6826-44ed-a439-32f5bed431c4 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:55.954909 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244bdfa-6826-44ed-a439-32f5bed431c4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:55.955380 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244bdfa-6826-44ed-a439-32f5bed431c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:56.027209 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3ebf6f1d-d61e-47d8-b42e-fd64eccee8be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7ca43dea0744d159130177a1d790a39'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:56.034117 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-2244bdfa-6826-44ed-a439-32f5bed431c4 None None] MFA Rules not processed for user `e3a5c3879b064a65b080faf964155c09`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:56.039705 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2244bdfa-6826-44ed-a439-32f5bed431c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:56.047220 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3ebf6f1d-d61e-47d8-b42e-fd64eccee8be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7ca43dea0744d159130177a1d790a39'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:56.047986 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3ebf6f1d-d61e-47d8-b42e-fd64eccee8be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7ca43dea0744d159130177a1d790a39'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:56.079761 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3ebf6f1d-d61e-47d8-b42e-fd64eccee8be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7ca43dea0744d159130177a1d790a39'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:56.080896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3ebf6f1d-d61e-47d8-b42e-fd64eccee8be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7ca43dea0744d159130177a1d790a39'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:56.087433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:56.102944 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 836/1645] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:39:55 2022] DELETE /identity/v3/users/a7ca43dea0744d159130177a1d790a39 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:39:56.107700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4d9c7-36ba-4bdb-9aee-ad194fc7c7c3 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:56.108451 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4d9c7-36ba-4bdb-9aee-ad194fc7c7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:56.108986 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4d9c7-36ba-4bdb-9aee-ad194fc7c7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:56.143497 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-50c4d9c7-36ba-4bdb-9aee-ad194fc7c7c3 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:56.146447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-50c4d9c7-36ba-4bdb-9aee-ad194fc7c7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:56.187106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 810/1646] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:39:56.202290 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12be941-261d-45c9-8b17-403a8213d8ff None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:56.202772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12be941-261d-45c9-8b17-403a8213d8ff None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:56.203145 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12be941-261d-45c9-8b17-403a8213d8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:56.239242 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-f12be941-261d-45c9-8b17-403a8213d8ff None None] MFA Rules not processed for user `e3a5c3879b064a65b080faf964155c09`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:56.241271 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f12be941-261d-45c9-8b17-403a8213d8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:56.250045 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 837/1647] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:39:56.265318 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4d9c7-36ba-4bdb-9aee-ad194fc7c7c3 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:56.266877 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-50c4d9c7-36ba-4bdb-9aee-ad194fc7c7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:56.320795 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:56.398065 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 811/1648] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:56.412061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12be941-261d-45c9-8b17-403a8213d8ff None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:56.415590 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f12be941-261d-45c9-8b17-403a8213d8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:56.428383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4d9c7-36ba-4bdb-9aee-ad194fc7c7c3 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:56.437463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9376d1-e138-4116-9445-ccf19f98bcff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:56.438760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9376d1-e138-4116-9445-ccf19f98bcff service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:56.439581 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9376d1-e138-4116-9445-ccf19f98bcff service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:56.439725 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9376d1-e138-4116-9445-ccf19f98bcff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:56.456860 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9376d1-e138-4116-9445-ccf19f98bcff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:56.460197 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9376d1-e138-4116-9445-ccf19f98bcff service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:56.485782 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 838/1649] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:39:56.569891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12be941-261d-45c9-8b17-403a8213d8ff None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:56.582260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba93692-8424-41ca-b180-5c1b0f10b4cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:56.582773 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba93692-8424-41ca-b180-5c1b0f10b4cc service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:56.583521 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba93692-8424-41ca-b180-5c1b0f10b4cc service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:56.584732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba93692-8424-41ca-b180-5c1b0f10b4cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:56.605501 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba93692-8424-41ca-b180-5c1b0f10b4cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:56.607782 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba93692-8424-41ca-b180-5c1b0f10b4cc service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:56.642219 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 812/1650] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:39:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:39:57.172751 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9376d1-e138-4116-9445-ccf19f98bcff service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:57.178996 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ea9376d1-e138-4116-9445-ccf19f98bcff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:57.232520 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9376d1-e138-4116-9445-ccf19f98bcff service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:57.232520 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d2f5a-7c93-43a7-be12-78a45e1f4468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:57.252260 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d2f5a-7c93-43a7-be12-78a45e1f4468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:57.252260 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d2f5a-7c93-43a7-be12-78a45e1f4468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:57.252260 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d2f5a-7c93-43a7-be12-78a45e1f4468 admin admin] PATH_INFO: `/v3/users/687fb05f5c7b4ff19e21d5eec63fa717` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:57.252260 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d2f5a-7c93-43a7-be12-78a45e1f4468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=687fb05f5c7b4ff19e21d5eec63fa717)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:57.252260 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d2f5a-7c93-43a7-be12-78a45e1f4468 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:57.320750 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-817d2f5a-7c93-43a7-be12-78a45e1f4468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '687fb05f5c7b4ff19e21d5eec63fa717'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:57.334754 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-817d2f5a-7c93-43a7-be12-78a45e1f4468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '687fb05f5c7b4ff19e21d5eec63fa717'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:57.335812 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-817d2f5a-7c93-43a7-be12-78a45e1f4468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '687fb05f5c7b4ff19e21d5eec63fa717'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:57.369786 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-817d2f5a-7c93-43a7-be12-78a45e1f4468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '687fb05f5c7b4ff19e21d5eec63fa717'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:57.371586 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-817d2f5a-7c93-43a7-be12-78a45e1f4468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '687fb05f5c7b4ff19e21d5eec63fa717'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:57.397828 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf73cca-fce6-4468-87fb-373f4e5eb8b0 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:57.398110 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf73cca-fce6-4468-87fb-373f4e5eb8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:57.398727 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf73cca-fce6-4468-87fb-373f4e5eb8b0 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:57.400053 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 813/1651] 10.222.0.18 () {54 vars in 912 bytes} [Thu Jun 2 13:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:39:57.400920 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 839/1652] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:39:57 2022] DELETE /identity/v3/users/687fb05f5c7b4ff19e21d5eec63fa717 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:39:57.405441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651eaac-39d3-4cd3-95e8-1f8c82f99738 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:57.405726 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651eaac-39d3-4cd3-95e8-1f8c82f99738 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:57.405995 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651eaac-39d3-4cd3-95e8-1f8c82f99738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:57.414795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b5f07-41e3-4889-9810-acf0306dfafe None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:57.415077 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b5f07-41e3-4889-9810-acf0306dfafe None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:57.415347 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b5f07-41e3-4889-9810-acf0306dfafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:57.458546 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-3651eaac-39d3-4cd3-95e8-1f8c82f99738 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:57.459350 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:57.461077 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3651eaac-39d3-4cd3-95e8-1f8c82f99738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:57.521374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a20b5f07-41e3-4889-9810-acf0306dfafe None None] MFA Rules not processed for user `a072e8e01bc64c9b92579bb8f1d513a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:57.523379 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a20b5f07-41e3-4889-9810-acf0306dfafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:57.608870 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 814/1653] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:57.654529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651eaac-39d3-4cd3-95e8-1f8c82f99738 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:57.655616 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 840/1654] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 13:39:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:57.656826 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3651eaac-39d3-4cd3-95e8-1f8c82f99738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:57.679131 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b5f07-41e3-4889-9810-acf0306dfafe None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:57.680866 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a20b5f07-41e3-4889-9810-acf0306dfafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:57.684669 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651eaac-39d3-4cd3-95e8-1f8c82f99738 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:57.693899 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0f27c-6a01-4fff-a3e1-d990e53c1f39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:57.694612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0f27c-6a01-4fff-a3e1-d990e53c1f39 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:57.694887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0f27c-6a01-4fff-a3e1-d990e53c1f39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:57.695159 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0f27c-6a01-4fff-a3e1-d990e53c1f39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:57.698017 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b5f07-41e3-4889-9810-acf0306dfafe None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:57.706931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c05311-b754-4e71-9fc8-4bfb83c242ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:57.707607 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c05311-b754-4e71-9fc8-4bfb83c242ba service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:57.707881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c05311-b754-4e71-9fc8-4bfb83c242ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:57.708239 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c05311-b754-4e71-9fc8-4bfb83c242ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:57.719200 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0f27c-6a01-4fff-a3e1-d990e53c1f39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:57.720574 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0f27c-6a01-4fff-a3e1-d990e53c1f39 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:57.730091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c05311-b754-4e71-9fc8-4bfb83c242ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:57.731640 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c05311-b754-4e71-9fc8-4bfb83c242ba service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:57.742946 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 815/1655] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:39:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:39:57.747995 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 841/1656] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:39:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:39:58.640596 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0f27c-6a01-4fff-a3e1-d990e53c1f39 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:58.642076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b7b0f27c-6a01-4fff-a3e1-d990e53c1f39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:58.668169 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0f27c-6a01-4fff-a3e1-d990e53c1f39 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:58.683316 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16563788-6a2a-435a-b6aa-46c79b98f435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:58.684211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16563788-6a2a-435a-b6aa-46c79b98f435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:58.684484 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16563788-6a2a-435a-b6aa-46c79b98f435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:58.684931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16563788-6a2a-435a-b6aa-46c79b98f435 admin admin] PATH_INFO: `/v3/projects/fee2e71523d742e08240c25f5ec24fc0` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:58.687002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16563788-6a2a-435a-b6aa-46c79b98f435 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fee2e71523d742e08240c25f5ec24fc0)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:58.689060 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16563788-6a2a-435a-b6aa-46c79b98f435 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:58.782604 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:58.784374 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-16563788-6a2a-435a-b6aa-46c79b98f435 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fee2e71523d742e08240c25f5ec24fc0', 'request_id': 'req-16563788-6a2a-435a-b6aa-46c79b98f435'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:58.801356 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-16563788-6a2a-435a-b6aa-46c79b98f435 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fee2e71523d742e08240c25f5ec24fc0', 'request_id': 'req-16563788-6a2a-435a-b6aa-46c79b98f435'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:58.810534 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-16563788-6a2a-435a-b6aa-46c79b98f435 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fee2e71523d742e08240c25f5ec24fc0', 'request_id': 'req-16563788-6a2a-435a-b6aa-46c79b98f435'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:58.835274 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-16563788-6a2a-435a-b6aa-46c79b98f435 admin admin] The token cache is being invalidate because project fee2e71523d742e08240c25f5ec24fc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:39:58.836061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-16563788-6a2a-435a-b6aa-46c79b98f435 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:58.838474 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-16563788-6a2a-435a-b6aa-46c79b98f435 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:58.841194 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 816/1657] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:39:58 2022] DELETE /identity/v3/projects/fee2e71523d742e08240c25f5ec24fc0 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:39:58.846357 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c05311-b754-4e71-9fc8-4bfb83c242ba service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:58.868979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c05311-b754-4e71-9fc8-4bfb83c242ba service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:59.050438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1720549-fb9d-4376-8943-c2270fa76f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:59.051630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1720549-fb9d-4376-8943-c2270fa76f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:59.052443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1720549-fb9d-4376-8943-c2270fa76f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:59.053042 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1720549-fb9d-4376-8943-c2270fa76f79 admin admin] PATH_INFO: `/v3/users/5c5f32360c014e85b34fc43c8b0dfbf9` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:59.065739 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1720549-fb9d-4376-8943-c2270fa76f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c5f32360c014e85b34fc43c8b0dfbf9)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:59.068569 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1720549-fb9d-4376-8943-c2270fa76f79 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:59.192354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a1720549-fb9d-4376-8943-c2270fa76f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c5f32360c014e85b34fc43c8b0dfbf9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:59.214783 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a1720549-fb9d-4376-8943-c2270fa76f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c5f32360c014e85b34fc43c8b0dfbf9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:59.217396 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a1720549-fb9d-4376-8943-c2270fa76f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c5f32360c014e85b34fc43c8b0dfbf9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:59.268003 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a1720549-fb9d-4376-8943-c2270fa76f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c5f32360c014e85b34fc43c8b0dfbf9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:59.270958 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a1720549-fb9d-4376-8943-c2270fa76f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c5f32360c014e85b34fc43c8b0dfbf9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:59.296730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700a203-2995-472f-83d7-97ac0dc1a205 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:59.297340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700a203-2995-472f-83d7-97ac0dc1a205 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:59.297747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700a203-2995-472f-83d7-97ac0dc1a205 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:59.299308 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 817/1658] 10.222.0.18 () {54 vars in 960 bytes} [Thu Jun 2 13:39:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:39:59.304969 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b8c38-dcde-4ed8-814b-4ae29d3dc350 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:59.306666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b8c38-dcde-4ed8-814b-4ae29d3dc350 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:59.307094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b8c38-dcde-4ed8-814b-4ae29d3dc350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:59.312043 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 842/1659] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:39:58 2022] DELETE /identity/v3/users/5c5f32360c014e85b34fc43c8b0dfbf9 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:39:59.373105 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-f05b8c38-dcde-4ed8-814b-4ae29d3dc350 None None] MFA Rules not processed for user `2f7ea9741a5d409d87b8ebb4390a74ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:59.374737 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f05b8c38-dcde-4ed8-814b-4ae29d3dc350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:59.638071 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 818/1660] 10.222.0.18 () {58 vars in 1057 bytes} [Thu Jun 2 13:39:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:39:59.650748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1720549-fb9d-4376-8943-c2270fa76f79 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:59.682868 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1720549-fb9d-4376-8943-c2270fa76f79 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:59.702861 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0596c-c0bc-4ef9-839e-eaa496124d49 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f7ea9741a5d409d87b8ebb4390a74ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:59.704884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0596c-c0bc-4ef9-839e-eaa496124d49 service placement] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:59.705330 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0596c-c0bc-4ef9-839e-eaa496124d49 service placement] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:59.705615 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0596c-c0bc-4ef9-839e-eaa496124d49 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:59.720533 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6ff0596c-c0bc-4ef9-839e-eaa496124d49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:59.739264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0596c-c0bc-4ef9-839e-eaa496124d49 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:59.742292 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0596c-c0bc-4ef9-839e-eaa496124d49 service placement] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:59.748201 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:59.787797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 843/1661] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:39:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:01.377099 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b8c38-dcde-4ed8-814b-4ae29d3dc350 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:01.378779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f05b8c38-dcde-4ed8-814b-4ae29d3dc350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:01.680977 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b8c38-dcde-4ed8-814b-4ae29d3dc350 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:01.705367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e120afd-7aa1-46dd-8bad-20b162c37a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:01.706513 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e120afd-7aa1-46dd-8bad-20b162c37a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:01.706916 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e120afd-7aa1-46dd-8bad-20b162c37a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:01.707341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e120afd-7aa1-46dd-8bad-20b162c37a48 admin admin] PATH_INFO: `/v3/projects/4ec89f41e677400eb16db60774ac21a4` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:01.712569 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e120afd-7aa1-46dd-8bad-20b162c37a48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ec89f41e677400eb16db60774ac21a4)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:01.717267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e120afd-7aa1-46dd-8bad-20b162c37a48 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:01.884253 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5e120afd-7aa1-46dd-8bad-20b162c37a48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ec89f41e677400eb16db60774ac21a4', 'request_id': 'req-5e120afd-7aa1-46dd-8bad-20b162c37a48'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:01.899478 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5e120afd-7aa1-46dd-8bad-20b162c37a48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ec89f41e677400eb16db60774ac21a4', 'request_id': 'req-5e120afd-7aa1-46dd-8bad-20b162c37a48'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:01.917265 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5e120afd-7aa1-46dd-8bad-20b162c37a48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ec89f41e677400eb16db60774ac21a4', 'request_id': 'req-5e120afd-7aa1-46dd-8bad-20b162c37a48'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:01.960375 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5e120afd-7aa1-46dd-8bad-20b162c37a48 admin admin] The token cache is being invalidate because project 4ec89f41e677400eb16db60774ac21a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:01.962961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5e120afd-7aa1-46dd-8bad-20b162c37a48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:01.964838 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5e120afd-7aa1-46dd-8bad-20b162c37a48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:01.967345 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 819/1662] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:01 2022] DELETE /identity/v3/projects/4ec89f41e677400eb16db60774ac21a4 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:01.972105 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28e560-c9e3-4bce-997f-8640b11a3c85 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:01.972977 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28e560-c9e3-4bce-997f-8640b11a3c85 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:01.973253 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28e560-c9e3-4bce-997f-8640b11a3c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:02.048099 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-eb28e560-c9e3-4bce-997f-8640b11a3c85 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:02.050055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-eb28e560-c9e3-4bce-997f-8640b11a3c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:02.329322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12e189-bc44-4099-89d7-1d99f72ba4c0 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:02.331055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12e189-bc44-4099-89d7-1d99f72ba4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:02.331501 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12e189-bc44-4099-89d7-1d99f72ba4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:02.341866 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:02.342548 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 844/1663] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:02.392020 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-1b12e189-bc44-4099-89d7-1d99f72ba4c0 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:02.401229 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1b12e189-bc44-4099-89d7-1d99f72ba4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:02.444367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 820/1664] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:02.448462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28e560-c9e3-4bce-997f-8640b11a3c85 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:02.466022 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28e560-c9e3-4bce-997f-8640b11a3c85 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:02.498311 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbced1b-8c1d-4a34-9123-0cb927951597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:02.499066 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbced1b-8c1d-4a34-9123-0cb927951597 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:02.499341 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbced1b-8c1d-4a34-9123-0cb927951597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:02.499612 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbced1b-8c1d-4a34-9123-0cb927951597 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:02.506247 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbced1b-8c1d-4a34-9123-0cb927951597 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:40:02.507139 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbced1b-8c1d-4a34-9123-0cb927951597 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:02.519227 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbced1b-8c1d-4a34-9123-0cb927951597 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:02.562771 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 845/1665] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:40:02.567608 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12e189-bc44-4099-89d7-1d99f72ba4c0 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:02.596260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12e189-bc44-4099-89d7-1d99f72ba4c0 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:02.602683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965bb0b-de05-460c-a584-2d0075198b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:02.603805 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965bb0b-de05-460c-a584-2d0075198b7b admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:02.604271 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965bb0b-de05-460c-a584-2d0075198b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:02.604902 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965bb0b-de05-460c-a584-2d0075198b7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:02.605798 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965bb0b-de05-460c-a584-2d0075198b7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:02.607965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965bb0b-de05-460c-a584-2d0075198b7b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:02.754612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 821/1666] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:02 2022] POST /identity/v3/projects => generated 405 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:02.759344 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbced1b-8c1d-4a34-9123-0cb927951597 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:02.793413 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbced1b-8c1d-4a34-9123-0cb927951597 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:03.004931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f1f69-b11c-42a8-bbde-6ec0bb94563f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:03.008055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f1f69-b11c-42a8-bbde-6ec0bb94563f admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:03.008256 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f1f69-b11c-42a8-bbde-6ec0bb94563f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:03.008585 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f1f69-b11c-42a8-bbde-6ec0bb94563f admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:03.010302 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f1f69-b11c-42a8-bbde-6ec0bb94563f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:03.015664 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f1f69-b11c-42a8-bbde-6ec0bb94563f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:03.031629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965bb0b-de05-460c-a584-2d0075198b7b admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:03.033437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5965bb0b-de05-460c-a584-2d0075198b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:03.062387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965bb0b-de05-460c-a584-2d0075198b7b admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:03.067343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 846/1667] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:02 2022] POST /identity/v3/users => generated 303 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:03.071761 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f1f69-b11c-42a8-bbde-6ec0bb94563f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:03.089500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f08df-e71f-4d8a-9236-d6e5e351cbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:03.090316 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f08df-e71f-4d8a-9236-d6e5e351cbaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:03.090662 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f08df-e71f-4d8a-9236-d6e5e351cbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:03.090945 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f08df-e71f-4d8a-9236-d6e5e351cbaf admin admin] PATH_INFO: `/v3/projects/71d31b17ecd040dfbc2a651e832b6b40` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:03.101691 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f08df-e71f-4d8a-9236-d6e5e351cbaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d31b17ecd040dfbc2a651e832b6b40)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:03.104898 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f08df-e71f-4d8a-9236-d6e5e351cbaf admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:03.107651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f1f69-b11c-42a8-bbde-6ec0bb94563f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:03.136029 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ab416-96f1-4ae6-8604-e4ec073a54f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:03.136910 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ab416-96f1-4ae6-8604-e4ec073a54f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:03.137197 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ab416-96f1-4ae6-8604-e4ec073a54f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:03.137475 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ab416-96f1-4ae6-8604-e4ec073a54f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:03.138232 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ab416-96f1-4ae6-8604-e4ec073a54f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:03.140045 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ab416-96f1-4ae6-8604-e4ec073a54f5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:03.186989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 847/1668] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:40:03.188013 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ab416-96f1-4ae6-8604-e4ec073a54f5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:03.233769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ab416-96f1-4ae6-8604-e4ec073a54f5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:03.251973 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9078ca-5608-4247-b118-6478f140b4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:03.253365 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9078ca-5608-4247-b118-6478f140b4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:03.253789 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9078ca-5608-4247-b118-6478f140b4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:03.254870 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9078ca-5608-4247-b118-6478f140b4c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:03.255808 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9078ca-5608-4247-b118-6478f140b4c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:03.257595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9078ca-5608-4247-b118-6478f140b4c0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:03.274439 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 848/1669] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:03.278120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9078ca-5608-4247-b118-6478f140b4c0 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:03.290085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-203f08df-e71f-4d8a-9236-d6e5e351cbaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d31b17ecd040dfbc2a651e832b6b40', 'request_id': 'req-203f08df-e71f-4d8a-9236-d6e5e351cbaf'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:03.294680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9078ca-5608-4247-b118-6478f140b4c0 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:03.301950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-203f08df-e71f-4d8a-9236-d6e5e351cbaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d31b17ecd040dfbc2a651e832b6b40', 'request_id': 'req-203f08df-e71f-4d8a-9236-d6e5e351cbaf'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:03.325475 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-203f08df-e71f-4d8a-9236-d6e5e351cbaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d31b17ecd040dfbc2a651e832b6b40', 'request_id': 'req-203f08df-e71f-4d8a-9236-d6e5e351cbaf'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:03.357558 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-203f08df-e71f-4d8a-9236-d6e5e351cbaf admin admin] The token cache is being invalidate because project 71d31b17ecd040dfbc2a651e832b6b40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:03.357779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-203f08df-e71f-4d8a-9236-d6e5e351cbaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:03.367123 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-203f08df-e71f-4d8a-9236-d6e5e351cbaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:03.372267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 822/1670] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:03 2022] DELETE /identity/v3/projects/71d31b17ecd040dfbc2a651e832b6b40 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:03.372267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f08df-e71f-4d8a-9236-d6e5e351cbaf admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:03.374432 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-203f08df-e71f-4d8a-9236-d6e5e351cbaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:03.379490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:03.392486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef17f7-5f2c-4ea8-b74c-4099da29face admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:03.393851 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef17f7-5f2c-4ea8-b74c-4099da29face admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:03.394241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef17f7-5f2c-4ea8-b74c-4099da29face admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:03.394683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef17f7-5f2c-4ea8-b74c-4099da29face admin admin] PATH_INFO: `/v3/projects/8a3881f815da43c28b019bf2fcbfebb2/users/82f7730d121f44aabae807fde32fd1e0/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:03.415717 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef17f7-5f2c-4ea8-b74c-4099da29face admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a3881f815da43c28b019bf2fcbfebb2, user_id=82f7730d121f44aabae807fde32fd1e0, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:03.420287 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef17f7-5f2c-4ea8-b74c-4099da29face admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:03.436162 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f08df-e71f-4d8a-9236-d6e5e351cbaf admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:03.451634 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 849/1671] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:03 2022] PUT /identity/v3/projects/8a3881f815da43c28b019bf2fcbfebb2/users/82f7730d121f44aabae807fde32fd1e0/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:40:03.453197 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e716c0d-0cbc-4a04-b4ea-0058632c3a56 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:03.454647 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e716c0d-0cbc-4a04-b4ea-0058632c3a56 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:03.455434 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e716c0d-0cbc-4a04-b4ea-0058632c3a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:03.503598 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6e716c0d-0cbc-4a04-b4ea-0058632c3a56 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:03.507209 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6e716c0d-0cbc-4a04-b4ea-0058632c3a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:03.604982 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13fea8-0184-42ec-9d1a-5c8679afd066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:03.605176 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13fea8-0184-42ec-9d1a-5c8679afd066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:03.605445 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13fea8-0184-42ec-9d1a-5c8679afd066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:03.606104 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13fea8-0184-42ec-9d1a-5c8679afd066 admin admin] PATH_INFO: `/v3/users/5f5d6ef71bad4b62b59e41e972bc3961` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:03.607392 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13fea8-0184-42ec-9d1a-5c8679afd066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f5d6ef71bad4b62b59e41e972bc3961)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:03.608710 dv-cinder-836083-8-smb devstack@keystone.service[80238]: WARNING py.warnings [None req-2f13fea8-0184-42ec-9d1a-5c8679afd066 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:40:03.608710 dv-cinder-836083-8-smb devstack@keystone.service[80238]: warnings.warn(msg) Jun 02 13:40:03.608710 dv-cinder-836083-8-smb devstack@keystone.service[80238]: Jun 02 13:40:03.610081 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13fea8-0184-42ec-9d1a-5c8679afd066 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:03.672186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 850/1672] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:03.676161 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69395e8-cf77-4da4-a39c-e553670557c4 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:03.677757 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69395e8-cf77-4da4-a39c-e553670557c4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:03.679114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69395e8-cf77-4da4-a39c-e553670557c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:03.760561 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d69395e8-cf77-4da4-a39c-e553670557c4 None None] MFA Rules not processed for user `82f7730d121f44aabae807fde32fd1e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:03.762974 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d69395e8-cf77-4da4-a39c-e553670557c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:03.778390 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2f13fea8-0184-42ec-9d1a-5c8679afd066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f5d6ef71bad4b62b59e41e972bc3961'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:03.807314 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2f13fea8-0184-42ec-9d1a-5c8679afd066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f5d6ef71bad4b62b59e41e972bc3961'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:03.807969 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2f13fea8-0184-42ec-9d1a-5c8679afd066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f5d6ef71bad4b62b59e41e972bc3961'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:03.821526 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:03.841103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2f13fea8-0184-42ec-9d1a-5c8679afd066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f5d6ef71bad4b62b59e41e972bc3961'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:03.898147 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 851/1673] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:03 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:03.906263 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243d16f-65ce-432b-b00a-1866e2f9f65d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:03.907096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243d16f-65ce-432b-b00a-1866e2f9f65d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:03.907634 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243d16f-65ce-432b-b00a-1866e2f9f65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:03.935479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2f13fea8-0184-42ec-9d1a-5c8679afd066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f5d6ef71bad4b62b59e41e972bc3961'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:03.940400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2243d16f-65ce-432b-b00a-1866e2f9f65d None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:03.942406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2243d16f-65ce-432b-b00a-1866e2f9f65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:03.949383 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 823/1674] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:03 2022] DELETE /identity/v3/users/5f5d6ef71bad4b62b59e41e972bc3961 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:03.949383 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dd640-6e1e-46d1-86b8-6ff07962d745 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:03.949383 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dd640-6e1e-46d1-86b8-6ff07962d745 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:03.949383 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dd640-6e1e-46d1-86b8-6ff07962d745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:03.955071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 852/1675] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:03.955071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243d16f-65ce-432b-b00a-1866e2f9f65d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:03.955071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2243d16f-65ce-432b-b00a-1866e2f9f65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:03.968009 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243d16f-65ce-432b-b00a-1866e2f9f65d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:03.994600 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-aa7dd640-6e1e-46d1-86b8-6ff07962d745 None None] MFA Rules not processed for user `cbf7d6db675047cbb3a3f16631c59622`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:03.998081 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-aa7dd640-6e1e-46d1-86b8-6ff07962d745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:04.043131 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e27d47-2386-4941-a2af-6966440bd085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:04.044393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e27d47-2386-4941-a2af-6966440bd085 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:04.044675 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e27d47-2386-4941-a2af-6966440bd085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:04.044949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e27d47-2386-4941-a2af-6966440bd085 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:04.045723 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e27d47-2386-4941-a2af-6966440bd085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:04.048217 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e27d47-2386-4941-a2af-6966440bd085 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:04.052514 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:04.085586 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 853/1676] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:03 2022] POST /identity/v3/projects => generated 401 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:04.085586 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd1c17-c056-47f8-8a13-fe8974a74e3d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:04.085586 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd1c17-c056-47f8-8a13-fe8974a74e3d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:04.085586 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd1c17-c056-47f8-8a13-fe8974a74e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:04.127748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2abd1c17-c056-47f8-8a13-fe8974a74e3d None None] MFA Rules not processed for user `f0f9f36f32754886b5a66a88c229f147`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:04.129749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2abd1c17-c056-47f8-8a13-fe8974a74e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:04.146844 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 824/1677] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 13:40:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:04.148317 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2c6b8-064a-4a14-8cd0-1fa5ae9207c2 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:04.148701 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2c6b8-064a-4a14-8cd0-1fa5ae9207c2 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:04.150219 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2c6b8-064a-4a14-8cd0-1fa5ae9207c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:04.217215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-15f2c6b8-064a-4a14-8cd0-1fa5ae9207c2 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:04.224565 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-15f2c6b8-064a-4a14-8cd0-1fa5ae9207c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:04.233558 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 854/1678] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:04.234701 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd1c17-c056-47f8-8a13-fe8974a74e3d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:04.413015 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd1c17-c056-47f8-8a13-fe8974a74e3d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:04.419828 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 825/1679] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:04.428378 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2c6b8-064a-4a14-8cd0-1fa5ae9207c2 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:04.435372 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc0f6c-1721-435d-bdad-69839263081b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:04.436245 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc0f6c-1721-435d-bdad-69839263081b admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:04.436630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc0f6c-1721-435d-bdad-69839263081b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:04.437013 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc0f6c-1721-435d-bdad-69839263081b admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:04.437878 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc0f6c-1721-435d-bdad-69839263081b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:40:04.438294 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc0f6c-1721-435d-bdad-69839263081b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:04.440481 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc0f6c-1721-435d-bdad-69839263081b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:04.448400 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2c6b8-064a-4a14-8cd0-1fa5ae9207c2 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:04.468784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 855/1680] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:40:04.468784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4388be3-6c97-4bce-9344-56705e7e1db3 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:04.468784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4388be3-6c97-4bce-9344-56705e7e1db3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:04.468784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4388be3-6c97-4bce-9344-56705e7e1db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:04.471158 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0ca2c-20f5-4276-b7f3-99eeaf3fe4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:04.472015 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0ca2c-20f5-4276-b7f3-99eeaf3fe4cb admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:04.472441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0ca2c-20f5-4276-b7f3-99eeaf3fe4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:04.472718 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0ca2c-20f5-4276-b7f3-99eeaf3fe4cb admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:04.473429 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0ca2c-20f5-4276-b7f3-99eeaf3fe4cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:04.476972 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0ca2c-20f5-4276-b7f3-99eeaf3fe4cb admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:04.492775 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f4388be3-6c97-4bce-9344-56705e7e1db3 None None] MFA Rules not processed for user `f0f9f36f32754886b5a66a88c229f147`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:04.494431 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f4388be3-6c97-4bce-9344-56705e7e1db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:04.505150 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 856/1681] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:04.507354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4388be3-6c97-4bce-9344-56705e7e1db3 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:04.509237 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f4388be3-6c97-4bce-9344-56705e7e1db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:04.522183 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 826/1682] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:04 2022] POST /identity/v3/users => generated 307 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:04.523322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0ca2c-20f5-4276-b7f3-99eeaf3fe4cb admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:04.525770 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3bb0ca2c-20f5-4276-b7f3-99eeaf3fe4cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:04.613470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0ca2c-20f5-4276-b7f3-99eeaf3fe4cb admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:04.620058 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:04.625129 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeebf5d-0bc7-4123-aa4a-c56473ba3d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:04.625826 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeebf5d-0bc7-4123-aa4a-c56473ba3d1a service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:04.626184 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4388be3-6c97-4bce-9344-56705e7e1db3 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:04.626616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeebf5d-0bc7-4123-aa4a-c56473ba3d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:04.626871 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeebf5d-0bc7-4123-aa4a-c56473ba3d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:04.633950 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbbcf7-f555-4f93-ac98-86d163deab3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd0e37b0404419bb5752228bd809be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:04.634824 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbbcf7-f555-4f93-ac98-86d163deab3e service swift] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:04.635168 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbbcf7-f555-4f93-ac98-86d163deab3e service swift] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:04.636508 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbbcf7-f555-4f93-ac98-86d163deab3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:04.645783 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeebf5d-0bc7-4123-aa4a-c56473ba3d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:04.647581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeebf5d-0bc7-4123-aa4a-c56473ba3d1a service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:04.660805 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 827/1683] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:04.661623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeebf5d-0bc7-4123-aa4a-c56473ba3d1a service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:04.672290 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeebf5d-0bc7-4123-aa4a-c56473ba3d1a service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:04.680859 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30301f72-d360-4e46-b476-d725c1bc6c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:04.681615 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30301f72-d360-4e46-b476-d725c1bc6c95 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:04.681964 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30301f72-d360-4e46-b476-d725c1bc6c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:04.682299 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30301f72-d360-4e46-b476-d725c1bc6c95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:04.683403 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30301f72-d360-4e46-b476-d725c1bc6c95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:04.685923 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30301f72-d360-4e46-b476-d725c1bc6c95 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:04.689755 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:04.702237 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbbcf7-f555-4f93-ac98-86d163deab3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:04.704330 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbbcf7-f555-4f93-ac98-86d163deab3e service swift] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:04.714201 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 857/1684] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 13:40:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:40:04.715001 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbbcf7-f555-4f93-ac98-86d163deab3e service swift] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:04.716863 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-93fbbcf7-f555-4f93-ac98-86d163deab3e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:04.738167 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 828/1685] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:04 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:04.740385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30301f72-d360-4e46-b476-d725c1bc6c95 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:04.931130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbbcf7-f555-4f93-ac98-86d163deab3e service swift] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:04.948753 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30301f72-d360-4e46-b476-d725c1bc6c95 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:04.966621 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915915f-449f-4362-84aa-c95ded1714e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:04.968260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915915f-449f-4362-84aa-c95ded1714e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:04.969843 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915915f-449f-4362-84aa-c95ded1714e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:04.970957 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915915f-449f-4362-84aa-c95ded1714e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:04.973697 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915915f-449f-4362-84aa-c95ded1714e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:04.979762 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915915f-449f-4362-84aa-c95ded1714e9 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:05.020155 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 829/1686] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:05.028328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915915f-449f-4362-84aa-c95ded1714e9 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:05.057504 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915915f-449f-4362-84aa-c95ded1714e9 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:05.072854 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0744f-5e3a-482e-9f93-68a46ee68975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:05.074233 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0744f-5e3a-482e-9f93-68a46ee68975 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:05.076887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0744f-5e3a-482e-9f93-68a46ee68975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:05.077376 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0744f-5e3a-482e-9f93-68a46ee68975 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:05.078295 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0744f-5e3a-482e-9f93-68a46ee68975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:05.085357 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0744f-5e3a-482e-9f93-68a46ee68975 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:05.153164 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34984b4-fb38-45ef-8fad-3a244a274d32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:05.155358 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34984b4-fb38-45ef-8fad-3a244a274d32 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:05.155854 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34984b4-fb38-45ef-8fad-3a244a274d32 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:05.156287 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34984b4-fb38-45ef-8fad-3a244a274d32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:05.163381 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 830/1687] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:05 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:05.163381 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0744f-5e3a-482e-9f93-68a46ee68975 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:05.200062 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0744f-5e3a-482e-9f93-68a46ee68975 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:05.224932 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae56357-68d7-4eef-a713-be98ee5e46eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:05.225877 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae56357-68d7-4eef-a713-be98ee5e46eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:05.226155 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae56357-68d7-4eef-a713-be98ee5e46eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:05.228909 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae56357-68d7-4eef-a713-be98ee5e46eb admin admin] PATH_INFO: `/v3/projects/237d74206f864f8f85c0d6fe1a9cd278/users/5eda7241ab0342659173957f953c2327/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:05.274674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:05.277944 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae56357-68d7-4eef-a713-be98ee5e46eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=237d74206f864f8f85c0d6fe1a9cd278, user_id=5eda7241ab0342659173957f953c2327, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:05.281471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae56357-68d7-4eef-a713-be98ee5e46eb admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:05.314967 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 831/1688] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:05 2022] PUT /identity/v3/projects/237d74206f864f8f85c0d6fe1a9cd278/users/5eda7241ab0342659173957f953c2327/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:05.316249 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae56357-68d7-4eef-a713-be98ee5e46eb admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:05.329317 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34984b4-fb38-45ef-8fad-3a244a274d32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:05.334120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34984b4-fb38-45ef-8fad-3a244a274d32 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:05.366370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 858/1689] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:05.367449 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34984b4-fb38-45ef-8fad-3a244a274d32 service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:05.400627 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34984b4-fb38-45ef-8fad-3a244a274d32 service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:05.616021 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae56357-68d7-4eef-a713-be98ee5e46eb admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:05.629016 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ded978-4fa3-499e-9153-80d9be8e4833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:05.629535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ded978-4fa3-499e-9153-80d9be8e4833 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:05.629856 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ded978-4fa3-499e-9153-80d9be8e4833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:05.630257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ded978-4fa3-499e-9153-80d9be8e4833 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:05.631156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ded978-4fa3-499e-9153-80d9be8e4833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:05.634798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ded978-4fa3-499e-9153-80d9be8e4833 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:05.654085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa949aca-b6bf-4c94-8828-ed2fca847f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:05.662696 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa949aca-b6bf-4c94-8828-ed2fca847f61 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:05.663232 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa949aca-b6bf-4c94-8828-ed2fca847f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:05.664047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa949aca-b6bf-4c94-8828-ed2fca847f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:05.664967 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa949aca-b6bf-4c94-8828-ed2fca847f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:05.672222 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa949aca-b6bf-4c94-8828-ed2fca847f61 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:05.681689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 859/1690] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:05.687235 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ded978-4fa3-499e-9153-80d9be8e4833 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:05.715544 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ded978-4fa3-499e-9153-80d9be8e4833 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:05.721953 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 832/1691] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:05.723904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa949aca-b6bf-4c94-8828-ed2fca847f61 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:05.742115 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae470a-d643-41de-aed0-9b39a37b7a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:05.744198 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae470a-d643-41de-aed0-9b39a37b7a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:05.744484 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae470a-d643-41de-aed0-9b39a37b7a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:05.744779 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae470a-d643-41de-aed0-9b39a37b7a41 admin admin] PATH_INFO: `/v3/projects/237d74206f864f8f85c0d6fe1a9cd278/users/5eda7241ab0342659173957f953c2327/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:05.750129 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae470a-d643-41de-aed0-9b39a37b7a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=237d74206f864f8f85c0d6fe1a9cd278, user_id=5eda7241ab0342659173957f953c2327, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:05.753508 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae470a-d643-41de-aed0-9b39a37b7a41 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:05.779327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa949aca-b6bf-4c94-8828-ed2fca847f61 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:05.789900 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 860/1692] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:05 2022] PUT /identity/v3/projects/237d74206f864f8f85c0d6fe1a9cd278/users/5eda7241ab0342659173957f953c2327/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:05.791250 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae470a-d643-41de-aed0-9b39a37b7a41 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:05.804106 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-99ae470a-d643-41de-aed0-9b39a37b7a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:05.961667 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:06.036973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af1204-52cb-47fb-833d-fbdd072e70f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:06.037248 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae470a-d643-41de-aed0-9b39a37b7a41 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:06.037495 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af1204-52cb-47fb-833d-fbdd072e70f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:06.037959 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af1204-52cb-47fb-833d-fbdd072e70f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:06.038262 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af1204-52cb-47fb-833d-fbdd072e70f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:06.039048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af1204-52cb-47fb-833d-fbdd072e70f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:06.041071 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af1204-52cb-47fb-833d-fbdd072e70f7 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:06.049527 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94553b72-8b9e-430b-911a-ece8b8794693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:06.050732 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94553b72-8b9e-430b-911a-ece8b8794693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:06.051025 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94553b72-8b9e-430b-911a-ece8b8794693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:06.051320 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94553b72-8b9e-430b-911a-ece8b8794693 admin admin] PATH_INFO: `/v3/projects/8521c9f5b5094bf8b0570886769ca559` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:06.055583 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94553b72-8b9e-430b-911a-ece8b8794693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8521c9f5b5094bf8b0570886769ca559)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:06.056832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: WARNING py.warnings [None req-94553b72-8b9e-430b-911a-ece8b8794693 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:40:06.056832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: warnings.warn(msg) Jun 02 13:40:06.056832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: Jun 02 13:40:06.058030 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94553b72-8b9e-430b-911a-ece8b8794693 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:06.083277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 833/1693] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:06.087639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1b90d-73ff-47f5-b22b-65c74b8f6e47 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:06.087953 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1b90d-73ff-47f5-b22b-65c74b8f6e47 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:06.088256 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1b90d-73ff-47f5-b22b-65c74b8f6e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:06.184559 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-24c1b90d-73ff-47f5-b22b-65c74b8f6e47 None None] MFA Rules not processed for user `5eda7241ab0342659173957f953c2327`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:06.188632 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-24c1b90d-73ff-47f5-b22b-65c74b8f6e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:06.233273 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-94553b72-8b9e-430b-911a-ece8b8794693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8521c9f5b5094bf8b0570886769ca559', 'request_id': 'req-94553b72-8b9e-430b-911a-ece8b8794693'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:06.241606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-94553b72-8b9e-430b-911a-ece8b8794693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8521c9f5b5094bf8b0570886769ca559', 'request_id': 'req-94553b72-8b9e-430b-911a-ece8b8794693'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:06.268782 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-94553b72-8b9e-430b-911a-ece8b8794693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8521c9f5b5094bf8b0570886769ca559', 'request_id': 'req-94553b72-8b9e-430b-911a-ece8b8794693'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:06.271654 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:06.303848 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-94553b72-8b9e-430b-911a-ece8b8794693 admin admin] The token cache is being invalidate because project 8521c9f5b5094bf8b0570886769ca559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:06.304194 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-94553b72-8b9e-430b-911a-ece8b8794693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:06.305071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-94553b72-8b9e-430b-911a-ece8b8794693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:06.311302 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 861/1694] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:05 2022] DELETE /identity/v3/projects/8521c9f5b5094bf8b0570886769ca559 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:06.312229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94553b72-8b9e-430b-911a-ece8b8794693 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:06.322358 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-94553b72-8b9e-430b-911a-ece8b8794693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:06.373452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 834/1695] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:06 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:06.379891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1b90d-73ff-47f5-b22b-65c74b8f6e47 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:06.384114 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-24c1b90d-73ff-47f5-b22b-65c74b8f6e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:06.442268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94553b72-8b9e-430b-911a-ece8b8794693 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:06.449419 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01238dae-6835-46be-b680-55a42fb6ceba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:06.450785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01238dae-6835-46be-b680-55a42fb6ceba admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:06.450907 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01238dae-6835-46be-b680-55a42fb6ceba admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:06.451121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01238dae-6835-46be-b680-55a42fb6ceba admin admin] PATH_INFO: `/v3/projects/0a77155b85e4461ab403bcc04d4b16a1/users/11ad838854084b1ab42e8329b837d57d/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:06.504222 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01238dae-6835-46be-b680-55a42fb6ceba admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a77155b85e4461ab403bcc04d4b16a1, user_id=11ad838854084b1ab42e8329b837d57d, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:06.509003 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01238dae-6835-46be-b680-55a42fb6ceba admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:06.533668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 862/1696] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:06 2022] PUT /identity/v3/projects/0a77155b85e4461ab403bcc04d4b16a1/users/11ad838854084b1ab42e8329b837d57d/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:06.535285 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb79ac-aaff-432f-9adf-430c7f18ccf6 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:06.535608 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb79ac-aaff-432f-9adf-430c7f18ccf6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:06.535884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb79ac-aaff-432f-9adf-430c7f18ccf6 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:06.547746 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 863/1697] 10.222.0.18 () {54 vars in 912 bytes} [Thu Jun 2 13:40:06 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:40:06.551835 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb79ac-aaff-432f-9adf-430c7f18ccf6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:06.557239 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6deb79ac-aaff-432f-9adf-430c7f18ccf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:06.593450 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1b90d-73ff-47f5-b22b-65c74b8f6e47 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:06.697306 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb79ac-aaff-432f-9adf-430c7f18ccf6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:06.702522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0026e-bc82-4724-85ea-e858b8ead4b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:06.703252 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0026e-bc82-4724-85ea-e858b8ead4b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:06.703532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0026e-bc82-4724-85ea-e858b8ead4b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:06.703804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0026e-bc82-4724-85ea-e858b8ead4b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:06.739676 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cabd8-bad6-429e-a046-d28b10836c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:06.740650 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cabd8-bad6-429e-a046-d28b10836c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:06.740972 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cabd8-bad6-429e-a046-d28b10836c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:06.741243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cabd8-bad6-429e-a046-d28b10836c98 admin admin] PATH_INFO: `/v3/users/8722d259c77f450aa3aba3441b505efc` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:06.746722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5cabd8-bad6-429e-a046-d28b10836c98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8722d259c77f450aa3aba3441b505efc)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:06.776000 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5cabd8-bad6-429e-a046-d28b10836c98 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:06.794062 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:06.886770 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6f5cabd8-bad6-429e-a046-d28b10836c98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8722d259c77f450aa3aba3441b505efc'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:06.910013 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0026e-bc82-4724-85ea-e858b8ead4b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:06.912721 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0026e-bc82-4724-85ea-e858b8ead4b0 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:06.916349 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6f5cabd8-bad6-429e-a046-d28b10836c98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8722d259c77f450aa3aba3441b505efc'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:06.920179 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6f5cabd8-bad6-429e-a046-d28b10836c98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8722d259c77f450aa3aba3441b505efc'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:06.935452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6f5cabd8-bad6-429e-a046-d28b10836c98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8722d259c77f450aa3aba3441b505efc'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:06.947940 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 864/1698] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:06 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:06.951727 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d4334-4362-44ea-bd1c-f0313af1d8c6 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:06.952160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d4334-4362-44ea-bd1c-f0313af1d8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:06.953901 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d4334-4362-44ea-bd1c-f0313af1d8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:06.968676 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6f5cabd8-bad6-429e-a046-d28b10836c98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8722d259c77f450aa3aba3441b505efc'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:06.985917 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 835/1699] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:06 2022] DELETE /identity/v3/users/8722d259c77f450aa3aba3441b505efc => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:06.992162 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fef743-4df5-4a7b-93ba-be82afe1ae68 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:06.992454 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fef743-4df5-4a7b-93ba-be82afe1ae68 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:06.992728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fef743-4df5-4a7b-93ba-be82afe1ae68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:07.003751 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-1c2d4334-4362-44ea-bd1c-f0313af1d8c6 None None] MFA Rules not processed for user `a072e8e01bc64c9b92579bb8f1d513a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:07.007330 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1c2d4334-4362-44ea-bd1c-f0313af1d8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:07.067281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:07.070007 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-75fef743-4df5-4a7b-93ba-be82afe1ae68 None None] MFA Rules not processed for user `11ad838854084b1ab42e8329b837d57d`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:07.072428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-75fef743-4df5-4a7b-93ba-be82afe1ae68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:07.150278 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 865/1700] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 13:40:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:07.180382 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d4334-4362-44ea-bd1c-f0313af1d8c6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:07.182016 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1c2d4334-4362-44ea-bd1c-f0313af1d8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:07.202094 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d4334-4362-44ea-bd1c-f0313af1d8c6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:07.214219 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105e7ad-145d-419b-bcae-d70bd7095b2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:07.215183 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105e7ad-145d-419b-bcae-d70bd7095b2a service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:07.216847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105e7ad-145d-419b-bcae-d70bd7095b2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:07.217915 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105e7ad-145d-419b-bcae-d70bd7095b2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:07.238424 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105e7ad-145d-419b-bcae-d70bd7095b2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:07.243541 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105e7ad-145d-419b-bcae-d70bd7095b2a service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:07.244198 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 836/1701] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:07.250323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fef743-4df5-4a7b-93ba-be82afe1ae68 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:07.253263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-75fef743-4df5-4a7b-93ba-be82afe1ae68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:07.268435 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 866/1702] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:07.271591 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105e7ad-145d-419b-bcae-d70bd7095b2a service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:07.275456 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e105e7ad-145d-419b-bcae-d70bd7095b2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:07.497039 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105e7ad-145d-419b-bcae-d70bd7095b2a service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:07.499221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fef743-4df5-4a7b-93ba-be82afe1ae68 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:07.508595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679ad65-b093-4d73-987d-c08e2b946a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:07.510338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679ad65-b093-4d73-987d-c08e2b946a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:07.510338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679ad65-b093-4d73-987d-c08e2b946a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:07.510338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679ad65-b093-4d73-987d-c08e2b946a6a admin admin] PATH_INFO: `/v3/users/82f7730d121f44aabae807fde32fd1e0` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:07.511842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd473a-05c0-4079-bc07-11ceffd15cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:07.512523 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd473a-05c0-4079-bc07-11ceffd15cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:07.512833 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd473a-05c0-4079-bc07-11ceffd15cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:07.513332 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd473a-05c0-4079-bc07-11ceffd15cc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:07.514405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd473a-05c0-4079-bc07-11ceffd15cc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:07.516153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679ad65-b093-4d73-987d-c08e2b946a6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=82f7730d121f44aabae807fde32fd1e0)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:07.518152 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679ad65-b093-4d73-987d-c08e2b946a6a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:07.521210 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd473a-05c0-4079-bc07-11ceffd15cc4 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:07.566919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:07.591466 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 837/1703] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:07 2022] POST /identity/v3/projects => generated 387 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:07.596015 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd473a-05c0-4079-bc07-11ceffd15cc4 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:07.659191 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7679ad65-b093-4d73-987d-c08e2b946a6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82f7730d121f44aabae807fde32fd1e0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:07.676248 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7679ad65-b093-4d73-987d-c08e2b946a6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82f7730d121f44aabae807fde32fd1e0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:07.677845 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7679ad65-b093-4d73-987d-c08e2b946a6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82f7730d121f44aabae807fde32fd1e0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:07.707582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7679ad65-b093-4d73-987d-c08e2b946a6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82f7730d121f44aabae807fde32fd1e0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:07.710370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7679ad65-b093-4d73-987d-c08e2b946a6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82f7730d121f44aabae807fde32fd1e0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:07.743705 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 867/1704] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:07 2022] DELETE /identity/v3/users/82f7730d121f44aabae807fde32fd1e0 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:07.748985 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4aea0-23d3-4b34-aebd-c6232854d1ec None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:07.753839 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4aea0-23d3-4b34-aebd-c6232854d1ec None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:07.754184 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4aea0-23d3-4b34-aebd-c6232854d1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:07.760850 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd473a-05c0-4079-bc07-11ceffd15cc4 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:07.797359 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-32d4aea0-23d3-4b34-aebd-c6232854d1ec None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:07.799776 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-32d4aea0-23d3-4b34-aebd-c6232854d1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:07.861533 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:07.929956 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5dfd26-c7cb-48e6-b2e9-82fcf6ddfd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:07.931168 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 868/1705] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:07.937087 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5dfd26-c7cb-48e6-b2e9-82fcf6ddfd40 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:07.937729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5dfd26-c7cb-48e6-b2e9-82fcf6ddfd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:07.938201 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5dfd26-c7cb-48e6-b2e9-82fcf6ddfd40 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:07.939175 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5dfd26-c7cb-48e6-b2e9-82fcf6ddfd40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:07.947208 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5dfd26-c7cb-48e6-b2e9-82fcf6ddfd40 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:08.009636 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 838/1706] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:07 2022] POST /identity/v3/users => generated 300 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:08.011187 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4aea0-23d3-4b34-aebd-c6232854d1ec None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:08.013271 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-32d4aea0-23d3-4b34-aebd-c6232854d1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:08.041056 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4aea0-23d3-4b34-aebd-c6232854d1ec None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:08.061707 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf6c3e-e907-455a-b699-82169327a50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:08.062456 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf6c3e-e907-455a-b699-82169327a50c admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:08.062759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf6c3e-e907-455a-b699-82169327a50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:08.063035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf6c3e-e907-455a-b699-82169327a50c admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:08.063780 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf6c3e-e907-455a-b699-82169327a50c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:08.065946 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf6c3e-e907-455a-b699-82169327a50c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:08.099147 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 869/1707] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:08.102862 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5dfd26-c7cb-48e6-b2e9-82fcf6ddfd40 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:08.118105 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5dfd26-c7cb-48e6-b2e9-82fcf6ddfd40 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:08.129068 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf6c3e-e907-455a-b699-82169327a50c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:08.131347 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-19bf6c3e-e907-455a-b699-82169327a50c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:08.140606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a718a0e-793e-49d7-a094-9e89a1025f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:08.146299 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a718a0e-793e-49d7-a094-9e89a1025f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:08.146756 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a718a0e-793e-49d7-a094-9e89a1025f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:08.148195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a718a0e-793e-49d7-a094-9e89a1025f6c admin admin] PATH_INFO: `/v3/projects/ebbd713c8a794e79bd298379477f85b0/users/07798b63d22c4fa4998eb028a4ef2a9b/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:08.215175 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a718a0e-793e-49d7-a094-9e89a1025f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebbd713c8a794e79bd298379477f85b0, user_id=07798b63d22c4fa4998eb028a4ef2a9b, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:08.218212 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a718a0e-793e-49d7-a094-9e89a1025f6c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:08.256114 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 839/1708] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:08 2022] PUT /identity/v3/projects/ebbd713c8a794e79bd298379477f85b0/users/07798b63d22c4fa4998eb028a4ef2a9b/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:08.261183 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a718a0e-793e-49d7-a094-9e89a1025f6c admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:08.387092 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf6c3e-e907-455a-b699-82169327a50c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:08.484957 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a718a0e-793e-49d7-a094-9e89a1025f6c admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:08.503863 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d6882-7636-42b4-8d34-be380ff6ec68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:08.504882 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d6882-7636-42b4-8d34-be380ff6ec68 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:08.510269 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d6882-7636-42b4-8d34-be380ff6ec68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:08.510705 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d6882-7636-42b4-8d34-be380ff6ec68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:08.511650 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d6882-7636-42b4-8d34-be380ff6ec68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:08.513804 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d6882-7636-42b4-8d34-be380ff6ec68 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:08.552780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 840/1709] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:08.552780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d6882-7636-42b4-8d34-be380ff6ec68 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:08.569214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4d42a-4b03-49b9-b20b-570a81667143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:08.569873 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4d42a-4b03-49b9-b20b-570a81667143 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:08.570159 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4d42a-4b03-49b9-b20b-570a81667143 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:08.570427 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4d42a-4b03-49b9-b20b-570a81667143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:08.577102 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d6882-7636-42b4-8d34-be380ff6ec68 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:08.597089 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248083d-0b9b-4bc1-8e06-4c282f3dba2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:08.606732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248083d-0b9b-4bc1-8e06-4c282f3dba2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:08.609817 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4d42a-4b03-49b9-b20b-570a81667143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:08.610245 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248083d-0b9b-4bc1-8e06-4c282f3dba2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:08.610464 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248083d-0b9b-4bc1-8e06-4c282f3dba2b admin admin] PATH_INFO: `/v3/projects/ebbd713c8a794e79bd298379477f85b0/users/07798b63d22c4fa4998eb028a4ef2a9b/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:08.611229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4d42a-4b03-49b9-b20b-570a81667143 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:08.618636 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248083d-0b9b-4bc1-8e06-4c282f3dba2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebbd713c8a794e79bd298379477f85b0, user_id=07798b63d22c4fa4998eb028a4ef2a9b, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:08.621894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248083d-0b9b-4bc1-8e06-4c282f3dba2b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:08.624055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:08.654172 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 841/1710] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:08 2022] PUT /identity/v3/projects/ebbd713c8a794e79bd298379477f85b0/users/07798b63d22c4fa4998eb028a4ef2a9b/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:08.654491 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 870/1711] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:40:08.656572 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a359a7-daa6-4fff-a476-30e1fc063363 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:08.656860 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a359a7-daa6-4fff-a476-30e1fc063363 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:08.657168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a359a7-daa6-4fff-a476-30e1fc063363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:08.717032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-73a359a7-daa6-4fff-a476-30e1fc063363 None None] MFA Rules not processed for user `07798b63d22c4fa4998eb028a4ef2a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:08.717032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-73a359a7-daa6-4fff-a476-30e1fc063363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:08.971257 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 842/1712] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:08.982050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4d42a-4b03-49b9-b20b-570a81667143 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:08.987327 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c5c4d42a-4b03-49b9-b20b-570a81667143 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:09.000965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fd448-0efc-4d30-bff7-4ee31247e87f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:09.001297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fd448-0efc-4d30-bff7-4ee31247e87f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:09.001518 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fd448-0efc-4d30-bff7-4ee31247e87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:09.065458 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-5e0fd448-0efc-4d30-bff7-4ee31247e87f None None] MFA Rules not processed for user `a072e8e01bc64c9b92579bb8f1d513a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:09.073936 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5e0fd448-0efc-4d30-bff7-4ee31247e87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:09.232753 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4d42a-4b03-49b9-b20b-570a81667143 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:09.288871 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 843/1713] 10.222.0.57 () {58 vars in 1015 bytes} [Thu Jun 2 13:40:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:40:09.290370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757d769-4300-4ae2-8d3c-d6cc65e489a0 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:09.290872 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757d769-4300-4ae2-8d3c-d6cc65e489a0 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:09.291251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757d769-4300-4ae2-8d3c-d6cc65e489a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:09.331373 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-5757d769-4300-4ae2-8d3c-d6cc65e489a0 None None] MFA Rules not processed for user `f0f9f36f32754886b5a66a88c229f147`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:09.335244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5757d769-4300-4ae2-8d3c-d6cc65e489a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:09.406712 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:09.428354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce55d0c-0370-4b55-93fc-7a8d5fceac79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:09.429180 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce55d0c-0370-4b55-93fc-7a8d5fceac79 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:09.429436 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce55d0c-0370-4b55-93fc-7a8d5fceac79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:09.429736 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce55d0c-0370-4b55-93fc-7a8d5fceac79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:09.479625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 844/1714] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:09.480793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce55d0c-0370-4b55-93fc-7a8d5fceac79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:09.481087 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757d769-4300-4ae2-8d3c-d6cc65e489a0 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:09.482847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce55d0c-0370-4b55-93fc-7a8d5fceac79 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:09.484132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5757d769-4300-4ae2-8d3c-d6cc65e489a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:09.524091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 871/1715] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:09.573767 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce55d0c-0370-4b55-93fc-7a8d5fceac79 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:09.606129 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:09.764370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757d769-4300-4ae2-8d3c-d6cc65e489a0 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:09.770888 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690ab42-4d85-40fc-9300-3af4d45ea82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:09.774086 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690ab42-4d85-40fc-9300-3af4d45ea82b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:09.774376 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690ab42-4d85-40fc-9300-3af4d45ea82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:09.774704 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690ab42-4d85-40fc-9300-3af4d45ea82b admin admin] PATH_INFO: `/v3/projects/879d1d9f805a4b25b86a05efb3f5a230` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:09.777308 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690ab42-4d85-40fc-9300-3af4d45ea82b admin admin] RBAC: Authorizing `identity:delete_project(project_id=879d1d9f805a4b25b86a05efb3f5a230)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:09.779296 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690ab42-4d85-40fc-9300-3af4d45ea82b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:09.805719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce55d0c-0370-4b55-93fc-7a8d5fceac79 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:09.823397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372e38f-041e-4940-873b-cf1e4e9d052e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:09.824535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372e38f-041e-4940-873b-cf1e4e9d052e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:09.824734 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372e38f-041e-4940-873b-cf1e4e9d052e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:09.824988 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372e38f-041e-4940-873b-cf1e4e9d052e admin admin] PATH_INFO: `/v3/users/11ad838854084b1ab42e8329b837d57d` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:09.827850 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372e38f-041e-4940-873b-cf1e4e9d052e admin admin] RBAC: Authorizing `identity:delete_user(user_id=11ad838854084b1ab42e8329b837d57d)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:09.829841 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372e38f-041e-4940-873b-cf1e4e9d052e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:09.965316 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6372e38f-041e-4940-873b-cf1e4e9d052e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11ad838854084b1ab42e8329b837d57d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:09.989784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6372e38f-041e-4940-873b-cf1e4e9d052e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11ad838854084b1ab42e8329b837d57d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:09.991705 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6372e38f-041e-4940-873b-cf1e4e9d052e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11ad838854084b1ab42e8329b837d57d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:10.025897 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6372e38f-041e-4940-873b-cf1e4e9d052e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11ad838854084b1ab42e8329b837d57d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:10.026814 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6372e38f-041e-4940-873b-cf1e4e9d052e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11ad838854084b1ab42e8329b837d57d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:10.032116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9690ab42-4d85-40fc-9300-3af4d45ea82b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '879d1d9f805a4b25b86a05efb3f5a230', 'request_id': 'req-9690ab42-4d85-40fc-9300-3af4d45ea82b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:10.063241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 872/1716] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:09 2022] DELETE /identity/v3/users/11ad838854084b1ab42e8329b837d57d => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:40:10.063378 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9690ab42-4d85-40fc-9300-3af4d45ea82b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '879d1d9f805a4b25b86a05efb3f5a230', 'request_id': 'req-9690ab42-4d85-40fc-9300-3af4d45ea82b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:10.063517 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372e38f-041e-4940-873b-cf1e4e9d052e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:10.063970 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6372e38f-041e-4940-873b-cf1e4e9d052e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:10.099496 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9690ab42-4d85-40fc-9300-3af4d45ea82b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '879d1d9f805a4b25b86a05efb3f5a230', 'request_id': 'req-9690ab42-4d85-40fc-9300-3af4d45ea82b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:10.140151 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9690ab42-4d85-40fc-9300-3af4d45ea82b admin admin] The token cache is being invalidate because project 879d1d9f805a4b25b86a05efb3f5a230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:10.140521 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9690ab42-4d85-40fc-9300-3af4d45ea82b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:10.141273 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9690ab42-4d85-40fc-9300-3af4d45ea82b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:10.150903 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 845/1717] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:09 2022] DELETE /identity/v3/projects/879d1d9f805a4b25b86a05efb3f5a230 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:10.152840 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d466717-68cb-4f56-8825-1f1fae304937 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:10.159086 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d466717-68cb-4f56-8825-1f1fae304937 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:10.159398 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d466717-68cb-4f56-8825-1f1fae304937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:10.206631 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372e38f-041e-4940-873b-cf1e4e9d052e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:10.220656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829a97c-508c-485f-b116-cff82f9244f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:10.221329 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829a97c-508c-485f-b116-cff82f9244f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:10.221596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829a97c-508c-485f-b116-cff82f9244f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:10.222212 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829a97c-508c-485f-b116-cff82f9244f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:10.224593 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6829a97c-508c-485f-b116-cff82f9244f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:10.248794 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6829a97c-508c-485f-b116-cff82f9244f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:10.250629 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6829a97c-508c-485f-b116-cff82f9244f2 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:10.262534 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 873/1718] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:10.263911 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-6d466717-68cb-4f56-8825-1f1fae304937 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:10.265492 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6d466717-68cb-4f56-8825-1f1fae304937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:10.267535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da5dc8-4c36-41c2-be01-2a4b80c7b77b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:10.267834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da5dc8-4c36-41c2-be01-2a4b80c7b77b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:10.268114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da5dc8-4c36-41c2-be01-2a4b80c7b77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:10.310692 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f2da5dc8-4c36-41c2-be01-2a4b80c7b77b None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:10.311948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f2da5dc8-4c36-41c2-be01-2a4b80c7b77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:10.324807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:10.456850 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 874/1719] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:10.458239 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be872bc-4331-49a3-b1ce-acc67f7983b6 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:10.458517 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be872bc-4331-49a3-b1ce-acc67f7983b6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:10.458818 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be872bc-4331-49a3-b1ce-acc67f7983b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:10.512941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-1be872bc-4331-49a3-b1ce-acc67f7983b6 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:10.514310 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1be872bc-4331-49a3-b1ce-acc67f7983b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:10.530831 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 846/1720] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:10.542433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 875/1721] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:10.547916 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d466717-68cb-4f56-8825-1f1fae304937 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:10.569697 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d466717-68cb-4f56-8825-1f1fae304937 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:10.575495 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a276cf-ede3-435d-8af1-1ba7f3fe9cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:10.576453 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a276cf-ede3-435d-8af1-1ba7f3fe9cce admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:10.576883 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a276cf-ede3-435d-8af1-1ba7f3fe9cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:10.577299 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a276cf-ede3-435d-8af1-1ba7f3fe9cce admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:10.578179 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a276cf-ede3-435d-8af1-1ba7f3fe9cce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:40:10.578668 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a276cf-ede3-435d-8af1-1ba7f3fe9cce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:10.580614 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a276cf-ede3-435d-8af1-1ba7f3fe9cce admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:10.614759 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 847/1722] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:40:10.619585 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be872bc-4331-49a3-b1ce-acc67f7983b6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:10.630918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be872bc-4331-49a3-b1ce-acc67f7983b6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:10.651044 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b9589-a6ce-42a8-87c2-b0e11c9ee171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:10.651882 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b9589-a6ce-42a8-87c2-b0e11c9ee171 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:10.652314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b9589-a6ce-42a8-87c2-b0e11c9ee171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:10.652628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b9589-a6ce-42a8-87c2-b0e11c9ee171 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:10.653352 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b9589-a6ce-42a8-87c2-b0e11c9ee171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:10.655559 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b9589-a6ce-42a8-87c2-b0e11c9ee171 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:10.694265 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a276cf-ede3-435d-8af1-1ba7f3fe9cce admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:10.697022 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c6a276cf-ede3-435d-8af1-1ba7f3fe9cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:10.752818 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a276cf-ede3-435d-8af1-1ba7f3fe9cce admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:10.765068 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 876/1723] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:10 2022] POST /identity/v3/projects => generated 369 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:10.766756 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b9589-a6ce-42a8-87c2-b0e11c9ee171 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:10.772491 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d5974-6ace-4cfe-bee3-6ec2ef02e7dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:10.773565 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d5974-6ace-4cfe-bee3-6ec2ef02e7dd service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:10.775338 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d5974-6ace-4cfe-bee3-6ec2ef02e7dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:10.776254 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d5974-6ace-4cfe-bee3-6ec2ef02e7dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:10.828929 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d5974-6ace-4cfe-bee3-6ec2ef02e7dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:10.832861 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d5974-6ace-4cfe-bee3-6ec2ef02e7dd service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:10.881739 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 848/1724] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:10.933642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b9589-a6ce-42a8-87c2-b0e11c9ee171 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:10.950212 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b0476-a369-4d45-a752-6e96789d4639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:10.951207 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b0476-a369-4d45-a752-6e96789d4639 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:10.951618 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b0476-a369-4d45-a752-6e96789d4639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:10.952030 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b0476-a369-4d45-a752-6e96789d4639 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:10.952891 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b0476-a369-4d45-a752-6e96789d4639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:10.955032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b0476-a369-4d45-a752-6e96789d4639 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:10.998766 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 877/1725] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:10 2022] POST /identity/v3/users => generated 285 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:11.003494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d5974-6ace-4cfe-bee3-6ec2ef02e7dd service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:11.014496 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d5974-6ace-4cfe-bee3-6ec2ef02e7dd service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:11.049672 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f793359-e746-4ef1-9643-288438b85ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:11.052527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f793359-e746-4ef1-9643-288438b85ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:11.053138 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f793359-e746-4ef1-9643-288438b85ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:11.053737 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f793359-e746-4ef1-9643-288438b85ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:11.055127 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f793359-e746-4ef1-9643-288438b85ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:11.057831 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f793359-e746-4ef1-9643-288438b85ad6 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:11.101374 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 849/1726] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:11.102753 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b0476-a369-4d45-a752-6e96789d4639 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:11.119386 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b0476-a369-4d45-a752-6e96789d4639 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:11.133304 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7f622-afcd-4642-8e93-cff2c0b11824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:11.134288 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7f622-afcd-4642-8e93-cff2c0b11824 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:11.134742 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7f622-afcd-4642-8e93-cff2c0b11824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:11.135153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7f622-afcd-4642-8e93-cff2c0b11824 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:11.136035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7f622-afcd-4642-8e93-cff2c0b11824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:11.137818 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7f622-afcd-4642-8e93-cff2c0b11824 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:11.162593 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 878/1727] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:11.164516 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f793359-e746-4ef1-9643-288438b85ad6 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:11.176206 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f793359-e746-4ef1-9643-288438b85ad6 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:11.199359 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40732e3a-319e-4e16-a06d-936c1c8743f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:11.200548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40732e3a-319e-4e16-a06d-936c1c8743f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:11.200993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40732e3a-319e-4e16-a06d-936c1c8743f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:11.201417 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40732e3a-319e-4e16-a06d-936c1c8743f6 admin admin] PATH_INFO: `/v3/projects/258632eba7bb40678279f55a6778ac1f/users/0930437365934d2388f9ff91cfcb39b5/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:11.238353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40732e3a-319e-4e16-a06d-936c1c8743f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=258632eba7bb40678279f55a6778ac1f, user_id=0930437365934d2388f9ff91cfcb39b5, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:11.244140 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40732e3a-319e-4e16-a06d-936c1c8743f6 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:11.273623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 850/1728] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:11 2022] PUT /identity/v3/projects/258632eba7bb40678279f55a6778ac1f/users/0930437365934d2388f9ff91cfcb39b5/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:11.302693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659d795-9dc9-465b-b159-b27f689fcc23 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:11.303236 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659d795-9dc9-465b-b159-b27f689fcc23 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:11.303653 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659d795-9dc9-465b-b159-b27f689fcc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:11.384311 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f659d795-9dc9-465b-b159-b27f689fcc23 None None] MFA Rules not processed for user `0930437365934d2388f9ff91cfcb39b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:11.397050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f659d795-9dc9-465b-b159-b27f689fcc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:11.492402 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:11.545437 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 879/1729] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:40:11.546982 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40732e3a-319e-4e16-a06d-936c1c8743f6 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:11.552028 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:11.688255 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40732e3a-319e-4e16-a06d-936c1c8743f6 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:11.700622 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22d19e-a465-4f4a-8b10-0345c1c4e7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:11.701317 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22d19e-a465-4f4a-8b10-0345c1c4e7b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:11.701636 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22d19e-a465-4f4a-8b10-0345c1c4e7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:11.701918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22d19e-a465-4f4a-8b10-0345c1c4e7b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:11.703102 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22d19e-a465-4f4a-8b10-0345c1c4e7b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:11.704639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22d19e-a465-4f4a-8b10-0345c1c4e7b6 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:11.778983 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 851/1730] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:11 2022] POST /identity/v3/projects => generated 367 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:11.780535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659d795-9dc9-465b-b159-b27f689fcc23 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:11.793908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659d795-9dc9-465b-b159-b27f689fcc23 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:11.966523 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43bab3-b741-46b6-8303-9371ac9cf7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:11.969085 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43bab3-b741-46b6-8303-9371ac9cf7be admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:11.970870 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43bab3-b741-46b6-8303-9371ac9cf7be admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:11.972182 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43bab3-b741-46b6-8303-9371ac9cf7be admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:11.973807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43bab3-b741-46b6-8303-9371ac9cf7be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:11.979239 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43bab3-b741-46b6-8303-9371ac9cf7be admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:12.058254 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 880/1731] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:11 2022] POST /identity/v3/users => generated 290 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:12.060194 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22d19e-a465-4f4a-8b10-0345c1c4e7b6 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:12.081240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22d19e-a465-4f4a-8b10-0345c1c4e7b6 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:12.099368 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c659b-4d86-4d68-be5e-a49148a13900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:12.100222 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c659b-4d86-4d68-be5e-a49148a13900 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:12.101976 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c659b-4d86-4d68-be5e-a49148a13900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:12.102330 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c659b-4d86-4d68-be5e-a49148a13900 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:12.103531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c659b-4d86-4d68-be5e-a49148a13900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:12.107664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c659b-4d86-4d68-be5e-a49148a13900 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:12.264068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 852/1732] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:12.264771 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43bab3-b741-46b6-8303-9371ac9cf7be admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:12.276858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43bab3-b741-46b6-8303-9371ac9cf7be admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:12.305152 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893857b2-8da7-4716-9187-346cb8c366d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:12.310256 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893857b2-8da7-4716-9187-346cb8c366d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:12.313121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893857b2-8da7-4716-9187-346cb8c366d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:12.315043 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893857b2-8da7-4716-9187-346cb8c366d3 admin admin] PATH_INFO: `/v3/projects/5d34f54107f34bc7b428b34116d56eec/users/6fb1ecf9418548d3a6fa42c29a10ce29/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:12.401578 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893857b2-8da7-4716-9187-346cb8c366d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d34f54107f34bc7b428b34116d56eec, user_id=6fb1ecf9418548d3a6fa42c29a10ce29, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:12.417352 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893857b2-8da7-4716-9187-346cb8c366d3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:12.482150 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 881/1733] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:12 2022] PUT /identity/v3/projects/5d34f54107f34bc7b428b34116d56eec/users/6fb1ecf9418548d3a6fa42c29a10ce29/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:40:12.483462 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c659b-4d86-4d68-be5e-a49148a13900 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:12.501279 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c659b-4d86-4d68-be5e-a49148a13900 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:12.775939 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1dc670-1719-4e37-adf2-3b1519effc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:12.779029 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1dc670-1719-4e37-adf2-3b1519effc13 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:12.780232 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1dc670-1719-4e37-adf2-3b1519effc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:12.781599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1dc670-1719-4e37-adf2-3b1519effc13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:12.785273 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1dc670-1719-4e37-adf2-3b1519effc13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:12.795590 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1dc670-1719-4e37-adf2-3b1519effc13 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:12.819468 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 853/1734] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:12.823421 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893857b2-8da7-4716-9187-346cb8c366d3 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:12.843056 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893857b2-8da7-4716-9187-346cb8c366d3 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:12.851095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ca42e-ac9a-49c9-b7c8-89d80eba43c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:12.852435 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ca42e-ac9a-49c9-b7c8-89d80eba43c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:12.853058 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ca42e-ac9a-49c9-b7c8-89d80eba43c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:12.853489 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ca42e-ac9a-49c9-b7c8-89d80eba43c5 admin admin] PATH_INFO: `/v3/projects/5d34f54107f34bc7b428b34116d56eec/users/6fb1ecf9418548d3a6fa42c29a10ce29/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:12.856704 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ca42e-ac9a-49c9-b7c8-89d80eba43c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d34f54107f34bc7b428b34116d56eec, user_id=6fb1ecf9418548d3a6fa42c29a10ce29, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:12.862760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ca42e-ac9a-49c9-b7c8-89d80eba43c5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:12.877317 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1dc670-1719-4e37-adf2-3b1519effc13 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:12.880997 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-bd1dc670-1719-4e37-adf2-3b1519effc13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:12.909486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 882/1735] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:12 2022] PUT /identity/v3/projects/5d34f54107f34bc7b428b34116d56eec/users/6fb1ecf9418548d3a6fa42c29a10ce29/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:12.914683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1dc670-1719-4e37-adf2-3b1519effc13 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:12.920506 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962187aa-fb03-4f5a-a831-c00d7ed373e9 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:12.921033 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962187aa-fb03-4f5a-a831-c00d7ed373e9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:12.921239 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962187aa-fb03-4f5a-a831-c00d7ed373e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:13.025854 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-962187aa-fb03-4f5a-a831-c00d7ed373e9 None None] MFA Rules not processed for user `6fb1ecf9418548d3a6fa42c29a10ce29`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:13.028198 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-962187aa-fb03-4f5a-a831-c00d7ed373e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:13.142371 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3923bb0-75f9-43e9-98e1-b489c779a1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:13.145537 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3923bb0-75f9-43e9-98e1-b489c779a1de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:13.145822 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3923bb0-75f9-43e9-98e1-b489c779a1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:13.146088 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3923bb0-75f9-43e9-98e1-b489c779a1de admin admin] PATH_INFO: `/v3/projects/8a3881f815da43c28b019bf2fcbfebb2` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:13.149872 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3923bb0-75f9-43e9-98e1-b489c779a1de admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a3881f815da43c28b019bf2fcbfebb2)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:13.157406 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3923bb0-75f9-43e9-98e1-b489c779a1de admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:13.204993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:13.271353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b3923bb0-75f9-43e9-98e1-b489c779a1de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a3881f815da43c28b019bf2fcbfebb2', 'request_id': 'req-b3923bb0-75f9-43e9-98e1-b489c779a1de'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:13.291685 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b3923bb0-75f9-43e9-98e1-b489c779a1de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a3881f815da43c28b019bf2fcbfebb2', 'request_id': 'req-b3923bb0-75f9-43e9-98e1-b489c779a1de'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:13.300616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b3923bb0-75f9-43e9-98e1-b489c779a1de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a3881f815da43c28b019bf2fcbfebb2', 'request_id': 'req-b3923bb0-75f9-43e9-98e1-b489c779a1de'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:13.330977 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 883/1736] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:12 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:13.349109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b3923bb0-75f9-43e9-98e1-b489c779a1de admin admin] The token cache is being invalidate because project 8a3881f815da43c28b019bf2fcbfebb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:13.349395 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b3923bb0-75f9-43e9-98e1-b489c779a1de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:13.350100 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b3923bb0-75f9-43e9-98e1-b489c779a1de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:13.351521 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962187aa-fb03-4f5a-a831-c00d7ed373e9 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:13.355308 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 854/1737] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:12 2022] DELETE /identity/v3/projects/8a3881f815da43c28b019bf2fcbfebb2 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:40:13.355911 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-962187aa-fb03-4f5a-a831-c00d7ed373e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:13.359035 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3923bb0-75f9-43e9-98e1-b489c779a1de admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:13.364486 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b3923bb0-75f9-43e9-98e1-b489c779a1de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:13.496872 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:13.605294 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3923bb0-75f9-43e9-98e1-b489c779a1de admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:13.625203 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e62f79-e42c-4d4f-8d0a-a33653437de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:13.626235 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e62f79-e42c-4d4f-8d0a-a33653437de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:13.626424 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e62f79-e42c-4d4f-8d0a-a33653437de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:13.626797 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e62f79-e42c-4d4f-8d0a-a33653437de0 admin admin] PATH_INFO: `/v3/users/5eda7241ab0342659173957f953c2327` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:13.628560 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962187aa-fb03-4f5a-a831-c00d7ed373e9 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:13.632426 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e62f79-e42c-4d4f-8d0a-a33653437de0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eda7241ab0342659173957f953c2327)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:13.633972 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e62f79-e42c-4d4f-8d0a-a33653437de0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:13.840085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e2e62f79-e42c-4d4f-8d0a-a33653437de0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eda7241ab0342659173957f953c2327'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:13.861523 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e2e62f79-e42c-4d4f-8d0a-a33653437de0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eda7241ab0342659173957f953c2327'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:13.864994 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e2e62f79-e42c-4d4f-8d0a-a33653437de0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eda7241ab0342659173957f953c2327'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:13.892090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4966a9-9383-4cd8-b15d-d8224f694e69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:13.896147 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4966a9-9383-4cd8-b15d-d8224f694e69 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:13.897291 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4966a9-9383-4cd8-b15d-d8224f694e69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:13.898372 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4966a9-9383-4cd8-b15d-d8224f694e69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:13.903091 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e2e62f79-e42c-4d4f-8d0a-a33653437de0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eda7241ab0342659173957f953c2327'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:13.903861 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fa4966a9-9383-4cd8-b15d-d8224f694e69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:13.956043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e2e62f79-e42c-4d4f-8d0a-a33653437de0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eda7241ab0342659173957f953c2327'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:13.967730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 855/1738] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:13 2022] DELETE /identity/v3/users/5eda7241ab0342659173957f953c2327 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:14.150271 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4966a9-9383-4cd8-b15d-d8224f694e69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:14.152044 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4966a9-9383-4cd8-b15d-d8224f694e69 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:14.164231 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 884/1739] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:13 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 813 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:14.322275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e62f79-e42c-4d4f-8d0a-a33653437de0 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:14.323958 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e2e62f79-e42c-4d4f-8d0a-a33653437de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:14.451862 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:14.638420 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e62f79-e42c-4d4f-8d0a-a33653437de0 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:14.666288 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d9550-abbc-4338-bc9e-0ba067975c82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:14.667300 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d9550-abbc-4338-bc9e-0ba067975c82 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:14.667716 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d9550-abbc-4338-bc9e-0ba067975c82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:14.669029 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d9550-abbc-4338-bc9e-0ba067975c82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:14.686278 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-aa7d9550-abbc-4338-bc9e-0ba067975c82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:14.944230 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d9550-abbc-4338-bc9e-0ba067975c82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:14.945885 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d9550-abbc-4338-bc9e-0ba067975c82 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:14.999077 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 856/1740] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:14 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:15.107963 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4966a9-9383-4cd8-b15d-d8224f694e69 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:15.109846 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fa4966a9-9383-4cd8-b15d-d8224f694e69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:15.142956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4966a9-9383-4cd8-b15d-d8224f694e69 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:15.367417 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c229e48-57c5-4887-b057-b33ac1e296c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:15.368365 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c229e48-57c5-4887-b057-b33ac1e296c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:15.368648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c229e48-57c5-4887-b057-b33ac1e296c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:15.368926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c229e48-57c5-4887-b057-b33ac1e296c4 admin admin] PATH_INFO: `/v3/projects/0a77155b85e4461ab403bcc04d4b16a1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:15.399100 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c229e48-57c5-4887-b057-b33ac1e296c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a77155b85e4461ab403bcc04d4b16a1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:15.405413 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c229e48-57c5-4887-b057-b33ac1e296c4 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:15.565115 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:15.601841 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4c229e48-57c5-4887-b057-b33ac1e296c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a77155b85e4461ab403bcc04d4b16a1', 'request_id': 'req-4c229e48-57c5-4887-b057-b33ac1e296c4'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:15.637771 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4c229e48-57c5-4887-b057-b33ac1e296c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a77155b85e4461ab403bcc04d4b16a1', 'request_id': 'req-4c229e48-57c5-4887-b057-b33ac1e296c4'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:15.665254 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4c229e48-57c5-4887-b057-b33ac1e296c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a77155b85e4461ab403bcc04d4b16a1', 'request_id': 'req-4c229e48-57c5-4887-b057-b33ac1e296c4'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:15.724823 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4c229e48-57c5-4887-b057-b33ac1e296c4 admin admin] The token cache is being invalidate because project 0a77155b85e4461ab403bcc04d4b16a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:15.728156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4c229e48-57c5-4887-b057-b33ac1e296c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:15.732011 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4c229e48-57c5-4887-b057-b33ac1e296c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:15.740724 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 885/1741] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:15 2022] DELETE /identity/v3/projects/0a77155b85e4461ab403bcc04d4b16a1 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:15.744485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d9550-abbc-4338-bc9e-0ba067975c82 service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:15.781500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d9550-abbc-4338-bc9e-0ba067975c82 service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:15.994815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6221f-8a7c-49b6-982f-3a1e8511fe5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:15.995750 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6221f-8a7c-49b6-982f-3a1e8511fe5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:15.996058 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6221f-8a7c-49b6-982f-3a1e8511fe5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:15.996495 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6221f-8a7c-49b6-982f-3a1e8511fe5a admin admin] PATH_INFO: `/v3/users/07798b63d22c4fa4998eb028a4ef2a9b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:16.000671 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6221f-8a7c-49b6-982f-3a1e8511fe5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=07798b63d22c4fa4998eb028a4ef2a9b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:16.023400 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6221f-8a7c-49b6-982f-3a1e8511fe5a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:16.164069 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-cbf6221f-8a7c-49b6-982f-3a1e8511fe5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07798b63d22c4fa4998eb028a4ef2a9b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:16.183079 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-cbf6221f-8a7c-49b6-982f-3a1e8511fe5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07798b63d22c4fa4998eb028a4ef2a9b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:16.184037 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-cbf6221f-8a7c-49b6-982f-3a1e8511fe5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07798b63d22c4fa4998eb028a4ef2a9b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:16.196018 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-cbf6221f-8a7c-49b6-982f-3a1e8511fe5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07798b63d22c4fa4998eb028a4ef2a9b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:16.209567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:16.211005 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-cbf6221f-8a7c-49b6-982f-3a1e8511fe5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07798b63d22c4fa4998eb028a4ef2a9b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:16.221089 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 857/1742] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:15 2022] DELETE /identity/v3/users/07798b63d22c4fa4998eb028a4ef2a9b => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:17.315544 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c229e48-57c5-4887-b057-b33ac1e296c4 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:17.320243 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4c229e48-57c5-4887-b057-b33ac1e296c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:17.357487 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c229e48-57c5-4887-b057-b33ac1e296c4 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:17.647444 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb66db1-9aa6-4e53-868c-7a7de880b042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:17.648730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb66db1-9aa6-4e53-868c-7a7de880b042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:17.649242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb66db1-9aa6-4e53-868c-7a7de880b042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:17.649708 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb66db1-9aa6-4e53-868c-7a7de880b042 admin admin] PATH_INFO: `/v3/projects/237d74206f864f8f85c0d6fe1a9cd278` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:17.654655 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb66db1-9aa6-4e53-868c-7a7de880b042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=237d74206f864f8f85c0d6fe1a9cd278)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:17.660242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb66db1-9aa6-4e53-868c-7a7de880b042 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:17.660426 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c07ee-d519-4070-b9fc-2b08ae475c92 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:17.660950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c07ee-d519-4070-b9fc-2b08ae475c92 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:17.661242 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c07ee-d519-4070-b9fc-2b08ae475c92 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:17.663039 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 858/1743] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 13:40:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:40:17.702556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe8335-e879-4a95-b4de-ba56c929712f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:17.702852 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe8335-e879-4a95-b4de-ba56c929712f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:17.703160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe8335-e879-4a95-b4de-ba56c929712f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:17.743837 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-0fbe8335-e879-4a95-b4de-ba56c929712f None None] MFA Rules not processed for user `5a0061e2927843cf86769d2beab18743`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:17.745083 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0fbe8335-e879-4a95-b4de-ba56c929712f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:17.839703 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-deb66db1-9aa6-4e53-868c-7a7de880b042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '237d74206f864f8f85c0d6fe1a9cd278', 'request_id': 'req-deb66db1-9aa6-4e53-868c-7a7de880b042'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:17.850834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-deb66db1-9aa6-4e53-868c-7a7de880b042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '237d74206f864f8f85c0d6fe1a9cd278', 'request_id': 'req-deb66db1-9aa6-4e53-868c-7a7de880b042'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:17.886734 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-deb66db1-9aa6-4e53-868c-7a7de880b042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '237d74206f864f8f85c0d6fe1a9cd278', 'request_id': 'req-deb66db1-9aa6-4e53-868c-7a7de880b042'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:17.926874 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-deb66db1-9aa6-4e53-868c-7a7de880b042 admin admin] The token cache is being invalidate because project 237d74206f864f8f85c0d6fe1a9cd278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:17.927390 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-deb66db1-9aa6-4e53-868c-7a7de880b042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:17.928272 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-deb66db1-9aa6-4e53-868c-7a7de880b042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:17.936062 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 886/1744] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:17 2022] DELETE /identity/v3/projects/237d74206f864f8f85c0d6fe1a9cd278 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:17.951834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a725b7-4341-4f0d-8d0f-554efdfe44c1 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:17.951834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a725b7-4341-4f0d-8d0f-554efdfe44c1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:17.951834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a725b7-4341-4f0d-8d0f-554efdfe44c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:17.961929 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 859/1745] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 13:40:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:40:17.995254 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-15a725b7-4341-4f0d-8d0f-554efdfe44c1 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:18.001779 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-15a725b7-4341-4f0d-8d0f-554efdfe44c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:18.089591 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe8335-e879-4a95-b4de-ba56c929712f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:18.092164 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0fbe8335-e879-4a95-b4de-ba56c929712f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:18.141640 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe8335-e879-4a95-b4de-ba56c929712f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:18.166951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:18.215528 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 887/1746] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:40:18.216796 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535279d-c071-4140-9c82-9f6799eea001 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:18.217216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535279d-c071-4140-9c82-9f6799eea001 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:18.217585 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535279d-c071-4140-9c82-9f6799eea001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:18.253529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-1535279d-c071-4140-9c82-9f6799eea001 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:18.256999 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1535279d-c071-4140-9c82-9f6799eea001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:18.284247 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 888/1747] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:40:18.292057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535279d-c071-4140-9c82-9f6799eea001 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:18.308144 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535279d-c071-4140-9c82-9f6799eea001 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:18.332450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505001bf-2e88-4af9-9f65-16880088ec73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:18.334305 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505001bf-2e88-4af9-9f65-16880088ec73 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:18.334305 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505001bf-2e88-4af9-9f65-16880088ec73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:18.334305 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505001bf-2e88-4af9-9f65-16880088ec73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:18.342387 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505001bf-2e88-4af9-9f65-16880088ec73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:40:18.343067 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505001bf-2e88-4af9-9f65-16880088ec73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:18.348692 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505001bf-2e88-4af9-9f65-16880088ec73 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:18.397600 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 889/1748] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:40:18.402050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505001bf-2e88-4af9-9f65-16880088ec73 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:18.448272 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505001bf-2e88-4af9-9f65-16880088ec73 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:18.484984 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f434d0b-359d-4149-982a-8f74c648bf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:18.485814 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f434d0b-359d-4149-982a-8f74c648bf1d admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:18.486164 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f434d0b-359d-4149-982a-8f74c648bf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:18.486724 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f434d0b-359d-4149-982a-8f74c648bf1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:18.487645 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f434d0b-359d-4149-982a-8f74c648bf1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:18.490621 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f434d0b-359d-4149-982a-8f74c648bf1d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:18.565246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653bf88-78dc-4adb-8981-3af04773b0f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:18.565246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653bf88-78dc-4adb-8981-3af04773b0f3 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:18.565547 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653bf88-78dc-4adb-8981-3af04773b0f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:18.565958 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653bf88-78dc-4adb-8981-3af04773b0f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:18.596648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 890/1749] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:18 2022] POST /identity/v3/projects => generated 357 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:18.601629 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f434d0b-359d-4149-982a-8f74c648bf1d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:18.624509 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653bf88-78dc-4adb-8981-3af04773b0f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:18.652637 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653bf88-78dc-4adb-8981-3af04773b0f3 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:18.695434 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 860/1750] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:18.843097 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f434d0b-359d-4149-982a-8f74c648bf1d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:18.880232 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4c9d1-886c-4c29-b8ef-085cae97a79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:18.881146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4c9d1-886c-4c29-b8ef-085cae97a79e admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:18.881519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4c9d1-886c-4c29-b8ef-085cae97a79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:18.882035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4c9d1-886c-4c29-b8ef-085cae97a79e admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:18.883002 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4c9d1-886c-4c29-b8ef-085cae97a79e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:18.885288 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4c9d1-886c-4c29-b8ef-085cae97a79e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:18.946390 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 891/1751] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:18 2022] POST /identity/v3/users => generated 279 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:40:18.950896 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653bf88-78dc-4adb-8981-3af04773b0f3 service nova] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:18.970812 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653bf88-78dc-4adb-8981-3af04773b0f3 service nova] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:18.983512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7f698-4132-467b-b0fd-a195b1fa656a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:18.984530 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7f698-4132-467b-b0fd-a195b1fa656a admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:18.985074 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7f698-4132-467b-b0fd-a195b1fa656a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:18.985499 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7f698-4132-467b-b0fd-a195b1fa656a admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:18.986402 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7f698-4132-467b-b0fd-a195b1fa656a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:18.990733 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7f698-4132-467b-b0fd-a195b1fa656a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:19.021545 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 861/1752] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:19.026027 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4c9d1-886c-4c29-b8ef-085cae97a79e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:19.047190 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4c9d1-886c-4c29-b8ef-085cae97a79e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:19.056204 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50509201-d845-4014-9f6b-ac2b9a8a25c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:19.056910 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50509201-d845-4014-9f6b-ac2b9a8a25c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:19.057191 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50509201-d845-4014-9f6b-ac2b9a8a25c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:19.057466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50509201-d845-4014-9f6b-ac2b9a8a25c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:19.058395 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50509201-d845-4014-9f6b-ac2b9a8a25c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:19.060097 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50509201-d845-4014-9f6b-ac2b9a8a25c3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:19.083395 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 892/1753] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:19.092790 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7f698-4132-467b-b0fd-a195b1fa656a admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:19.125219 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7f698-4132-467b-b0fd-a195b1fa656a admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:19.143812 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38cae7-0009-412f-ad42-fa88384f0823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:19.145267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38cae7-0009-412f-ad42-fa88384f0823 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:19.145551 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38cae7-0009-412f-ad42-fa88384f0823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:19.147774 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38cae7-0009-412f-ad42-fa88384f0823 admin admin] PATH_INFO: `/v3/projects/8b536a5acbce4ffa9e6e9be88f1f2e75/users/98c3cc8bc5814eb494a07ec7621f644b/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:19.184574 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38cae7-0009-412f-ad42-fa88384f0823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b536a5acbce4ffa9e6e9be88f1f2e75, user_id=98c3cc8bc5814eb494a07ec7621f644b, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:19.187900 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38cae7-0009-412f-ad42-fa88384f0823 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:19.217231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 862/1754] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:19 2022] PUT /identity/v3/projects/8b536a5acbce4ffa9e6e9be88f1f2e75/users/98c3cc8bc5814eb494a07ec7621f644b/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:19.230195 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93203bfd-3cce-4367-a5e3-8f8b49aa5f47 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:19.230492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93203bfd-3cce-4367-a5e3-8f8b49aa5f47 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:19.230816 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93203bfd-3cce-4367-a5e3-8f8b49aa5f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:19.291555 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-93203bfd-3cce-4367-a5e3-8f8b49aa5f47 None None] MFA Rules not processed for user `98c3cc8bc5814eb494a07ec7621f644b`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:19.296744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-93203bfd-3cce-4367-a5e3-8f8b49aa5f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:19.455693 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38cae7-0009-412f-ad42-fa88384f0823 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:19.458985 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 893/1755] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:19 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:19.555707 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeff6b5-baac-4742-972e-78924cefaf43 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:19.556283 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeff6b5-baac-4742-972e-78924cefaf43 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:19.557185 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeff6b5-baac-4742-972e-78924cefaf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:19.557296 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:19.616981 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8aeff6b5-baac-4742-972e-78924cefaf43 None None] MFA Rules not processed for user `78290c0b02cd4cf2844decf6e7569535`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:19.622457 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8aeff6b5-baac-4742-972e-78924cefaf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:19.651885 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38cae7-0009-412f-ad42-fa88384f0823 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:19.667132 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:19.668774 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c8864-a86e-4f34-ad87-4a1a4ceae027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:19.669909 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c8864-a86e-4f34-ad87-4a1a4ceae027 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:19.670346 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c8864-a86e-4f34-ad87-4a1a4ceae027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:19.670813 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c8864-a86e-4f34-ad87-4a1a4ceae027 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:19.671680 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c8864-a86e-4f34-ad87-4a1a4ceae027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:19.674641 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c8864-a86e-4f34-ad87-4a1a4ceae027 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:19.769123 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 863/1756] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:19 2022] POST /identity/v3/projects => generated 355 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:19.770529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c8864-a86e-4f34-ad87-4a1a4ceae027 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:19.774370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d10c8864-a86e-4f34-ad87-4a1a4ceae027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:19.856409 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 894/1757] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:19.858738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeff6b5-baac-4742-972e-78924cefaf43 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:19.887154 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeff6b5-baac-4742-972e-78924cefaf43 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:19.946903 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c8864-a86e-4f34-ad87-4a1a4ceae027 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:19.969968 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b26fce-5239-4a69-ab4e-79c5392ab02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:19.970503 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b26fce-5239-4a69-ab4e-79c5392ab02c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:19.970862 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b26fce-5239-4a69-ab4e-79c5392ab02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:19.971124 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b26fce-5239-4a69-ab4e-79c5392ab02c admin admin] PATH_INFO: `/v3/projects/ebbd713c8a794e79bd298379477f85b0` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:19.978535 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b26fce-5239-4a69-ab4e-79c5392ab02c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebbd713c8a794e79bd298379477f85b0)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:19.985800 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b26fce-5239-4a69-ab4e-79c5392ab02c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:20.078497 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bcd09-34d9-4eff-9e2f-818a29ba6476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:20.079686 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bcd09-34d9-4eff-9e2f-818a29ba6476 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:20.080179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bcd09-34d9-4eff-9e2f-818a29ba6476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:20.085832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bcd09-34d9-4eff-9e2f-818a29ba6476 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:20.087583 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bcd09-34d9-4eff-9e2f-818a29ba6476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:20.092647 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bcd09-34d9-4eff-9e2f-818a29ba6476 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:20.144113 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-87b26fce-5239-4a69-ab4e-79c5392ab02c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebbd713c8a794e79bd298379477f85b0', 'request_id': 'req-87b26fce-5239-4a69-ab4e-79c5392ab02c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:20.148605 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 895/1758] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:19 2022] POST /identity/v3/users => generated 284 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:20.148605 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bcd09-34d9-4eff-9e2f-818a29ba6476 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:20.156988 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3c8bcd09-34d9-4eff-9e2f-818a29ba6476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:20.168668 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-87b26fce-5239-4a69-ab4e-79c5392ab02c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebbd713c8a794e79bd298379477f85b0', 'request_id': 'req-87b26fce-5239-4a69-ab4e-79c5392ab02c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:20.191557 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-87b26fce-5239-4a69-ab4e-79c5392ab02c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebbd713c8a794e79bd298379477f85b0', 'request_id': 'req-87b26fce-5239-4a69-ab4e-79c5392ab02c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:20.230442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-87b26fce-5239-4a69-ab4e-79c5392ab02c admin admin] The token cache is being invalidate because project ebbd713c8a794e79bd298379477f85b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:20.230904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-87b26fce-5239-4a69-ab4e-79c5392ab02c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:20.232375 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-87b26fce-5239-4a69-ab4e-79c5392ab02c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:20.236527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 864/1759] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:19 2022] DELETE /identity/v3/projects/ebbd713c8a794e79bd298379477f85b0 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:20.238088 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b26fce-5239-4a69-ab4e-79c5392ab02c admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:20.244518 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-87b26fce-5239-4a69-ab4e-79c5392ab02c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:20.403948 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:20.413104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bcd09-34d9-4eff-9e2f-818a29ba6476 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:20.436622 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b26fce-5239-4a69-ab4e-79c5392ab02c admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:20.443580 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc4e6d-16ec-461e-949b-6c636cee92fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:20.444974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc4e6d-16ec-461e-949b-6c636cee92fe admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:20.445480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc4e6d-16ec-461e-949b-6c636cee92fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:20.445927 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc4e6d-16ec-461e-949b-6c636cee92fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:20.447076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc4e6d-16ec-461e-949b-6c636cee92fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:20.451560 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc4e6d-16ec-461e-949b-6c636cee92fe admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:20.469965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 865/1760] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:20.474841 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54de90-d042-4451-b480-a10e641bc81c None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:20.475748 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54de90-d042-4451-b480-a10e641bc81c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:20.476388 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54de90-d042-4451-b480-a10e641bc81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:20.532446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-bf54de90-d042-4451-b480-a10e641bc81c None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:20.534111 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-bf54de90-d042-4451-b480-a10e641bc81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:20.535135 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:20.559519 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 866/1761] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:20.562276 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54de90-d042-4451-b480-a10e641bc81c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:20.591666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54de90-d042-4451-b480-a10e641bc81c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:20.613319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42ee4b-3754-46de-b136-f598127d3a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:20.614795 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42ee4b-3754-46de-b136-f598127d3a28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:20.617503 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42ee4b-3754-46de-b136-f598127d3a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:20.617867 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42ee4b-3754-46de-b136-f598127d3a28 admin admin] PATH_INFO: `/v3/projects/3e9d6bd9b37f47fc80ef419ef4788f6b/users/74823c50ab7a45aea0a368678fa56a85/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:20.621220 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb988a1-9674-4974-8b90-e18f0fc42da9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:20.622294 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb988a1-9674-4974-8b90-e18f0fc42da9 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:20.622765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb988a1-9674-4974-8b90-e18f0fc42da9 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:20.623049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb988a1-9674-4974-8b90-e18f0fc42da9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:20.641183 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4fb988a1-9674-4974-8b90-e18f0fc42da9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:20.670486 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42ee4b-3754-46de-b136-f598127d3a28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9d6bd9b37f47fc80ef419ef4788f6b, user_id=74823c50ab7a45aea0a368678fa56a85, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:20.677721 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42ee4b-3754-46de-b136-f598127d3a28 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:20.708619 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 867/1762] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:20 2022] PUT /identity/v3/projects/3e9d6bd9b37f47fc80ef419ef4788f6b/users/74823c50ab7a45aea0a368678fa56a85/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:20.710879 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163f0ef-151f-4a55-80a7-6293c5f49927 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:20.711166 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163f0ef-151f-4a55-80a7-6293c5f49927 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:20.714428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163f0ef-151f-4a55-80a7-6293c5f49927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:20.769740 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-c163f0ef-151f-4a55-80a7-6293c5f49927 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:20.776287 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c163f0ef-151f-4a55-80a7-6293c5f49927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:20.874755 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb988a1-9674-4974-8b90-e18f0fc42da9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:20.880494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb988a1-9674-4974-8b90-e18f0fc42da9 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:20.910394 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 896/1763] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 764 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:20.911572 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb988a1-9674-4974-8b90-e18f0fc42da9 service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:20.931359 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 868/1764] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:20.932588 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163f0ef-151f-4a55-80a7-6293c5f49927 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:20.934129 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c163f0ef-151f-4a55-80a7-6293c5f49927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:20.941152 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb988a1-9674-4974-8b90-e18f0fc42da9 service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:20.954545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d572ba6-983f-45dc-9e2f-db9f24cd369a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:20.955590 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d572ba6-983f-45dc-9e2f-db9f24cd369a admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:20.955970 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d572ba6-983f-45dc-9e2f-db9f24cd369a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:20.956349 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163f0ef-151f-4a55-80a7-6293c5f49927 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:20.956471 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d572ba6-983f-45dc-9e2f-db9f24cd369a admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:20.957457 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d572ba6-983f-45dc-9e2f-db9f24cd369a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:20.959503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d572ba6-983f-45dc-9e2f-db9f24cd369a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:20.985334 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e05f65-83bc-457a-95c1-bf7ac48ba862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:20.985334 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e05f65-83bc-457a-95c1-bf7ac48ba862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:20.985835 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e05f65-83bc-457a-95c1-bf7ac48ba862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:20.986116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e05f65-83bc-457a-95c1-bf7ac48ba862 admin admin] PATH_INFO: `/v3/users/0930437365934d2388f9ff91cfcb39b5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:20.993051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 897/1765] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:20.993291 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e05f65-83bc-457a-95c1-bf7ac48ba862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0930437365934d2388f9ff91cfcb39b5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:20.995386 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e05f65-83bc-457a-95c1-bf7ac48ba862 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:20.995996 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d572ba6-983f-45dc-9e2f-db9f24cd369a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:21.025268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d572ba6-983f-45dc-9e2f-db9f24cd369a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:21.039516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0193f-a4fd-4fd0-9935-d243effffa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:21.040396 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0193f-a4fd-4fd0-9935-d243effffa1d admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:21.040768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0193f-a4fd-4fd0-9935-d243effffa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:21.041149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0193f-a4fd-4fd0-9935-d243effffa1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:21.041988 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0193f-a4fd-4fd0-9935-d243effffa1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:40:21.042391 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0193f-a4fd-4fd0-9935-d243effffa1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:21.044141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0193f-a4fd-4fd0-9935-d243effffa1d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:21.101046 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 898/1766] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:40:21.102131 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0193f-a4fd-4fd0-9935-d243effffa1d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:21.118796 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0193f-a4fd-4fd0-9935-d243effffa1d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:21.131892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d63da-7652-4cc3-adee-3cd76b75ad65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:21.133110 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d63da-7652-4cc3-adee-3cd76b75ad65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:21.133599 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d63da-7652-4cc3-adee-3cd76b75ad65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:21.134068 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d63da-7652-4cc3-adee-3cd76b75ad65 admin admin] PATH_INFO: `/v3/projects/3e9d6bd9b37f47fc80ef419ef4788f6b/users/74823c50ab7a45aea0a368678fa56a85/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:21.139426 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d63da-7652-4cc3-adee-3cd76b75ad65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9d6bd9b37f47fc80ef419ef4788f6b, user_id=74823c50ab7a45aea0a368678fa56a85, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:21.140477 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d4e05f65-83bc-457a-95c1-bf7ac48ba862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0930437365934d2388f9ff91cfcb39b5'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:21.142717 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d63da-7652-4cc3-adee-3cd76b75ad65 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:21.152926 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d4e05f65-83bc-457a-95c1-bf7ac48ba862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0930437365934d2388f9ff91cfcb39b5'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:21.154116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d4e05f65-83bc-457a-95c1-bf7ac48ba862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0930437365934d2388f9ff91cfcb39b5'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:21.170713 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 899/1767] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:21 2022] PUT /identity/v3/projects/3e9d6bd9b37f47fc80ef419ef4788f6b/users/74823c50ab7a45aea0a368678fa56a85/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:21.170713 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d63da-7652-4cc3-adee-3cd76b75ad65 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:21.173234 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-336d63da-7652-4cc3-adee-3cd76b75ad65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:21.178137 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d4e05f65-83bc-457a-95c1-bf7ac48ba862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0930437365934d2388f9ff91cfcb39b5'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:21.205693 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d4e05f65-83bc-457a-95c1-bf7ac48ba862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0930437365934d2388f9ff91cfcb39b5'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:21.219335 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 869/1768] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:20 2022] DELETE /identity/v3/users/0930437365934d2388f9ff91cfcb39b5 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:21.220708 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7a2eb-951b-46f8-ae57-d346adf117d9 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:21.220999 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7a2eb-951b-46f8-ae57-d346adf117d9 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:21.221275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7a2eb-951b-46f8-ae57-d346adf117d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:21.284733 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-ece7a2eb-951b-46f8-ae57-d346adf117d9 None None] MFA Rules not processed for user `74823c50ab7a45aea0a368678fa56a85`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:21.288037 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ece7a2eb-951b-46f8-ae57-d346adf117d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:21.322978 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d63da-7652-4cc3-adee-3cd76b75ad65 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:21.336322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:21.402261 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:21.433038 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1048e16-11cb-40e4-9933-e3c7addc4470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:21.433873 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1048e16-11cb-40e4-9933-e3c7addc4470 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:21.434154 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1048e16-11cb-40e4-9933-e3c7addc4470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:21.434471 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1048e16-11cb-40e4-9933-e3c7addc4470 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:21.435694 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1048e16-11cb-40e4-9933-e3c7addc4470 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:21.449447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1048e16-11cb-40e4-9933-e3c7addc4470 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:21.461457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 870/1769] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:21 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:21.464045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5281b8-1652-422e-bb73-db0d62656b87 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:21.464636 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5281b8-1652-422e-bb73-db0d62656b87 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:21.471459 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5281b8-1652-422e-bb73-db0d62656b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:21.502612 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 900/1770] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:21 2022] POST /identity/v3/projects => generated 401 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:21.506699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1048e16-11cb-40e4-9933-e3c7addc4470 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:21.507392 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-4a5281b8-1652-422e-bb73-db0d62656b87 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:21.510617 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4a5281b8-1652-422e-bb73-db0d62656b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:21.512552 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e1048e16-11cb-40e4-9933-e3c7addc4470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:21.671460 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1048e16-11cb-40e4-9933-e3c7addc4470 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:21.675586 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc48b4-cdae-4d03-804f-29153a2c66bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:21.676296 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc48b4-cdae-4d03-804f-29153a2c66bd service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:21.677070 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc48b4-cdae-4d03-804f-29153a2c66bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:21.677070 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc48b4-cdae-4d03-804f-29153a2c66bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:21.691322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 871/1771] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:21.693112 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5281b8-1652-422e-bb73-db0d62656b87 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:21.707028 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5281b8-1652-422e-bb73-db0d62656b87 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:21.713248 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d46a43-9ad7-4c00-92b2-964d0a27cbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:21.715707 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d46a43-9ad7-4c00-92b2-964d0a27cbab admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:21.716228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d46a43-9ad7-4c00-92b2-964d0a27cbab admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:21.716752 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d46a43-9ad7-4c00-92b2-964d0a27cbab admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:21.717864 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d46a43-9ad7-4c00-92b2-964d0a27cbab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:21.720711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d46a43-9ad7-4c00-92b2-964d0a27cbab admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:21.756548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 872/1772] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:21 2022] POST /identity/v3/users => generated 301 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:21.760502 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d46a43-9ad7-4c00-92b2-964d0a27cbab admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:21.764611 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-95d46a43-9ad7-4c00-92b2-964d0a27cbab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:21.830175 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc48b4-cdae-4d03-804f-29153a2c66bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:21.834052 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc48b4-cdae-4d03-804f-29153a2c66bd service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:21.855399 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 901/1773] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:21 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:21.857030 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc48b4-cdae-4d03-804f-29153a2c66bd service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:21.877326 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc48b4-cdae-4d03-804f-29153a2c66bd service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:21.889311 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5079e1f-4ccb-4f0d-8e2c-8c38ca11d9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:21.890380 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5079e1f-4ccb-4f0d-8e2c-8c38ca11d9db admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:21.891171 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5079e1f-4ccb-4f0d-8e2c-8c38ca11d9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:21.891582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5079e1f-4ccb-4f0d-8e2c-8c38ca11d9db admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:21.892657 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5079e1f-4ccb-4f0d-8e2c-8c38ca11d9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:21.895152 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5079e1f-4ccb-4f0d-8e2c-8c38ca11d9db admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:21.921931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 902/1774] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:21.926550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5079e1f-4ccb-4f0d-8e2c-8c38ca11d9db admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:21.945423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5079e1f-4ccb-4f0d-8e2c-8c38ca11d9db admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:21.955402 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28d29e-884f-4f0d-a706-a0c19cdf4bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:21.956109 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28d29e-884f-4f0d-a706-a0c19cdf4bda admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:21.956388 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28d29e-884f-4f0d-a706-a0c19cdf4bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:21.956657 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28d29e-884f-4f0d-a706-a0c19cdf4bda admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:21.957394 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28d29e-884f-4f0d-a706-a0c19cdf4bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:21.961268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28d29e-884f-4f0d-a706-a0c19cdf4bda admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:21.964540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d46a43-9ad7-4c00-92b2-964d0a27cbab admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:21.972933 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f279c75-5388-4297-bb0d-fe360c813d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:21.980353 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 903/1775] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:40:21.983930 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f279c75-5388-4297-bb0d-fe360c813d51 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:21.985420 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f279c75-5388-4297-bb0d-fe360c813d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:21.985899 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f279c75-5388-4297-bb0d-fe360c813d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:21.998895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28d29e-884f-4f0d-a706-a0c19cdf4bda admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:22.009655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f279c75-5388-4297-bb0d-fe360c813d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:22.011394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f279c75-5388-4297-bb0d-fe360c813d51 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:22.023317 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28d29e-884f-4f0d-a706-a0c19cdf4bda admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:22.024403 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 873/1776] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:22.025440 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f279c75-5388-4297-bb0d-fe360c813d51 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:22.030940 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ad69e-2f19-4dfe-aa38-f40dcc842b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:22.032652 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ad69e-2f19-4dfe-aa38-f40dcc842b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:22.033569 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ad69e-2f19-4dfe-aa38-f40dcc842b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:22.033939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ad69e-2f19-4dfe-aa38-f40dcc842b30 admin admin] PATH_INFO: `/v3/projects/5600144643a6428589899469e8b16cea/users/d9bf252c36eb4468a24c13d3a3f78708/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:22.037428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f279c75-5388-4297-bb0d-fe360c813d51 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:22.044309 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369182f-72f9-48c4-ae46-79c3f849789a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:22.045281 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369182f-72f9-48c4-ae46-79c3f849789a service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:22.045714 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369182f-72f9-48c4-ae46-79c3f849789a service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:22.046129 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369182f-72f9-48c4-ae46-79c3f849789a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:22.048362 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7369182f-72f9-48c4-ae46-79c3f849789a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:22.062084 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ad69e-2f19-4dfe-aa38-f40dcc842b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5600144643a6428589899469e8b16cea, user_id=d9bf252c36eb4468a24c13d3a3f78708, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:22.068602 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ad69e-2f19-4dfe-aa38-f40dcc842b30 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:22.103690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 904/1777] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:21 2022] PUT /identity/v3/projects/5600144643a6428589899469e8b16cea/users/d9bf252c36eb4468a24c13d3a3f78708/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:22.115897 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:22.136567 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ed3f8-7ea8-4b1d-b3c4-957cbff047ba None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:22.137247 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ed3f8-7ea8-4b1d-b3c4-957cbff047ba None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:22.137612 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ed3f8-7ea8-4b1d-b3c4-957cbff047ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:22.164836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369182f-72f9-48c4-ae46-79c3f849789a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:22.164836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369182f-72f9-48c4-ae46-79c3f849789a service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:22.187569 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 874/1778] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:22 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:22.203151 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c86ed3f8-7ea8-4b1d-b3c4-957cbff047ba None None] MFA Rules not processed for user `d9bf252c36eb4468a24c13d3a3f78708`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:22.205865 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c86ed3f8-7ea8-4b1d-b3c4-957cbff047ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:22.306527 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:22.441193 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 905/1779] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:22.446402 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369182f-72f9-48c4-ae46-79c3f849789a service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:22.464565 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369182f-72f9-48c4-ae46-79c3f849789a service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:22.687082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b68d41-fcf6-416b-9293-a81be067f9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:22.694710 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b68d41-fcf6-416b-9293-a81be067f9df admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:22.700677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b68d41-fcf6-416b-9293-a81be067f9df admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:22.701149 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b68d41-fcf6-416b-9293-a81be067f9df admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:22.702039 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b68d41-fcf6-416b-9293-a81be067f9df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:22.704141 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b68d41-fcf6-416b-9293-a81be067f9df admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:22.801613 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 875/1780] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:22 2022] POST /identity/v3/projects => generated 399 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:22.802926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ed3f8-7ea8-4b1d-b3c4-957cbff047ba None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:22.819586 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ed3f8-7ea8-4b1d-b3c4-957cbff047ba None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:22.961234 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603723a-b197-47f5-8a2b-3690639b8549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:22.962039 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603723a-b197-47f5-8a2b-3690639b8549 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:22.962361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603723a-b197-47f5-8a2b-3690639b8549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:22.962699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603723a-b197-47f5-8a2b-3690639b8549 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:22.963595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603723a-b197-47f5-8a2b-3690639b8549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:22.965639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603723a-b197-47f5-8a2b-3690639b8549 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:23.011192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 906/1781] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:22 2022] POST /identity/v3/users => generated 306 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:23.014908 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b68d41-fcf6-416b-9293-a81be067f9df admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:23.031250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b68d41-fcf6-416b-9293-a81be067f9df admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:23.046850 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fed624-1698-4122-ab03-a5b37db27a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:23.046850 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fed624-1698-4122-ab03-a5b37db27a70 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:23.046850 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fed624-1698-4122-ab03-a5b37db27a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:23.046850 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fed624-1698-4122-ab03-a5b37db27a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:23.047194 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fed624-1698-4122-ab03-a5b37db27a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:23.048991 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fed624-1698-4122-ab03-a5b37db27a70 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:23.078744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603723a-b197-47f5-8a2b-3690639b8549 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:23.086117 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 876/1782] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:23.096652 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603723a-b197-47f5-8a2b-3690639b8549 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:23.110695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e726e-e4ba-40bc-a6da-94ec68df7ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:23.111643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e726e-e4ba-40bc-a6da-94ec68df7ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:23.111930 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e726e-e4ba-40bc-a6da-94ec68df7ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:23.112203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e726e-e4ba-40bc-a6da-94ec68df7ecb admin admin] PATH_INFO: `/v3/projects/3fe506c307034c198e52c5aaa38ce837/users/fbad21a088a64b509a7698be55809845/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:23.161976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e726e-e4ba-40bc-a6da-94ec68df7ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fe506c307034c198e52c5aaa38ce837, user_id=fbad21a088a64b509a7698be55809845, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:23.166841 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e726e-e4ba-40bc-a6da-94ec68df7ecb admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:23.213999 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fed624-1698-4122-ab03-a5b37db27a70 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:23.215063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 907/1783] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:23 2022] PUT /identity/v3/projects/3fe506c307034c198e52c5aaa38ce837/users/fbad21a088a64b509a7698be55809845/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:40:23.231090 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fed624-1698-4122-ab03-a5b37db27a70 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:23.349047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f4fc7-64bc-4760-816d-b158812089a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:23.349191 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f4fc7-64bc-4760-816d-b158812089a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:23.349621 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f4fc7-64bc-4760-816d-b158812089a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:23.349903 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f4fc7-64bc-4760-816d-b158812089a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:23.350924 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f4fc7-64bc-4760-816d-b158812089a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:23.353622 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f4fc7-64bc-4760-816d-b158812089a7 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:23.377965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 877/1784] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:23.379532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e726e-e4ba-40bc-a6da-94ec68df7ecb admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:23.391205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e726e-e4ba-40bc-a6da-94ec68df7ecb admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:23.398171 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba010b-6e8c-45bd-ae59-dfe9533a9358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:23.399492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba010b-6e8c-45bd-ae59-dfe9533a9358 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:23.399777 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba010b-6e8c-45bd-ae59-dfe9533a9358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:23.400055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba010b-6e8c-45bd-ae59-dfe9533a9358 admin admin] PATH_INFO: `/v3/projects/3fe506c307034c198e52c5aaa38ce837/users/fbad21a088a64b509a7698be55809845/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:23.402194 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba010b-6e8c-45bd-ae59-dfe9533a9358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fe506c307034c198e52c5aaa38ce837, user_id=fbad21a088a64b509a7698be55809845, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:23.404920 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba010b-6e8c-45bd-ae59-dfe9533a9358 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:23.427451 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 908/1785] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:23 2022] PUT /identity/v3/projects/3fe506c307034c198e52c5aaa38ce837/users/fbad21a088a64b509a7698be55809845/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:23.428450 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa95340-1bb4-4905-b6b5-e3391072e8bf None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:23.428739 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa95340-1bb4-4905-b6b5-e3391072e8bf None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:23.429041 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa95340-1bb4-4905-b6b5-e3391072e8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:23.466443 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-7aa95340-1bb4-4905-b6b5-e3391072e8bf None None] MFA Rules not processed for user `fbad21a088a64b509a7698be55809845`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:23.468447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7aa95340-1bb4-4905-b6b5-e3391072e8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:23.661664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:23.746119 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 878/1786] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:23 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:40:23.759120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba010b-6e8c-45bd-ae59-dfe9533a9358 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:23.944282 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba010b-6e8c-45bd-ae59-dfe9533a9358 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:23.959598 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab12426-29e9-40ab-aea1-92d300107ba9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:23.962518 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab12426-29e9-40ab-aea1-92d300107ba9 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:23.963961 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab12426-29e9-40ab-aea1-92d300107ba9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:23.964452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab12426-29e9-40ab-aea1-92d300107ba9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:24.003758 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab12426-29e9-40ab-aea1-92d300107ba9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:24.012168 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab12426-29e9-40ab-aea1-92d300107ba9 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:24.033176 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 909/1787] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:23 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:24.183060 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa95340-1bb4-4905-b6b5-e3391072e8bf None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:24.199412 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa95340-1bb4-4905-b6b5-e3391072e8bf None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:24.204728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa697baf-6ecf-4c8f-ad77-ec77df9752a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:24.205557 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa697baf-6ecf-4c8f-ad77-ec77df9752a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:24.206086 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa697baf-6ecf-4c8f-ad77-ec77df9752a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:24.206492 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa697baf-6ecf-4c8f-ad77-ec77df9752a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:24.360611 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a3afe-2a20-4c24-b948-6b0b3615f48a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:24.360898 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a3afe-2a20-4c24-b948-6b0b3615f48a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:24.361175 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a3afe-2a20-4c24-b948-6b0b3615f48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:24.406243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa697baf-6ecf-4c8f-ad77-ec77df9752a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:24.408371 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa697baf-6ecf-4c8f-ad77-ec77df9752a4 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:24.416879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-917a3afe-2a20-4c24-b948-6b0b3615f48a None None] MFA Rules not processed for user `e1cd9b4bda834e90b366d83445c85810`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:24.421155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-917a3afe-2a20-4c24-b948-6b0b3615f48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:24.450653 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 879/1788] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:24 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:24.464896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:24.624602 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 910/1789] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:24.633335 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa697baf-6ecf-4c8f-ad77-ec77df9752a4 service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:24.634980 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-fa697baf-6ecf-4c8f-ad77-ec77df9752a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:24.780447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507bd6f-4f0c-48b2-a5de-30f271c17c36 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:24.781501 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507bd6f-4f0c-48b2-a5de-30f271c17c36 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:24.781788 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507bd6f-4f0c-48b2-a5de-30f271c17c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:24.797830 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa697baf-6ecf-4c8f-ad77-ec77df9752a4 service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:24.804230 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04074461-e15e-40f4-84c1-3941a067d343 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:24.804508 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04074461-e15e-40f4-84c1-3941a067d343 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:24.804748 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04074461-e15e-40f4-84c1-3941a067d343 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:24.805026 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04074461-e15e-40f4-84c1-3941a067d343 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:24.814215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04074461-e15e-40f4-84c1-3941a067d343 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:24.816278 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04074461-e15e-40f4-84c1-3941a067d343 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:24.827091 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 880/1790] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:24.874020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4507bd6f-4f0c-48b2-a5de-30f271c17c36 None None] MFA Rules not processed for user `bb90d2315ce54db8820d4943b1a8c53c`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:24.875340 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4507bd6f-4f0c-48b2-a5de-30f271c17c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:25.145268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 911/1791] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:25.167028 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04074461-e15e-40f4-84c1-3941a067d343 service nova] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:25.168500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-04074461-e15e-40f4-84c1-3941a067d343 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:25.197675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04074461-e15e-40f4-84c1-3941a067d343 service nova] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:25.217807 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1955db9-f19c-4793-80a5-89cff4d7d908 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:25.219080 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1955db9-f19c-4793-80a5-89cff4d7d908 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:25.219651 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1955db9-f19c-4793-80a5-89cff4d7d908 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:25.220185 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1955db9-f19c-4793-80a5-89cff4d7d908 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:25.235321 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1955db9-f19c-4793-80a5-89cff4d7d908 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:25.237360 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1955db9-f19c-4793-80a5-89cff4d7d908 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:25.260709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 881/1792] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:25.813316 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b4a0c-fce5-40c8-8198-8eff2817f513 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:25.813757 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b4a0c-fce5-40c8-8198-8eff2817f513 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:25.814201 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b4a0c-fce5-40c8-8198-8eff2817f513 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:25.816060 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 912/1793] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 13:40:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:40:25.933389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05480ae4-23f8-4160-865e-0855bf9a6321 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:25.933647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05480ae4-23f8-4160-865e-0855bf9a6321 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:25.933935 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05480ae4-23f8-4160-865e-0855bf9a6321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:25.981401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-05480ae4-23f8-4160-865e-0855bf9a6321 None None] MFA Rules not processed for user `5a0061e2927843cf86769d2beab18743`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:25.984568 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-05480ae4-23f8-4160-865e-0855bf9a6321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:26.010700 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 882/1794] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 13:40:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:27.014096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b4a0c-fce5-40c8-8198-8eff2817f513 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:27.046714 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05480ae4-23f8-4160-865e-0855bf9a6321 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:27.048479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-05480ae4-23f8-4160-865e-0855bf9a6321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:27.079922 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b4a0c-fce5-40c8-8198-8eff2817f513 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:27.115347 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d873ef3-f520-4d7a-8feb-3332f6e6ca2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:27.116287 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d873ef3-f520-4d7a-8feb-3332f6e6ca2c service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:27.116705 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d873ef3-f520-4d7a-8feb-3332f6e6ca2c service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:27.117158 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d873ef3-f520-4d7a-8feb-3332f6e6ca2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:27.150600 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d873ef3-f520-4d7a-8feb-3332f6e6ca2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:27.155788 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d873ef3-f520-4d7a-8feb-3332f6e6ca2c service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:27.193835 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 913/1795] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:27.239306 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:27.307948 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05480ae4-23f8-4160-865e-0855bf9a6321 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:27.322750 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b60fc2-d3c4-4327-a9a8-9be6541f9adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:27.324061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b60fc2-d3c4-4327-a9a8-9be6541f9adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:27.324772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b60fc2-d3c4-4327-a9a8-9be6541f9adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:27.325247 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b60fc2-d3c4-4327-a9a8-9be6541f9adf admin admin] PATH_INFO: `/v3/projects/258632eba7bb40678279f55a6778ac1f` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:27.327088 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b60fc2-d3c4-4327-a9a8-9be6541f9adf admin admin] RBAC: Authorizing `identity:delete_project(project_id=258632eba7bb40678279f55a6778ac1f)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:27.329229 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b60fc2-d3c4-4327-a9a8-9be6541f9adf admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:27.444002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a8b60fc2-d3c4-4327-a9a8-9be6541f9adf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '258632eba7bb40678279f55a6778ac1f', 'request_id': 'req-a8b60fc2-d3c4-4327-a9a8-9be6541f9adf'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:27.458801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a8b60fc2-d3c4-4327-a9a8-9be6541f9adf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '258632eba7bb40678279f55a6778ac1f', 'request_id': 'req-a8b60fc2-d3c4-4327-a9a8-9be6541f9adf'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:27.475280 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a8b60fc2-d3c4-4327-a9a8-9be6541f9adf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '258632eba7bb40678279f55a6778ac1f', 'request_id': 'req-a8b60fc2-d3c4-4327-a9a8-9be6541f9adf'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:27.502014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a8b60fc2-d3c4-4327-a9a8-9be6541f9adf admin admin] The token cache is being invalidate because project 258632eba7bb40678279f55a6778ac1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:27.502311 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a8b60fc2-d3c4-4327-a9a8-9be6541f9adf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:27.504254 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a8b60fc2-d3c4-4327-a9a8-9be6541f9adf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:27.510649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d873ef3-f520-4d7a-8feb-3332f6e6ca2c service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:27.512942 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 883/1796] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:27 2022] DELETE /identity/v3/projects/258632eba7bb40678279f55a6778ac1f => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:27.529688 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d873ef3-f520-4d7a-8feb-3332f6e6ca2c service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:27.649235 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f64b26-f28b-4f27-929f-14865b4d2158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:27.650424 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f64b26-f28b-4f27-929f-14865b4d2158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:27.651139 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f64b26-f28b-4f27-929f-14865b4d2158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:27.651553 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f64b26-f28b-4f27-929f-14865b4d2158 admin admin] PATH_INFO: `/v3/users/6fb1ecf9418548d3a6fa42c29a10ce29` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:27.655506 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f64b26-f28b-4f27-929f-14865b4d2158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fb1ecf9418548d3a6fa42c29a10ce29)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:27.660003 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f64b26-f28b-4f27-929f-14865b4d2158 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:27.707026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:27.766626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-41f64b26-f28b-4f27-929f-14865b4d2158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fb1ecf9418548d3a6fa42c29a10ce29'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:27.780868 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-41f64b26-f28b-4f27-929f-14865b4d2158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fb1ecf9418548d3a6fa42c29a10ce29'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:27.781721 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-41f64b26-f28b-4f27-929f-14865b4d2158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fb1ecf9418548d3a6fa42c29a10ce29'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:27.800656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-41f64b26-f28b-4f27-929f-14865b4d2158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fb1ecf9418548d3a6fa42c29a10ce29'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:27.801756 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-41f64b26-f28b-4f27-929f-14865b4d2158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fb1ecf9418548d3a6fa42c29a10ce29'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:27.822240 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 914/1797] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:27 2022] DELETE /identity/v3/users/6fb1ecf9418548d3a6fa42c29a10ce29 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:29.370950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d22a62-3285-412c-b392-cf2066f0d801 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:29.371455 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d22a62-3285-412c-b392-cf2066f0d801 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:29.371542 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d22a62-3285-412c-b392-cf2066f0d801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:29.406019 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-29d22a62-3285-412c-b392-cf2066f0d801 None None] MFA Rules not processed for user `78290c0b02cd4cf2844decf6e7569535`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:29.408475 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-29d22a62-3285-412c-b392-cf2066f0d801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:29.557299 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 884/1798] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:29.599182 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f64b26-f28b-4f27-929f-14865b4d2158 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:29.600857 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-41f64b26-f28b-4f27-929f-14865b4d2158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:29.674366 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a0377-4986-47c0-b831-1adea5b43252 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:29.674546 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a0377-4986-47c0-b831-1adea5b43252 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:29.675045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a0377-4986-47c0-b831-1adea5b43252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:29.725317 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-a47a0377-4986-47c0-b831-1adea5b43252 None None] MFA Rules not processed for user `e1cd9b4bda834e90b366d83445c85810`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:29.729608 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a47a0377-4986-47c0-b831-1adea5b43252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:29.804769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f64b26-f28b-4f27-929f-14865b4d2158 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:29.817604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0459ff-cf42-476d-a466-c44fd29e3725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:29.820998 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0459ff-cf42-476d-a466-c44fd29e3725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:29.822662 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0459ff-cf42-476d-a466-c44fd29e3725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:29.823317 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0459ff-cf42-476d-a466-c44fd29e3725 admin admin] PATH_INFO: `/v3/projects/5d34f54107f34bc7b428b34116d56eec` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:29.827365 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0459ff-cf42-476d-a466-c44fd29e3725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d34f54107f34bc7b428b34116d56eec)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:29.831778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0459ff-cf42-476d-a466-c44fd29e3725 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:29.872076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 885/1799] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:29.873313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a0377-4986-47c0-b831-1adea5b43252 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:29.877053 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a47a0377-4986-47c0-b831-1adea5b43252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:29.909579 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a0377-4986-47c0-b831-1adea5b43252 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:29.927867 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebae8b4-b1ab-493f-9c42-aaccd2dfb521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:29.929752 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebae8b4-b1ab-493f-9c42-aaccd2dfb521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:29.930560 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebae8b4-b1ab-493f-9c42-aaccd2dfb521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:29.931288 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebae8b4-b1ab-493f-9c42-aaccd2dfb521 admin admin] PATH_INFO: `/v3/users/d9bf252c36eb4468a24c13d3a3f78708` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:29.934449 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebae8b4-b1ab-493f-9c42-aaccd2dfb521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9bf252c36eb4468a24c13d3a3f78708)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:29.938880 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebae8b4-b1ab-493f-9c42-aaccd2dfb521 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:29.951325 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fe0459ff-cf42-476d-a466-c44fd29e3725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d34f54107f34bc7b428b34116d56eec', 'request_id': 'req-fe0459ff-cf42-476d-a466-c44fd29e3725'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:29.977514 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fe0459ff-cf42-476d-a466-c44fd29e3725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d34f54107f34bc7b428b34116d56eec', 'request_id': 'req-fe0459ff-cf42-476d-a466-c44fd29e3725'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:29.980126 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:29.987694 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fe0459ff-cf42-476d-a466-c44fd29e3725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d34f54107f34bc7b428b34116d56eec', 'request_id': 'req-fe0459ff-cf42-476d-a466-c44fd29e3725'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:30.017024 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fe0459ff-cf42-476d-a466-c44fd29e3725 admin admin] The token cache is being invalidate because project 5d34f54107f34bc7b428b34116d56eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:30.017252 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fe0459ff-cf42-476d-a466-c44fd29e3725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:30.019197 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fe0459ff-cf42-476d-a466-c44fd29e3725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:30.026496 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 915/1800] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:29 2022] DELETE /identity/v3/projects/5d34f54107f34bc7b428b34116d56eec => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:30.031859 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525454b5-ed5b-4ef5-ba47-3c221424c5fb None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:30.032384 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525454b5-ed5b-4ef5-ba47-3c221424c5fb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:30.032837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525454b5-ed5b-4ef5-ba47-3c221424c5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:30.047565 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4ebae8b4-b1ab-493f-9c42-aaccd2dfb521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9bf252c36eb4468a24c13d3a3f78708'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:30.058899 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4ebae8b4-b1ab-493f-9c42-aaccd2dfb521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9bf252c36eb4468a24c13d3a3f78708'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:30.059857 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4ebae8b4-b1ab-493f-9c42-aaccd2dfb521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9bf252c36eb4468a24c13d3a3f78708'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:30.071784 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4ebae8b4-b1ab-493f-9c42-aaccd2dfb521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9bf252c36eb4468a24c13d3a3f78708'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:30.076087 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-525454b5-ed5b-4ef5-ba47-3c221424c5fb None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:30.080572 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-525454b5-ed5b-4ef5-ba47-3c221424c5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:30.092005 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4ebae8b4-b1ab-493f-9c42-aaccd2dfb521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9bf252c36eb4468a24c13d3a3f78708'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:30.102128 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 886/1801] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:29 2022] DELETE /identity/v3/users/d9bf252c36eb4468a24c13d3a3f78708 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:30.107417 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea79aa1-2cf4-4457-b5cc-610584225b03 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:30.107417 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea79aa1-2cf4-4457-b5cc-610584225b03 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:30.107721 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea79aa1-2cf4-4457-b5cc-610584225b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:30.143802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-dea79aa1-2cf4-4457-b5cc-610584225b03 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:30.148780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-dea79aa1-2cf4-4457-b5cc-610584225b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:30.152710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:30.211820 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 916/1802] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:30.220609 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd12a9-caf0-40c9-9991-db27aa9dd95f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:30.220989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd12a9-caf0-40c9-9991-db27aa9dd95f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:30.221354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd12a9-caf0-40c9-9991-db27aa9dd95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:30.241074 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4ccd12a9-caf0-40c9-9991-db27aa9dd95f None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:30.242416 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4ccd12a9-caf0-40c9-9991-db27aa9dd95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:30.254807 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 887/1803] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:30.256423 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f4455-28ae-4bd6-b3f6-a4bda7ad94d6 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:30.256708 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f4455-28ae-4bd6-b3f6-a4bda7ad94d6 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:30.260080 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f4455-28ae-4bd6-b3f6-a4bda7ad94d6 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:30.260225 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 917/1804] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:30.261494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd12a9-caf0-40c9-9991-db27aa9dd95f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:30.264825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 888/1805] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 13:40:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:40:30.276128 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd12a9-caf0-40c9-9991-db27aa9dd95f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:30.282151 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c660ee9-d4c1-4ff0-802a-317c144ce7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:30.284369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2482188-9065-40e0-87b6-780ca5f1652c None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:30.284651 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2482188-9065-40e0-87b6-780ca5f1652c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:30.285496 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2482188-9065-40e0-87b6-780ca5f1652c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:30.290834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c660ee9-d4c1-4ff0-802a-317c144ce7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:30.291557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c660ee9-d4c1-4ff0-802a-317c144ce7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:30.292839 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c660ee9-d4c1-4ff0-802a-317c144ce7a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:30.299048 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c660ee9-d4c1-4ff0-802a-317c144ce7a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:40:30.299410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c660ee9-d4c1-4ff0-802a-317c144ce7a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:30.301089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c660ee9-d4c1-4ff0-802a-317c144ce7a0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:30.321552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-c2482188-9065-40e0-87b6-780ca5f1652c None None] MFA Rules not processed for user `5a0061e2927843cf86769d2beab18743`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:30.323006 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c2482188-9065-40e0-87b6-780ca5f1652c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:30.338941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 918/1806] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:40:30.341775 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c660ee9-d4c1-4ff0-802a-317c144ce7a0 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:30.345554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7c660ee9-d4c1-4ff0-802a-317c144ce7a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:30.434823 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 889/1807] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 13:40:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:40:30.435998 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2482188-9065-40e0-87b6-780ca5f1652c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:30.449950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2482188-9065-40e0-87b6-780ca5f1652c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:30.455413 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c660ee9-d4c1-4ff0-802a-317c144ce7a0 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:30.455978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c4474-9211-45a7-80b0-81d0eec89339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:30.457363 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c4474-9211-45a7-80b0-81d0eec89339 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:30.457966 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c4474-9211-45a7-80b0-81d0eec89339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:30.458599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c4474-9211-45a7-80b0-81d0eec89339 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:30.458944 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c4474-9211-45a7-80b0-81d0eec89339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:30.459893 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5f0d8-1f70-4fea-978c-0221430b7aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:30.460695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5f0d8-1f70-4fea-978c-0221430b7aae service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:30.460985 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5f0d8-1f70-4fea-978c-0221430b7aae service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:30.461260 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5f0d8-1f70-4fea-978c-0221430b7aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:30.461813 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c4474-9211-45a7-80b0-81d0eec89339 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:30.474329 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5f0d8-1f70-4fea-978c-0221430b7aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:30.475138 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5f0d8-1f70-4fea-978c-0221430b7aae service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:30.508710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 919/1808] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:30.514185 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 890/1809] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:30 2022] POST /identity/v3/projects => generated 387 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:30.519886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5f0d8-1f70-4fea-978c-0221430b7aae service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:30.539244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5f0d8-1f70-4fea-978c-0221430b7aae service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:30.748789 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c0a3b-3b70-44f0-97fc-ccb99aa34231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:30.750753 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c0a3b-3b70-44f0-97fc-ccb99aa34231 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:30.752198 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c0a3b-3b70-44f0-97fc-ccb99aa34231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:30.752693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c0a3b-3b70-44f0-97fc-ccb99aa34231 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:30.755831 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c0a3b-3b70-44f0-97fc-ccb99aa34231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:30.758887 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c0a3b-3b70-44f0-97fc-ccb99aa34231 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:30.780820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f80eb-88a2-4086-b4b8-eb56099baf9e None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:30.781263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f80eb-88a2-4086-b4b8-eb56099baf9e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:30.781719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f80eb-88a2-4086-b4b8-eb56099baf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:30.791339 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:30.826255 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-ee6f80eb-88a2-4086-b4b8-eb56099baf9e None None] MFA Rules not processed for user `bb90d2315ce54db8820d4943b1a8c53c`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:30.827839 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ee6f80eb-88a2-4086-b4b8-eb56099baf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:30.831998 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 920/1810] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:30 2022] POST /identity/v3/users => generated 294 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:30.835794 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c0a3b-3b70-44f0-97fc-ccb99aa34231 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:30.864732 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c0a3b-3b70-44f0-97fc-ccb99aa34231 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:30.878173 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6afa6-e836-4835-a38f-1906dfcbf613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:30.878929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6afa6-e836-4835-a38f-1906dfcbf613 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:30.879317 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6afa6-e836-4835-a38f-1906dfcbf613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:30.880634 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6afa6-e836-4835-a38f-1906dfcbf613 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:30.881400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6afa6-e836-4835-a38f-1906dfcbf613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:30.883181 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6afa6-e836-4835-a38f-1906dfcbf613 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:30.899519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 921/1811] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:30.908456 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6afa6-e836-4835-a38f-1906dfcbf613 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:30.946132 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6afa6-e836-4835-a38f-1906dfcbf613 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:30.951893 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c672203-fb23-43e2-ac6d-5eb935956927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:30.953067 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c672203-fb23-43e2-ac6d-5eb935956927 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:30.953540 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c672203-fb23-43e2-ac6d-5eb935956927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:30.954084 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c672203-fb23-43e2-ac6d-5eb935956927 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:30.955082 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c672203-fb23-43e2-ac6d-5eb935956927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:30.957435 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c672203-fb23-43e2-ac6d-5eb935956927 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:30.965713 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 891/1812] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:40:30.978584 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 922/1813] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:30.982898 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f80eb-88a2-4086-b4b8-eb56099baf9e None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:30.995938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f80eb-88a2-4086-b4b8-eb56099baf9e None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:31.015121 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260afe1-7b4f-40b4-8f34-4a3d23d8d6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:31.015784 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260afe1-7b4f-40b4-8f34-4a3d23d8d6d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:31.016067 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260afe1-7b4f-40b4-8f34-4a3d23d8d6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:31.016340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260afe1-7b4f-40b4-8f34-4a3d23d8d6d6 admin admin] PATH_INFO: `/v3/projects/ffaf9112ddb7400aafc8144414029290/users/cfd0c64480164c69993c0d71756f03c1/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:31.049998 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260afe1-7b4f-40b4-8f34-4a3d23d8d6d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffaf9112ddb7400aafc8144414029290, user_id=cfd0c64480164c69993c0d71756f03c1, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:31.064727 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260afe1-7b4f-40b4-8f34-4a3d23d8d6d6 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:31.117839 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 892/1814] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:30 2022] PUT /identity/v3/projects/ffaf9112ddb7400aafc8144414029290/users/cfd0c64480164c69993c0d71756f03c1/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:40:31.128114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1492f28-8757-49ba-859f-9662f3de6bb8 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:31.128418 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1492f28-8757-49ba-859f-9662f3de6bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:31.128687 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1492f28-8757-49ba-859f-9662f3de6bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:31.137832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260afe1-7b4f-40b4-8f34-4a3d23d8d6d6 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:31.140034 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d260afe1-7b4f-40b4-8f34-4a3d23d8d6d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:31.193272 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e1492f28-8757-49ba-859f-9662f3de6bb8 None None] MFA Rules not processed for user `cfd0c64480164c69993c0d71756f03c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:31.196967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e1492f28-8757-49ba-859f-9662f3de6bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:31.221451 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:31.305789 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260afe1-7b4f-40b4-8f34-4a3d23d8d6d6 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:31.317248 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30803d-b366-4f68-affb-61ce805d5a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:31.318246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30803d-b366-4f68-affb-61ce805d5a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:31.318541 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30803d-b366-4f68-affb-61ce805d5a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:31.318846 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30803d-b366-4f68-affb-61ce805d5a9c admin admin] PATH_INFO: `/v3/projects/5600144643a6428589899469e8b16cea` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:31.320334 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30803d-b366-4f68-affb-61ce805d5a9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5600144643a6428589899469e8b16cea)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:31.322283 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30803d-b366-4f68-affb-61ce805d5a9c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:31.381246 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 923/1815] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:31.382439 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1492f28-8757-49ba-859f-9662f3de6bb8 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:31.411307 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1492f28-8757-49ba-859f-9662f3de6bb8 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:31.425159 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef41203-fec8-4106-8bb7-616c17a71ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:31.426113 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef41203-fec8-4106-8bb7-616c17a71ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:31.426269 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef41203-fec8-4106-8bb7-616c17a71ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:31.433436 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef41203-fec8-4106-8bb7-616c17a71ea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:31.434961 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef41203-fec8-4106-8bb7-616c17a71ea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:31.436935 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef41203-fec8-4106-8bb7-616c17a71ea2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:31.465627 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4f30803d-b366-4f68-affb-61ce805d5a9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5600144643a6428589899469e8b16cea', 'request_id': 'req-4f30803d-b366-4f68-affb-61ce805d5a9c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:31.474919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4f30803d-b366-4f68-affb-61ce805d5a9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5600144643a6428589899469e8b16cea', 'request_id': 'req-4f30803d-b366-4f68-affb-61ce805d5a9c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:31.498764 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4f30803d-b366-4f68-affb-61ce805d5a9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5600144643a6428589899469e8b16cea', 'request_id': 'req-4f30803d-b366-4f68-affb-61ce805d5a9c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:31.503333 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 924/1816] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:31 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:31.507459 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef41203-fec8-4106-8bb7-616c17a71ea2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:31.548994 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4f30803d-b366-4f68-affb-61ce805d5a9c admin admin] The token cache is being invalidate because project 5600144643a6428589899469e8b16cea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:31.549883 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4f30803d-b366-4f68-affb-61ce805d5a9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:31.551121 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4f30803d-b366-4f68-affb-61ce805d5a9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:31.566918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 893/1817] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:31 2022] DELETE /identity/v3/projects/5600144643a6428589899469e8b16cea => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:31.570927 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30803d-b366-4f68-affb-61ce805d5a9c admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:31.573508 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4f30803d-b366-4f68-affb-61ce805d5a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:31.598393 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:31.655751 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef41203-fec8-4106-8bb7-616c17a71ea2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:31.669088 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e67b5-eef4-47a5-8e1e-9591a5c4caf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:31.670087 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e67b5-eef4-47a5-8e1e-9591a5c4caf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:31.670726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e67b5-eef4-47a5-8e1e-9591a5c4caf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:31.671171 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e67b5-eef4-47a5-8e1e-9591a5c4caf5 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:31.672576 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e67b5-eef4-47a5-8e1e-9591a5c4caf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:31.674942 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e67b5-eef4-47a5-8e1e-9591a5c4caf5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:31.704257 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30803d-b366-4f68-affb-61ce805d5a9c admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:31.711728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 925/1818] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:31 2022] POST /identity/v3/users => generated 299 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:31.711951 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432fc47-85e2-4b62-a15f-97cf027676a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:31.712998 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432fc47-85e2-4b62-a15f-97cf027676a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:31.713284 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432fc47-85e2-4b62-a15f-97cf027676a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:31.713562 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432fc47-85e2-4b62-a15f-97cf027676a2 admin admin] PATH_INFO: `/v3/users/fbad21a088a64b509a7698be55809845` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:31.714876 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432fc47-85e2-4b62-a15f-97cf027676a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbad21a088a64b509a7698be55809845)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:31.716510 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e67b5-eef4-47a5-8e1e-9591a5c4caf5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:31.717037 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432fc47-85e2-4b62-a15f-97cf027676a2 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:31.719931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d41e67b5-eef4-47a5-8e1e-9591a5c4caf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:31.740149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e67b5-eef4-47a5-8e1e-9591a5c4caf5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:31.748398 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2fff6-e323-4201-ae2a-fd0c15feafd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:31.750170 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2fff6-e323-4201-ae2a-fd0c15feafd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:31.751616 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2fff6-e323-4201-ae2a-fd0c15feafd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:31.752880 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2fff6-e323-4201-ae2a-fd0c15feafd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:31.753792 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2fff6-e323-4201-ae2a-fd0c15feafd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:31.756103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2fff6-e323-4201-ae2a-fd0c15feafd3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:31.772048 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 926/1819] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:31.778767 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2fff6-e323-4201-ae2a-fd0c15feafd3 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:31.793516 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5432fc47-85e2-4b62-a15f-97cf027676a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbad21a088a64b509a7698be55809845'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:31.804016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5432fc47-85e2-4b62-a15f-97cf027676a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbad21a088a64b509a7698be55809845'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:31.804921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5432fc47-85e2-4b62-a15f-97cf027676a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbad21a088a64b509a7698be55809845'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:31.809997 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2fff6-e323-4201-ae2a-fd0c15feafd3 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:31.816206 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5432fc47-85e2-4b62-a15f-97cf027676a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbad21a088a64b509a7698be55809845'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:31.818711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e6c17-bc0c-463d-92af-26820ba04cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:31.820240 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e6c17-bc0c-463d-92af-26820ba04cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:31.820780 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e6c17-bc0c-463d-92af-26820ba04cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:31.821473 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e6c17-bc0c-463d-92af-26820ba04cd1 admin admin] PATH_INFO: `/v3/projects/a1ac4a23108646bbaa3b8e2495d1ba43/users/19382533ba454473b8453e6ffa680ee4/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:31.850399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5432fc47-85e2-4b62-a15f-97cf027676a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbad21a088a64b509a7698be55809845'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:31.855325 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e6c17-bc0c-463d-92af-26820ba04cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1ac4a23108646bbaa3b8e2495d1ba43, user_id=19382533ba454473b8453e6ffa680ee4, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:31.863847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e6c17-bc0c-463d-92af-26820ba04cd1 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:31.872824 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 894/1820] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:31 2022] DELETE /identity/v3/users/fbad21a088a64b509a7698be55809845 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:31.890447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 927/1821] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:31 2022] PUT /identity/v3/projects/a1ac4a23108646bbaa3b8e2495d1ba43/users/19382533ba454473b8453e6ffa680ee4/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:31.895373 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432fc47-85e2-4b62-a15f-97cf027676a2 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:31.897356 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5432fc47-85e2-4b62-a15f-97cf027676a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:32.014661 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432fc47-85e2-4b62-a15f-97cf027676a2 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:32.061374 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:32.083280 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64e06b-8cbf-49d6-813b-278259e36858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:32.084240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64e06b-8cbf-49d6-813b-278259e36858 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:32.084523 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64e06b-8cbf-49d6-813b-278259e36858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:32.084800 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64e06b-8cbf-49d6-813b-278259e36858 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:32.085568 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64e06b-8cbf-49d6-813b-278259e36858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:32.087610 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64e06b-8cbf-49d6-813b-278259e36858 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:32.103850 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 895/1822] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:40:32.105250 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e6c17-bc0c-463d-92af-26820ba04cd1 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:32.120192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e6c17-bc0c-463d-92af-26820ba04cd1 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:32.126401 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bd392-b179-4b5a-8a38-cfbb725a3b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:32.127637 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bd392-b179-4b5a-8a38-cfbb725a3b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:32.127917 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bd392-b179-4b5a-8a38-cfbb725a3b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:32.128192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bd392-b179-4b5a-8a38-cfbb725a3b90 admin admin] PATH_INFO: `/v3/projects/a1ac4a23108646bbaa3b8e2495d1ba43/users/19382533ba454473b8453e6ffa680ee4/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:32.130868 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bd392-b179-4b5a-8a38-cfbb725a3b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1ac4a23108646bbaa3b8e2495d1ba43, user_id=19382533ba454473b8453e6ffa680ee4, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:32.133583 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bd392-b179-4b5a-8a38-cfbb725a3b90 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:32.153405 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 928/1823] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:32 2022] PUT /identity/v3/projects/a1ac4a23108646bbaa3b8e2495d1ba43/users/19382533ba454473b8453e6ffa680ee4/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:40:32.164280 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc564d2-b8a3-429f-82f6-631ea0f70a8b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:32.164454 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc564d2-b8a3-429f-82f6-631ea0f70a8b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:32.164738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc564d2-b8a3-429f-82f6-631ea0f70a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:32.196927 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-ffc564d2-b8a3-429f-82f6-631ea0f70a8b None None] MFA Rules not processed for user `19382533ba454473b8453e6ffa680ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:32.198318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ffc564d2-b8a3-429f-82f6-631ea0f70a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:32.309995 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bd392-b179-4b5a-8a38-cfbb725a3b90 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:32.312746 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d82bd392-b179-4b5a-8a38-cfbb725a3b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:32.342512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 896/1824] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:32.362379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc564d2-b8a3-429f-82f6-631ea0f70a8b None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:32.376124 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ffc564d2-b8a3-429f-82f6-631ea0f70a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:32.452616 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:32.521449 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc564d2-b8a3-429f-82f6-631ea0f70a8b None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:32.527707 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3a9c9-c3aa-4038-8093-f88dee2a2ede service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:32.528417 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3a9c9-c3aa-4038-8093-f88dee2a2ede service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:32.528697 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3a9c9-c3aa-4038-8093-f88dee2a2ede service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:32.528967 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3a9c9-c3aa-4038-8093-f88dee2a2ede service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:32.530196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bd392-b179-4b5a-8a38-cfbb725a3b90 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:32.535266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b9387-c1f7-4126-b330-069150c68dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:32.537222 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b9387-c1f7-4126-b330-069150c68dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:32.537649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b9387-c1f7-4126-b330-069150c68dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:32.538055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b9387-c1f7-4126-b330-069150c68dd8 admin admin] PATH_INFO: `/v3/projects/3fe506c307034c198e52c5aaa38ce837` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:32.540027 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b9387-c1f7-4126-b330-069150c68dd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fe506c307034c198e52c5aaa38ce837)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:32.542494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b9387-c1f7-4126-b330-069150c68dd8 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:32.542633 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3a9c9-c3aa-4038-8093-f88dee2a2ede service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:32.544174 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3a9c9-c3aa-4038-8093-f88dee2a2ede service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:32.560868 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 897/1825] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:32.561718 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3a9c9-c3aa-4038-8093-f88dee2a2ede service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:32.563675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-02f3a9c9-c3aa-4038-8093-f88dee2a2ede service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:32.679590 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-990b9387-c1f7-4126-b330-069150c68dd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fe506c307034c198e52c5aaa38ce837', 'request_id': 'req-990b9387-c1f7-4126-b330-069150c68dd8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:32.697365 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:32.699552 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-990b9387-c1f7-4126-b330-069150c68dd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fe506c307034c198e52c5aaa38ce837', 'request_id': 'req-990b9387-c1f7-4126-b330-069150c68dd8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:32.709803 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3a9c9-c3aa-4038-8093-f88dee2a2ede service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:32.711193 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-990b9387-c1f7-4126-b330-069150c68dd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fe506c307034c198e52c5aaa38ce837', 'request_id': 'req-990b9387-c1f7-4126-b330-069150c68dd8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:32.736441 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-990b9387-c1f7-4126-b330-069150c68dd8 admin admin] The token cache is being invalidate because project 3fe506c307034c198e52c5aaa38ce837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:32.737105 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-990b9387-c1f7-4126-b330-069150c68dd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:32.737879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-990b9387-c1f7-4126-b330-069150c68dd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:32.740621 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 929/1826] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:32 2022] DELETE /identity/v3/projects/3fe506c307034c198e52c5aaa38ce837 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:32.741976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b9387-c1f7-4126-b330-069150c68dd8 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:32.745342 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-990b9387-c1f7-4126-b330-069150c68dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:32.852160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d86f77-00e7-4f6c-96dd-db4774d715eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:32.855391 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d86f77-00e7-4f6c-96dd-db4774d715eb service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:32.855821 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d86f77-00e7-4f6c-96dd-db4774d715eb service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:32.856211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d86f77-00e7-4f6c-96dd-db4774d715eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:32.859180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d2d86f77-00e7-4f6c-96dd-db4774d715eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:32.880271 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d86f77-00e7-4f6c-96dd-db4774d715eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:32.882252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d86f77-00e7-4f6c-96dd-db4774d715eb service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:32.886366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b9387-c1f7-4126-b330-069150c68dd8 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:32.899705 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd868a-b930-42b2-b213-337e831e655e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:32.900554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd868a-b930-42b2-b213-337e831e655e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:32.900825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd868a-b930-42b2-b213-337e831e655e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:32.901638 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd868a-b930-42b2-b213-337e831e655e admin admin] PATH_INFO: `/v3/users/cfd0c64480164c69993c0d71756f03c1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:32.904098 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd868a-b930-42b2-b213-337e831e655e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfd0c64480164c69993c0d71756f03c1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:32.907582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd868a-b930-42b2-b213-337e831e655e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:32.919134 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 898/1827] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:32.923188 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad73105-d2ae-4a4a-9cb9-3da674889175 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:32.923495 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad73105-d2ae-4a4a-9cb9-3da674889175 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:32.923754 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad73105-d2ae-4a4a-9cb9-3da674889175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:32.966004 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-3ad73105-d2ae-4a4a-9cb9-3da674889175 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:32.967466 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3ad73105-d2ae-4a4a-9cb9-3da674889175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:32.994918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 899/1828] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:33.004023 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49557519-7d1b-4896-bd0a-8ed221d9c7c4 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:33.004204 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49557519-7d1b-4896-bd0a-8ed221d9c7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:33.004450 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49557519-7d1b-4896-bd0a-8ed221d9c7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:33.015138 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-62cd868a-b930-42b2-b213-337e831e655e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfd0c64480164c69993c0d71756f03c1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:33.030177 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-62cd868a-b930-42b2-b213-337e831e655e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfd0c64480164c69993c0d71756f03c1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:33.031398 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-62cd868a-b930-42b2-b213-337e831e655e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfd0c64480164c69993c0d71756f03c1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:33.042886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:33.044823 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-49557519-7d1b-4896-bd0a-8ed221d9c7c4 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:33.048690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-49557519-7d1b-4896-bd0a-8ed221d9c7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:33.057167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-62cd868a-b930-42b2-b213-337e831e655e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfd0c64480164c69993c0d71756f03c1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:33.058315 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-62cd868a-b930-42b2-b213-337e831e655e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfd0c64480164c69993c0d71756f03c1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:33.090768 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 900/1829] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:40:33.095564 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49557519-7d1b-4896-bd0a-8ed221d9c7c4 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:33.109534 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 930/1830] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:32 2022] DELETE /identity/v3/users/cfd0c64480164c69993c0d71756f03c1 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:33.118495 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d60454-a0c6-4c99-a9f5-ff80ce8e4d00 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:33.118959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d60454-a0c6-4c99-a9f5-ff80ce8e4d00 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:33.119591 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d60454-a0c6-4c99-a9f5-ff80ce8e4d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:33.123589 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49557519-7d1b-4896-bd0a-8ed221d9c7c4 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:33.217161 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a8d60454-a0c6-4c99-a9f5-ff80ce8e4d00 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:33.223357 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a8d60454-a0c6-4c99-a9f5-ff80ce8e4d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:33.335846 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a368e-ce21-4546-9629-c2bf50a88d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:33.336733 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a368e-ce21-4546-9629-c2bf50a88d8c admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:33.336964 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a368e-ce21-4546-9629-c2bf50a88d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:33.337239 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a368e-ce21-4546-9629-c2bf50a88d8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:33.337979 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a368e-ce21-4546-9629-c2bf50a88d8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:40:33.338281 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a368e-ce21-4546-9629-c2bf50a88d8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:33.340788 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a368e-ce21-4546-9629-c2bf50a88d8c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:33.380232 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 901/1831] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:40:33.386019 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a368e-ce21-4546-9629-c2bf50a88d8c admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:33.418761 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a368e-ce21-4546-9629-c2bf50a88d8c admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:33.426503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 931/1832] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:33.435948 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce8d66-95d2-4444-90a9-6d964d962b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:33.436806 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce8d66-95d2-4444-90a9-6d964d962b0b admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:33.437104 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce8d66-95d2-4444-90a9-6d964d962b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:33.437365 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce8d66-95d2-4444-90a9-6d964d962b0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:33.438304 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce8d66-95d2-4444-90a9-6d964d962b0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:33.440338 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce8d66-95d2-4444-90a9-6d964d962b0b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:33.527973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 902/1833] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:33 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:33.528606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d60454-a0c6-4c99-a9f5-ff80ce8e4d00 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:33.548750 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d60454-a0c6-4c99-a9f5-ff80ce8e4d00 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:33.582417 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce8d66-95d2-4444-90a9-6d964d962b0b admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:33.584221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-18ce8d66-95d2-4444-90a9-6d964d962b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:33.689316 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223af82b-2bad-4f61-b9ea-8fb12405768a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:33.691862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223af82b-2bad-4f61-b9ea-8fb12405768a admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:33.692982 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223af82b-2bad-4f61-b9ea-8fb12405768a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:33.693266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223af82b-2bad-4f61-b9ea-8fb12405768a admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:33.695369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223af82b-2bad-4f61-b9ea-8fb12405768a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:33.700270 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223af82b-2bad-4f61-b9ea-8fb12405768a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:33.730023 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:33.748707 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 932/1834] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:33 2022] POST /identity/v3/users => generated 291 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:33.752375 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223af82b-2bad-4f61-b9ea-8fb12405768a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:33.756807 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce8d66-95d2-4444-90a9-6d964d962b0b admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:33.761773 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdf6fe-d1d3-4ffe-bd0d-b50c40ee6fad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:33.762544 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdf6fe-d1d3-4ffe-bd0d-b50c40ee6fad service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:33.762854 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdf6fe-d1d3-4ffe-bd0d-b50c40ee6fad service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:33.763170 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdf6fe-d1d3-4ffe-bd0d-b50c40ee6fad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:33.778334 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223af82b-2bad-4f61-b9ea-8fb12405768a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:33.789573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fdf6fe-d1d3-4ffe-bd0d-b50c40ee6fad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:33.792873 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb7c00-8c6b-4055-a9bf-2adc8341e5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:33.793577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb7c00-8c6b-4055-a9bf-2adc8341e5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:33.793857 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb7c00-8c6b-4055-a9bf-2adc8341e5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:33.794124 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb7c00-8c6b-4055-a9bf-2adc8341e5b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:33.795470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fdf6fe-d1d3-4ffe-bd0d-b50c40ee6fad service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:33.799141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb7c00-8c6b-4055-a9bf-2adc8341e5b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:33.800771 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb7c00-8c6b-4055-a9bf-2adc8341e5b0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:33.829948 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 903/1835] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:40:33.834615 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 933/1836] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:40:33.838754 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdf6fe-d1d3-4ffe-bd0d-b50c40ee6fad service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:33.852789 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdf6fe-d1d3-4ffe-bd0d-b50c40ee6fad service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:33.859619 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6255f7-8786-4275-9f0e-5ab836a9f08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:33.860508 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6255f7-8786-4275-9f0e-5ab836a9f08e admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:33.861133 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6255f7-8786-4275-9f0e-5ab836a9f08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:33.861572 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6255f7-8786-4275-9f0e-5ab836a9f08e admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:33.862605 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6255f7-8786-4275-9f0e-5ab836a9f08e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:33.865371 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6255f7-8786-4275-9f0e-5ab836a9f08e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:33.877882 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 904/1837] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:33.882953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb7c00-8c6b-4055-a9bf-2adc8341e5b0 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:33.900728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb7c00-8c6b-4055-a9bf-2adc8341e5b0 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:33.907063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb3fc5-57e7-4a13-b9e4-14bb5dde4aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:33.908706 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb3fc5-57e7-4a13-b9e4-14bb5dde4aea admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:33.909000 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb3fc5-57e7-4a13-b9e4-14bb5dde4aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:33.909297 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb3fc5-57e7-4a13-b9e4-14bb5dde4aea admin admin] PATH_INFO: `/v3/projects/a0a9b363254c4cc2bd038f5f24d6f9f1/users/775df0202dc14077a9c8587c2bf0e52e/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:33.928149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb3fc5-57e7-4a13-b9e4-14bb5dde4aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0a9b363254c4cc2bd038f5f24d6f9f1, user_id=775df0202dc14077a9c8587c2bf0e52e, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:33.932565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb3fc5-57e7-4a13-b9e4-14bb5dde4aea admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:33.972058 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 934/1838] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:33 2022] PUT /identity/v3/projects/a0a9b363254c4cc2bd038f5f24d6f9f1/users/775df0202dc14077a9c8587c2bf0e52e/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:40:33.974818 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04d921-6432-4a6f-af57-4d43757cb3b9 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:33.975300 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04d921-6432-4a6f-af57-4d43757cb3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:33.975642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04d921-6432-4a6f-af57-4d43757cb3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:34.011566 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-aa04d921-6432-4a6f-af57-4d43757cb3b9 None None] MFA Rules not processed for user `775df0202dc14077a9c8587c2bf0e52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:34.012853 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-aa04d921-6432-4a6f-af57-4d43757cb3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:34.124155 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 905/1839] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:34.128777 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb3fc5-57e7-4a13-b9e4-14bb5dde4aea admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:34.175451 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:34.211145 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb3fc5-57e7-4a13-b9e4-14bb5dde4aea admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:34.216808 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef28bc-16e9-45d5-b845-1ec36d20771c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:34.217582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef28bc-16e9-45d5-b845-1ec36d20771c admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:34.217868 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef28bc-16e9-45d5-b845-1ec36d20771c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:34.218177 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef28bc-16e9-45d5-b845-1ec36d20771c admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:34.218927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef28bc-16e9-45d5-b845-1ec36d20771c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:34.220887 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef28bc-16e9-45d5-b845-1ec36d20771c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:34.257287 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 935/1840] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:34 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:40:34.261630 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04d921-6432-4a6f-af57-4d43757cb3b9 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:34.274704 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04d921-6432-4a6f-af57-4d43757cb3b9 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:34.343394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37582520-0e2b-48c6-96ea-42c9f7c4ffba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:34.344217 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37582520-0e2b-48c6-96ea-42c9f7c4ffba admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:34.344584 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37582520-0e2b-48c6-96ea-42c9f7c4ffba admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:34.344878 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37582520-0e2b-48c6-96ea-42c9f7c4ffba admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:34.345581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37582520-0e2b-48c6-96ea-42c9f7c4ffba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:34.347568 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37582520-0e2b-48c6-96ea-42c9f7c4ffba admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:34.371759 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 906/1841] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:34 2022] POST /identity/v3/users => generated 297 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:34.375619 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef28bc-16e9-45d5-b845-1ec36d20771c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:34.386538 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef28bc-16e9-45d5-b845-1ec36d20771c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:34.393993 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27caaadb-23ee-4a0c-a9c9-9b10ed7deef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:34.395315 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caaadb-23ee-4a0c-a9c9-9b10ed7deef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:34.395676 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caaadb-23ee-4a0c-a9c9-9b10ed7deef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:34.396019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caaadb-23ee-4a0c-a9c9-9b10ed7deef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:34.396918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27caaadb-23ee-4a0c-a9c9-9b10ed7deef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:34.398781 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27caaadb-23ee-4a0c-a9c9-9b10ed7deef1 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:34.414476 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 936/1842] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:34.416379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37582520-0e2b-48c6-96ea-42c9f7c4ffba admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:34.427909 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37582520-0e2b-48c6-96ea-42c9f7c4ffba admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:34.436807 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54038e-c632-4ae6-a981-308caf530c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:34.437852 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54038e-c632-4ae6-a981-308caf530c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:34.438146 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54038e-c632-4ae6-a981-308caf530c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:34.438416 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54038e-c632-4ae6-a981-308caf530c58 admin admin] PATH_INFO: `/v3/projects/4a17bfacdcad4636965b3607d666fd24/users/a9f1527b79164909a420da16e8f6d505/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:34.460196 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54038e-c632-4ae6-a981-308caf530c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a17bfacdcad4636965b3607d666fd24, user_id=a9f1527b79164909a420da16e8f6d505, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:34.463107 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54038e-c632-4ae6-a981-308caf530c58 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:34.493877 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 907/1843] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:34 2022] PUT /identity/v3/projects/4a17bfacdcad4636965b3607d666fd24/users/a9f1527b79164909a420da16e8f6d505/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:40:34.498998 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27caaadb-23ee-4a0c-a9c9-9b10ed7deef1 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:34.512343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27caaadb-23ee-4a0c-a9c9-9b10ed7deef1 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:34.580689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c02c2-0a35-4647-84fc-4cefb62bbae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:34.581586 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c02c2-0a35-4647-84fc-4cefb62bbae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:34.581871 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c02c2-0a35-4647-84fc-4cefb62bbae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:34.582148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c02c2-0a35-4647-84fc-4cefb62bbae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:34.582978 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c02c2-0a35-4647-84fc-4cefb62bbae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:34.584601 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c02c2-0a35-4647-84fc-4cefb62bbae7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:34.600193 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 937/1844] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:34.600869 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54038e-c632-4ae6-a981-308caf530c58 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:34.615260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54038e-c632-4ae6-a981-308caf530c58 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:34.620616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa76441-8cce-429e-aa27-bfe5cc720743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:34.621738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa76441-8cce-429e-aa27-bfe5cc720743 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:34.622141 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa76441-8cce-429e-aa27-bfe5cc720743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:34.623000 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa76441-8cce-429e-aa27-bfe5cc720743 admin admin] PATH_INFO: `/v3/projects/4a17bfacdcad4636965b3607d666fd24/users/a9f1527b79164909a420da16e8f6d505/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:34.628406 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa76441-8cce-429e-aa27-bfe5cc720743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a17bfacdcad4636965b3607d666fd24, user_id=a9f1527b79164909a420da16e8f6d505, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:34.632610 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa76441-8cce-429e-aa27-bfe5cc720743 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:34.652964 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 908/1845] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:34 2022] PUT /identity/v3/projects/4a17bfacdcad4636965b3607d666fd24/users/a9f1527b79164909a420da16e8f6d505/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:40:34.663042 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7cf39-98b9-4714-9575-614d8d8ec3f3 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:34.663508 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7cf39-98b9-4714-9575-614d8d8ec3f3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:34.663788 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7cf39-98b9-4714-9575-614d8d8ec3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:34.695148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-76d7cf39-98b9-4714-9575-614d8d8ec3f3 None None] MFA Rules not processed for user `a9f1527b79164909a420da16e8f6d505`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:34.696386 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-76d7cf39-98b9-4714-9575-614d8d8ec3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:34.771436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa76441-8cce-429e-aa27-bfe5cc720743 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:34.773217 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3aa76441-8cce-429e-aa27-bfe5cc720743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:34.820796 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:34.888225 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 938/1846] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:34.907036 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7cf39-98b9-4714-9575-614d8d8ec3f3 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:34.909653 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-76d7cf39-98b9-4714-9575-614d8d8ec3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:34.921191 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa76441-8cce-429e-aa27-bfe5cc720743 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:34.937955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2d62c-7ff6-44d0-a710-8f642ac1f68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:34.939597 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2d62c-7ff6-44d0-a710-8f642ac1f68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:34.939880 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2d62c-7ff6-44d0-a710-8f642ac1f68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:34.940152 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2d62c-7ff6-44d0-a710-8f642ac1f68a admin admin] PATH_INFO: `/v3/projects/ffaf9112ddb7400aafc8144414029290` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:34.945107 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f2d62c-7ff6-44d0-a710-8f642ac1f68a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffaf9112ddb7400aafc8144414029290)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:34.952865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f2d62c-7ff6-44d0-a710-8f642ac1f68a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:34.966520 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:35.000243 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7cf39-98b9-4714-9575-614d8d8ec3f3 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:35.004247 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc9b8c-92bf-4c94-a4a4-4da1c5053582 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:35.005201 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc9b8c-92bf-4c94-a4a4-4da1c5053582 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:35.005634 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc9b8c-92bf-4c94-a4a4-4da1c5053582 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:35.006203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc9b8c-92bf-4c94-a4a4-4da1c5053582 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:35.022361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc9b8c-92bf-4c94-a4a4-4da1c5053582 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:35.024067 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc9b8c-92bf-4c94-a4a4-4da1c5053582 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:35.047774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 939/1847] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:35.073452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-14f2d62c-7ff6-44d0-a710-8f642ac1f68a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffaf9112ddb7400aafc8144414029290', 'request_id': 'req-14f2d62c-7ff6-44d0-a710-8f642ac1f68a'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:35.095941 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-14f2d62c-7ff6-44d0-a710-8f642ac1f68a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffaf9112ddb7400aafc8144414029290', 'request_id': 'req-14f2d62c-7ff6-44d0-a710-8f642ac1f68a'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:35.123465 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-14f2d62c-7ff6-44d0-a710-8f642ac1f68a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffaf9112ddb7400aafc8144414029290', 'request_id': 'req-14f2d62c-7ff6-44d0-a710-8f642ac1f68a'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:35.173462 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-14f2d62c-7ff6-44d0-a710-8f642ac1f68a admin admin] The token cache is being invalidate because project ffaf9112ddb7400aafc8144414029290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:35.173810 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-14f2d62c-7ff6-44d0-a710-8f642ac1f68a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:35.177996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-14f2d62c-7ff6-44d0-a710-8f642ac1f68a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:35.184685 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 909/1848] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:34 2022] DELETE /identity/v3/projects/ffaf9112ddb7400aafc8144414029290 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:40:35.188472 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc9b8c-92bf-4c94-a4a4-4da1c5053582 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:35.209132 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc9b8c-92bf-4c94-a4a4-4da1c5053582 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:35.439648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53824ef7-0357-4d38-b6db-7d9390d73106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:35.441049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53824ef7-0357-4d38-b6db-7d9390d73106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:35.444160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53824ef7-0357-4d38-b6db-7d9390d73106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:35.444556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53824ef7-0357-4d38-b6db-7d9390d73106 admin admin] PATH_INFO: `/v3/users/19382533ba454473b8453e6ffa680ee4` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:35.447592 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53824ef7-0357-4d38-b6db-7d9390d73106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19382533ba454473b8453e6ffa680ee4)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:35.451993 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53824ef7-0357-4d38-b6db-7d9390d73106 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:35.571260 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-53824ef7-0357-4d38-b6db-7d9390d73106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19382533ba454473b8453e6ffa680ee4'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:35.591103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-53824ef7-0357-4d38-b6db-7d9390d73106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19382533ba454473b8453e6ffa680ee4'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:35.592057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-53824ef7-0357-4d38-b6db-7d9390d73106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19382533ba454473b8453e6ffa680ee4'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:35.622189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-53824ef7-0357-4d38-b6db-7d9390d73106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19382533ba454473b8453e6ffa680ee4'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:35.623696 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-53824ef7-0357-4d38-b6db-7d9390d73106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19382533ba454473b8453e6ffa680ee4'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:35.674023 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 940/1849] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:35 2022] DELETE /identity/v3/users/19382533ba454473b8453e6ffa680ee4 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:35.866776 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2d62c-7ff6-44d0-a710-8f642ac1f68a admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:35.868586 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-14f2d62c-7ff6-44d0-a710-8f642ac1f68a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:35.883673 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2d62c-7ff6-44d0-a710-8f642ac1f68a admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:35.967151 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a63ae-0387-4d58-85e2-e999b1e47980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:35.967894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a63ae-0387-4d58-85e2-e999b1e47980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:35.968180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a63ae-0387-4d58-85e2-e999b1e47980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:35.968819 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a63ae-0387-4d58-85e2-e999b1e47980 admin admin] PATH_INFO: `/v3/users/775df0202dc14077a9c8587c2bf0e52e` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:35.973010 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a63ae-0387-4d58-85e2-e999b1e47980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=775df0202dc14077a9c8587c2bf0e52e)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:35.975587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a63ae-0387-4d58-85e2-e999b1e47980 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:36.059938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f86a63ae-0387-4d58-85e2-e999b1e47980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '775df0202dc14077a9c8587c2bf0e52e'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:36.068907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:36.074711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f86a63ae-0387-4d58-85e2-e999b1e47980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '775df0202dc14077a9c8587c2bf0e52e'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:36.076028 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f86a63ae-0387-4d58-85e2-e999b1e47980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '775df0202dc14077a9c8587c2bf0e52e'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:36.090789 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f86a63ae-0387-4d58-85e2-e999b1e47980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '775df0202dc14077a9c8587c2bf0e52e'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:36.107540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f86a63ae-0387-4d58-85e2-e999b1e47980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '775df0202dc14077a9c8587c2bf0e52e'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:36.115702 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 910/1850] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:35 2022] DELETE /identity/v3/users/775df0202dc14077a9c8587c2bf0e52e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:36.119687 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fe840-36ca-48b1-9dee-7d885be1c95f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:36.123009 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fe840-36ca-48b1-9dee-7d885be1c95f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:36.128956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fe840-36ca-48b1-9dee-7d885be1c95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:36.156615 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-9b8fe840-36ca-48b1-9dee-7d885be1c95f None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:36.157976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9b8fe840-36ca-48b1-9dee-7d885be1c95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:36.210808 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:36.229702 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 941/1851] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:36.238836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a63ae-0387-4d58-85e2-e999b1e47980 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:36.240857 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f86a63ae-0387-4d58-85e2-e999b1e47980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:36.373592 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a63ae-0387-4d58-85e2-e999b1e47980 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:36.382144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1611e-05d5-4cd0-a23e-c5c03402d5c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:36.382869 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1611e-05d5-4cd0-a23e-c5c03402d5c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:36.386132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1611e-05d5-4cd0-a23e-c5c03402d5c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:36.386417 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1611e-05d5-4cd0-a23e-c5c03402d5c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:36.422046 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1611e-05d5-4cd0-a23e-c5c03402d5c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:36.423985 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1611e-05d5-4cd0-a23e-c5c03402d5c6 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:36.436779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 911/1852] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:36.784408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fe840-36ca-48b1-9dee-7d885be1c95f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:36.786278 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9b8fe840-36ca-48b1-9dee-7d885be1c95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:36.800927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fe840-36ca-48b1-9dee-7d885be1c95f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:36.809471 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa876b7-9a0b-468e-9637-dba729f34433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:36.812264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa876b7-9a0b-468e-9637-dba729f34433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:36.812554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa876b7-9a0b-468e-9637-dba729f34433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:36.812833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa876b7-9a0b-468e-9637-dba729f34433 admin admin] PATH_INFO: `/v3/projects/a1ac4a23108646bbaa3b8e2495d1ba43` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:36.815440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa876b7-9a0b-468e-9637-dba729f34433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1ac4a23108646bbaa3b8e2495d1ba43)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:36.817857 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa876b7-9a0b-468e-9637-dba729f34433 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:36.940263 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-afa876b7-9a0b-468e-9637-dba729f34433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1ac4a23108646bbaa3b8e2495d1ba43', 'request_id': 'req-afa876b7-9a0b-468e-9637-dba729f34433'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:36.952221 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-afa876b7-9a0b-468e-9637-dba729f34433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1ac4a23108646bbaa3b8e2495d1ba43', 'request_id': 'req-afa876b7-9a0b-468e-9637-dba729f34433'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:36.961548 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-afa876b7-9a0b-468e-9637-dba729f34433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1ac4a23108646bbaa3b8e2495d1ba43', 'request_id': 'req-afa876b7-9a0b-468e-9637-dba729f34433'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:36.983177 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-afa876b7-9a0b-468e-9637-dba729f34433 admin admin] The token cache is being invalidate because project a1ac4a23108646bbaa3b8e2495d1ba43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:36.983531 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-afa876b7-9a0b-468e-9637-dba729f34433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:36.984436 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-afa876b7-9a0b-468e-9637-dba729f34433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:36.990290 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 942/1853] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:36 2022] DELETE /identity/v3/projects/a1ac4a23108646bbaa3b8e2495d1ba43 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:36.991409 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69e7b1-f517-4795-9912-c9a39c4527b0 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:36.991929 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69e7b1-f517-4795-9912-c9a39c4527b0 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:36.992005 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69e7b1-f517-4795-9912-c9a39c4527b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:37.042797 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-ce69e7b1-f517-4795-9912-c9a39c4527b0 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:37.047635 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ce69e7b1-f517-4795-9912-c9a39c4527b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:37.175926 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 912/1854] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:37.185312 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6914be1-d9e6-45fb-924d-5bb1d14556b4 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:37.185904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6914be1-d9e6-45fb-924d-5bb1d14556b4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:37.185904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6914be1-d9e6-45fb-924d-5bb1d14556b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:37.215217 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e6914be1-d9e6-45fb-924d-5bb1d14556b4 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:37.218230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e6914be1-d9e6-45fb-924d-5bb1d14556b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:37.243311 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 943/1855] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:37.247946 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69e7b1-f517-4795-9912-c9a39c4527b0 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:37.275078 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69e7b1-f517-4795-9912-c9a39c4527b0 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:37.282228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ec8e8-9635-4d97-a28b-3f42a13e750a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:37.283222 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ec8e8-9635-4d97-a28b-3f42a13e750a admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:37.283641 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ec8e8-9635-4d97-a28b-3f42a13e750a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:37.284049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ec8e8-9635-4d97-a28b-3f42a13e750a admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:37.285092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ec8e8-9635-4d97-a28b-3f42a13e750a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:40:37.285823 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ec8e8-9635-4d97-a28b-3f42a13e750a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:37.288162 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ec8e8-9635-4d97-a28b-3f42a13e750a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:37.323085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 913/1856] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:40:37.325132 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6914be1-d9e6-45fb-924d-5bb1d14556b4 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:37.340312 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6914be1-d9e6-45fb-924d-5bb1d14556b4 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:37.353709 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f4efb-bc39-4fd3-b732-f9fff6635ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:37.354540 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f4efb-bc39-4fd3-b732-f9fff6635ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:37.354852 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f4efb-bc39-4fd3-b732-f9fff6635ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:37.355124 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f4efb-bc39-4fd3-b732-f9fff6635ef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:37.355829 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f4efb-bc39-4fd3-b732-f9fff6635ef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:37.360839 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f4efb-bc39-4fd3-b732-f9fff6635ef5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:37.362226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ec8e8-9635-4d97-a28b-3f42a13e750a admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:37.365118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-398ec8e8-9635-4d97-a28b-3f42a13e750a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:37.386185 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ec8e8-9635-4d97-a28b-3f42a13e750a admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:37.400699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 944/1857] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:37 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:37.402785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f4efb-bc39-4fd3-b732-f9fff6635ef5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:37.403926 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed052322-ed44-43e8-afdf-fa8747a3262f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:37.404442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed052322-ed44-43e8-afdf-fa8747a3262f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:37.404730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed052322-ed44-43e8-afdf-fa8747a3262f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:37.405043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed052322-ed44-43e8-afdf-fa8747a3262f admin admin] PATH_INFO: `/v3/projects/a0a9b363254c4cc2bd038f5f24d6f9f1` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:37.414643 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed052322-ed44-43e8-afdf-fa8747a3262f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0a9b363254c4cc2bd038f5f24d6f9f1)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:37.417003 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed052322-ed44-43e8-afdf-fa8747a3262f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:37.500583 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f4efb-bc39-4fd3-b732-f9fff6635ef5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:37.508282 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94babf7a-c106-4dba-ac31-f5935509a1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:37.509301 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94babf7a-c106-4dba-ac31-f5935509a1c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:37.509824 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94babf7a-c106-4dba-ac31-f5935509a1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:37.510072 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94babf7a-c106-4dba-ac31-f5935509a1c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:37.510845 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94babf7a-c106-4dba-ac31-f5935509a1c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:37.513160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94babf7a-c106-4dba-ac31-f5935509a1c6 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:37.552349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 945/1858] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:37 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:37.556337 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94babf7a-c106-4dba-ac31-f5935509a1c6 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:37.558109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ed052322-ed44-43e8-afdf-fa8747a3262f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0a9b363254c4cc2bd038f5f24d6f9f1', 'request_id': 'req-ed052322-ed44-43e8-afdf-fa8747a3262f'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:37.564540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:37.568012 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ed052322-ed44-43e8-afdf-fa8747a3262f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0a9b363254c4cc2bd038f5f24d6f9f1', 'request_id': 'req-ed052322-ed44-43e8-afdf-fa8747a3262f'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:37.573893 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94babf7a-c106-4dba-ac31-f5935509a1c6 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:37.579589 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ed052322-ed44-43e8-afdf-fa8747a3262f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0a9b363254c4cc2bd038f5f24d6f9f1', 'request_id': 'req-ed052322-ed44-43e8-afdf-fa8747a3262f'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:37.605667 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ed052322-ed44-43e8-afdf-fa8747a3262f admin admin] The token cache is being invalidate because project a0a9b363254c4cc2bd038f5f24d6f9f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:37.605967 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ed052322-ed44-43e8-afdf-fa8747a3262f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:37.606985 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ed052322-ed44-43e8-afdf-fa8747a3262f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:37.611857 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 914/1859] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:37 2022] DELETE /identity/v3/projects/a0a9b363254c4cc2bd038f5f24d6f9f1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:37.617623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed052322-ed44-43e8-afdf-fa8747a3262f admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:37.620092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ed052322-ed44-43e8-afdf-fa8747a3262f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:37.706911 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:37.756542 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0cb32-4e5a-4f23-97c8-5a6599adb22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:37.757443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0cb32-4e5a-4f23-97c8-5a6599adb22b admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:37.757879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0cb32-4e5a-4f23-97c8-5a6599adb22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:37.757991 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0cb32-4e5a-4f23-97c8-5a6599adb22b admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:37.758815 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c0cb32-4e5a-4f23-97c8-5a6599adb22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:37.760354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c0cb32-4e5a-4f23-97c8-5a6599adb22b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:37.795264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 946/1860] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:37.798848 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0cb32-4e5a-4f23-97c8-5a6599adb22b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:37.802221 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c8c0cb32-4e5a-4f23-97c8-5a6599adb22b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:37.811206 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed052322-ed44-43e8-afdf-fa8747a3262f admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:37.821634 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44708c9b-ea00-40a9-b9df-d4792be911ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:37.823729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44708c9b-ea00-40a9-b9df-d4792be911ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:37.824164 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44708c9b-ea00-40a9-b9df-d4792be911ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:37.824597 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44708c9b-ea00-40a9-b9df-d4792be911ee admin admin] PATH_INFO: `/v3/users/a9f1527b79164909a420da16e8f6d505` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:37.829978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44708c9b-ea00-40a9-b9df-d4792be911ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f1527b79164909a420da16e8f6d505)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:37.832013 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44708c9b-ea00-40a9-b9df-d4792be911ee admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:37.855209 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0cb32-4e5a-4f23-97c8-5a6599adb22b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:37.881187 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372bb5b-e9db-49f2-83ec-e3e5276e7c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:37.882043 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372bb5b-e9db-49f2-83ec-e3e5276e7c97 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:37.882327 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372bb5b-e9db-49f2-83ec-e3e5276e7c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:37.882625 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372bb5b-e9db-49f2-83ec-e3e5276e7c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:37.883371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372bb5b-e9db-49f2-83ec-e3e5276e7c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:37.890157 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372bb5b-e9db-49f2-83ec-e3e5276e7c97 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:37.913071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 947/1861] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:37.939057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372bb5b-e9db-49f2-83ec-e3e5276e7c97 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:37.943946 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-44708c9b-ea00-40a9-b9df-d4792be911ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f1527b79164909a420da16e8f6d505'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:37.959293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-44708c9b-ea00-40a9-b9df-d4792be911ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f1527b79164909a420da16e8f6d505'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:37.960258 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-44708c9b-ea00-40a9-b9df-d4792be911ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f1527b79164909a420da16e8f6d505'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:37.968777 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372bb5b-e9db-49f2-83ec-e3e5276e7c97 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:37.970776 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-44708c9b-ea00-40a9-b9df-d4792be911ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f1527b79164909a420da16e8f6d505'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:37.988843 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-44708c9b-ea00-40a9-b9df-d4792be911ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f1527b79164909a420da16e8f6d505'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:38.000700 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 915/1862] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:37 2022] DELETE /identity/v3/users/a9f1527b79164909a420da16e8f6d505 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:38.001392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b79030-a9a0-43b5-a358-6ef3bdf59189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:38.003850 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b79030-a9a0-43b5-a358-6ef3bdf59189 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:38.004975 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b79030-a9a0-43b5-a358-6ef3bdf59189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:38.006981 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b79030-a9a0-43b5-a358-6ef3bdf59189 admin admin] PATH_INFO: `/v3/projects/34b9584734a24e74940ecef2b8d05b1c/users/99010770f75748a7907a73dc28b04b4a/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:38.048672 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b79030-a9a0-43b5-a358-6ef3bdf59189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b9584734a24e74940ecef2b8d05b1c, user_id=99010770f75748a7907a73dc28b04b4a, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:38.052662 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b79030-a9a0-43b5-a358-6ef3bdf59189 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:38.076765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 948/1863] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:37 2022] PUT /identity/v3/projects/34b9584734a24e74940ecef2b8d05b1c/users/99010770f75748a7907a73dc28b04b4a/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:38.088868 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffec84-8c5f-471e-975f-12e5bd873968 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:38.089466 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffec84-8c5f-471e-975f-12e5bd873968 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:38.090029 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffec84-8c5f-471e-975f-12e5bd873968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:38.152929 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-93ffec84-8c5f-471e-975f-12e5bd873968 None None] MFA Rules not processed for user `99010770f75748a7907a73dc28b04b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:38.154329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-93ffec84-8c5f-471e-975f-12e5bd873968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:38.223443 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:38.261175 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 916/1864] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:38.262195 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b79030-a9a0-43b5-a358-6ef3bdf59189 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:38.264787 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-37b79030-a9a0-43b5-a358-6ef3bdf59189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:38.425903 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b79030-a9a0-43b5-a358-6ef3bdf59189 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:38.432822 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a0458-825e-44bb-b725-c77eaed1c7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:38.433918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a0458-825e-44bb-b725-c77eaed1c7d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:38.434426 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a0458-825e-44bb-b725-c77eaed1c7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:38.434955 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a0458-825e-44bb-b725-c77eaed1c7d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:38.435963 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a0458-825e-44bb-b725-c77eaed1c7d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:38.438132 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a0458-825e-44bb-b725-c77eaed1c7d0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:38.518695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 949/1865] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:38 2022] POST /identity/v3/projects => generated 381 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:38.525104 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffec84-8c5f-471e-975f-12e5bd873968 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:38.541557 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffec84-8c5f-471e-975f-12e5bd873968 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:38.650943 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30868a8b-68c5-42f4-8b93-804c6930cb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:38.651646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30868a8b-68c5-42f4-8b93-804c6930cb9a admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:38.651925 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30868a8b-68c5-42f4-8b93-804c6930cb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:38.652197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30868a8b-68c5-42f4-8b93-804c6930cb9a admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:38.652890 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30868a8b-68c5-42f4-8b93-804c6930cb9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:38.655418 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30868a8b-68c5-42f4-8b93-804c6930cb9a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:38.688054 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 917/1866] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:38 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:38.695190 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a0458-825e-44bb-b725-c77eaed1c7d0 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:38.716707 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a0458-825e-44bb-b725-c77eaed1c7d0 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:38.730496 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ba6b4-2bfa-4d4f-a365-787a6c66f2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:38.730496 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ba6b4-2bfa-4d4f-a365-787a6c66f2ff admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:38.730496 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ba6b4-2bfa-4d4f-a365-787a6c66f2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:38.730496 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ba6b4-2bfa-4d4f-a365-787a6c66f2ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:38.730901 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ba6b4-2bfa-4d4f-a365-787a6c66f2ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:38.730901 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ba6b4-2bfa-4d4f-a365-787a6c66f2ff admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:38.746457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30868a8b-68c5-42f4-8b93-804c6930cb9a admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:38.747802 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 950/1867] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:38.758684 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30868a8b-68c5-42f4-8b93-804c6930cb9a admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:38.767259 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63cbd3-2b36-4a45-b347-72c2cb66dac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:38.768901 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63cbd3-2b36-4a45-b347-72c2cb66dac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:38.769974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63cbd3-2b36-4a45-b347-72c2cb66dac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:38.770402 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63cbd3-2b36-4a45-b347-72c2cb66dac3 admin admin] PATH_INFO: `/v3/projects/67ef7364ca474ca788a374cf9714eb4c/users/cfb196d8c35e4e559be41e7b7d7b953d/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:38.798304 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63cbd3-2b36-4a45-b347-72c2cb66dac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67ef7364ca474ca788a374cf9714eb4c, user_id=cfb196d8c35e4e559be41e7b7d7b953d, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:38.803255 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63cbd3-2b36-4a45-b347-72c2cb66dac3 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:38.827101 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 918/1868] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:38 2022] PUT /identity/v3/projects/67ef7364ca474ca788a374cf9714eb4c/users/cfb196d8c35e4e559be41e7b7d7b953d/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:38.830780 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ba6b4-2bfa-4d4f-a365-787a6c66f2ff admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:38.842098 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ba6b4-2bfa-4d4f-a365-787a6c66f2ff admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:38.930842 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301ac37-0acc-4679-aff1-46e40a1b7538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:38.932346 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301ac37-0acc-4679-aff1-46e40a1b7538 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:38.932731 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301ac37-0acc-4679-aff1-46e40a1b7538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:38.933304 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301ac37-0acc-4679-aff1-46e40a1b7538 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:38.934291 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301ac37-0acc-4679-aff1-46e40a1b7538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:38.937379 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301ac37-0acc-4679-aff1-46e40a1b7538 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:38.974277 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 951/1869] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:38.978280 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63cbd3-2b36-4a45-b347-72c2cb66dac3 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:38.993077 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63cbd3-2b36-4a45-b347-72c2cb66dac3 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:38.999746 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab55eb-566c-4d14-8a6c-9441b67f8918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:39.002653 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab55eb-566c-4d14-8a6c-9441b67f8918 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:39.002653 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab55eb-566c-4d14-8a6c-9441b67f8918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:39.002653 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab55eb-566c-4d14-8a6c-9441b67f8918 admin admin] PATH_INFO: `/v3/projects/67ef7364ca474ca788a374cf9714eb4c/users/cfb196d8c35e4e559be41e7b7d7b953d/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:39.007920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab55eb-566c-4d14-8a6c-9441b67f8918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67ef7364ca474ca788a374cf9714eb4c, user_id=cfb196d8c35e4e559be41e7b7d7b953d, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:39.011665 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab55eb-566c-4d14-8a6c-9441b67f8918 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:39.040621 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 919/1870] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:38 2022] PUT /identity/v3/projects/67ef7364ca474ca788a374cf9714eb4c/users/cfb196d8c35e4e559be41e7b7d7b953d/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:40:39.042479 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ef7f3-8ed3-40a5-a6d7-aa89c7a4d542 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:39.042983 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ef7f3-8ed3-40a5-a6d7-aa89c7a4d542 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:39.043400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ef7f3-8ed3-40a5-a6d7-aa89c7a4d542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:39.079681 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:39.093202 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-fc4ef7f3-8ed3-40a5-a6d7-aa89c7a4d542 None None] MFA Rules not processed for user `cfb196d8c35e4e559be41e7b7d7b953d`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:39.100883 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fc4ef7f3-8ed3-40a5-a6d7-aa89c7a4d542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:39.218059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 952/1871] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:39.226544 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab55eb-566c-4d14-8a6c-9441b67f8918 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:39.228670 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-29ab55eb-566c-4d14-8a6c-9441b67f8918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:39.307313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab55eb-566c-4d14-8a6c-9441b67f8918 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:39.311251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc87438-6a95-4caf-af6d-6968a2a9b099 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:39.311953 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc87438-6a95-4caf-af6d-6968a2a9b099 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:39.312244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc87438-6a95-4caf-af6d-6968a2a9b099 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:39.312519 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc87438-6a95-4caf-af6d-6968a2a9b099 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:39.323666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc87438-6a95-4caf-af6d-6968a2a9b099 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:39.325136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc87438-6a95-4caf-af6d-6968a2a9b099 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:39.336755 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 920/1872] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:39.539250 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ef7f3-8ed3-40a5-a6d7-aa89c7a4d542 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:39.540906 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fc4ef7f3-8ed3-40a5-a6d7-aa89c7a4d542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:39.823654 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ef7f3-8ed3-40a5-a6d7-aa89c7a4d542 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:39.838324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f25ad-829e-492e-a3af-8ffa6c588267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:39.839594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f25ad-829e-492e-a3af-8ffa6c588267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:39.840066 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f25ad-829e-492e-a3af-8ffa6c588267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:39.840626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f25ad-829e-492e-a3af-8ffa6c588267 admin admin] PATH_INFO: `/v3/projects/4a17bfacdcad4636965b3607d666fd24` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:39.844361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f25ad-829e-492e-a3af-8ffa6c588267 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a17bfacdcad4636965b3607d666fd24)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:39.851777 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f25ad-829e-492e-a3af-8ffa6c588267 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:39.996498 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fb4f25ad-829e-492e-a3af-8ffa6c588267 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a17bfacdcad4636965b3607d666fd24', 'request_id': 'req-fb4f25ad-829e-492e-a3af-8ffa6c588267'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:40.023208 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fb4f25ad-829e-492e-a3af-8ffa6c588267 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a17bfacdcad4636965b3607d666fd24', 'request_id': 'req-fb4f25ad-829e-492e-a3af-8ffa6c588267'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:40.048025 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fb4f25ad-829e-492e-a3af-8ffa6c588267 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a17bfacdcad4636965b3607d666fd24', 'request_id': 'req-fb4f25ad-829e-492e-a3af-8ffa6c588267'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:40.090536 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fb4f25ad-829e-492e-a3af-8ffa6c588267 admin admin] The token cache is being invalidate because project 4a17bfacdcad4636965b3607d666fd24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:40.090974 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fb4f25ad-829e-492e-a3af-8ffa6c588267 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:40.091814 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fb4f25ad-829e-492e-a3af-8ffa6c588267 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:40.095637 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 953/1873] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:39 2022] DELETE /identity/v3/projects/4a17bfacdcad4636965b3607d666fd24 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:40.101495 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e5ab8-65f6-4047-a84d-0a4c715448c9 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:40.102091 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e5ab8-65f6-4047-a84d-0a4c715448c9 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:40.102091 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e5ab8-65f6-4047-a84d-0a4c715448c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:40.149378 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-382e5ab8-65f6-4047-a84d-0a4c715448c9 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:40.151558 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-382e5ab8-65f6-4047-a84d-0a4c715448c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:40.179642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f25ad-829e-492e-a3af-8ffa6c588267 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:40.184222 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fb4f25ad-829e-492e-a3af-8ffa6c588267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:40.290015 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:40.294745 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:40.324047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 921/1874] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:40:40.332025 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890068f5-6bcc-45ff-8965-ba77e5086b06 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:40.332624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890068f5-6bcc-45ff-8965-ba77e5086b06 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:40.333071 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890068f5-6bcc-45ff-8965-ba77e5086b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:40.358858 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-890068f5-6bcc-45ff-8965-ba77e5086b06 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:40.360373 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-890068f5-6bcc-45ff-8965-ba77e5086b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:40.370502 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 922/1875] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:40:40.375069 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890068f5-6bcc-45ff-8965-ba77e5086b06 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:40.383918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f25ad-829e-492e-a3af-8ffa6c588267 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:40.397923 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890068f5-6bcc-45ff-8965-ba77e5086b06 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:40.406403 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627af9c5-9bfb-4145-a5f7-bcfd0fb33b76 tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfb196d8c35e4e559be41e7b7d7b953d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67ef7364ca474ca788a374cf9714eb4c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:40.407682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627af9c5-9bfb-4145-a5f7-bcfd0fb33b76 tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:40.407855 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627af9c5-9bfb-4145-a5f7-bcfd0fb33b76 tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:40.408171 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627af9c5-9bfb-4145-a5f7-bcfd0fb33b76 tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:40.409035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627af9c5-9bfb-4145-a5f7-bcfd0fb33b76 tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:40:40.409346 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627af9c5-9bfb-4145-a5f7-bcfd0fb33b76 tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:40.412322 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627af9c5-9bfb-4145-a5f7-bcfd0fb33b76 tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:40.429658 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3019ead-d116-4689-8cff-9ba15492efef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:40.429939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 954/1876] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:40:40.431315 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3019ead-d116-4689-8cff-9ba15492efef admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:40.433296 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3019ead-d116-4689-8cff-9ba15492efef admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:40.433752 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3019ead-d116-4689-8cff-9ba15492efef admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:40.434731 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627af9c5-9bfb-4145-a5f7-bcfd0fb33b76 tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:40.435833 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3019ead-d116-4689-8cff-9ba15492efef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:40:40.446557 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3019ead-d116-4689-8cff-9ba15492efef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:40.449326 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627af9c5-9bfb-4145-a5f7-bcfd0fb33b76 tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:40.454232 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3019ead-d116-4689-8cff-9ba15492efef admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:40.456566 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cdbe5-109f-4557-946c-47be7eac48be tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfb196d8c35e4e559be41e7b7d7b953d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67ef7364ca474ca788a374cf9714eb4c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:40.458188 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cdbe5-109f-4557-946c-47be7eac48be tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:40.458792 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cdbe5-109f-4557-946c-47be7eac48be tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:40.459223 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cdbe5-109f-4557-946c-47be7eac48be tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:40.460365 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451cdbe5-109f-4557-946c-47be7eac48be tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:40.462632 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451cdbe5-109f-4557-946c-47be7eac48be tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:40.478978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 923/1877] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:40:40.483293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3019ead-d116-4689-8cff-9ba15492efef admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:40.511113 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 955/1878] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:40 2022] POST /identity/v3/projects => generated 355 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:40:40.511772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3019ead-d116-4689-8cff-9ba15492efef admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:40.512427 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cdbe5-109f-4557-946c-47be7eac48be tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:40.599503 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe85b0-7fa4-443e-898b-ea87130742db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:40.600581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe85b0-7fa4-443e-898b-ea87130742db admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:40.600581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe85b0-7fa4-443e-898b-ea87130742db admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:40.600765 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe85b0-7fa4-443e-898b-ea87130742db admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:40.601399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe85b0-7fa4-443e-898b-ea87130742db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:40.603388 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe85b0-7fa4-443e-898b-ea87130742db admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:40.605342 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cdbe5-109f-4557-946c-47be7eac48be tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:40.612303 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a161db-6009-474f-b3d4-0117ae91fd32 tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfb196d8c35e4e559be41e7b7d7b953d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67ef7364ca474ca788a374cf9714eb4c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:40.613028 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a161db-6009-474f-b3d4-0117ae91fd32 tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:40.613525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a161db-6009-474f-b3d4-0117ae91fd32 tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:40.613810 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a161db-6009-474f-b3d4-0117ae91fd32 tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:40.614722 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a161db-6009-474f-b3d4-0117ae91fd32 tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:40:40.615042 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a161db-6009-474f-b3d4-0117ae91fd32 tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:40.617141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a161db-6009-474f-b3d4-0117ae91fd32 tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:40.637303 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 924/1879] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:40 2022] POST /identity/v3/projects => generated 359 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:40.642408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe85b0-7fa4-443e-898b-ea87130742db admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:40.662934 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 956/1880] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:40:40.732299 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a161db-6009-474f-b3d4-0117ae91fd32 tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:40.745438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a161db-6009-474f-b3d4-0117ae91fd32 tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:40.770668 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe85b0-7fa4-443e-898b-ea87130742db admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:40.778039 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241b3e8-0cc8-4b34-a410-acaab034b1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:40.778904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241b3e8-0cc8-4b34-a410-acaab034b1dd admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:40.779723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241b3e8-0cc8-4b34-a410-acaab034b1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:40.780004 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241b3e8-0cc8-4b34-a410-acaab034b1dd admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:40.780761 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241b3e8-0cc8-4b34-a410-acaab034b1dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:40.783866 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241b3e8-0cc8-4b34-a410-acaab034b1dd admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:40.849616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 925/1881] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:40 2022] POST /identity/v3/users => generated 280 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:40.849616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241b3e8-0cc8-4b34-a410-acaab034b1dd admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:40.851682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efea1bb-eab6-4309-88fa-dc72273cc20f tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfb196d8c35e4e559be41e7b7d7b953d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67ef7364ca474ca788a374cf9714eb4c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:40.853456 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efea1bb-eab6-4309-88fa-dc72273cc20f tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:40.853741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efea1bb-eab6-4309-88fa-dc72273cc20f tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:40.854741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efea1bb-eab6-4309-88fa-dc72273cc20f tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] PATH_INFO: `/v3/projects/cc01e444140346ddb99ce02450be7989` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:40.855406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efea1bb-eab6-4309-88fa-dc72273cc20f tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cc01e444140346ddb99ce02450be7989)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:40.857549 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efea1bb-eab6-4309-88fa-dc72273cc20f tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:40.870187 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241b3e8-0cc8-4b34-a410-acaab034b1dd admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:40.878542 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572e63e-3ef6-454d-8918-32de09312b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:40.879716 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572e63e-3ef6-454d-8918-32de09312b84 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:40.880057 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572e63e-3ef6-454d-8918-32de09312b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:40.882111 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572e63e-3ef6-454d-8918-32de09312b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:40.884878 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572e63e-3ef6-454d-8918-32de09312b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:40.886628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572e63e-3ef6-454d-8918-32de09312b84 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:40.918768 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 926/1882] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:40.922822 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572e63e-3ef6-454d-8918-32de09312b84 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:40.935100 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:40.944245 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572e63e-3ef6-454d-8918-32de09312b84 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:40.955850 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2efea1bb-eab6-4309-88fa-dc72273cc20f tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc01e444140346ddb99ce02450be7989', 'request_id': 'req-2efea1bb-eab6-4309-88fa-dc72273cc20f'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:40.979397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2efea1bb-eab6-4309-88fa-dc72273cc20f tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc01e444140346ddb99ce02450be7989', 'request_id': 'req-2efea1bb-eab6-4309-88fa-dc72273cc20f'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:40.992107 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2efea1bb-eab6-4309-88fa-dc72273cc20f tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc01e444140346ddb99ce02450be7989', 'request_id': 'req-2efea1bb-eab6-4309-88fa-dc72273cc20f'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:41.031003 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:41.033504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2efea1bb-eab6-4309-88fa-dc72273cc20f tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] The token cache is being invalidate because project cc01e444140346ddb99ce02450be7989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:41.033900 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2efea1bb-eab6-4309-88fa-dc72273cc20f tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:41.034780 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2efea1bb-eab6-4309-88fa-dc72273cc20f tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:41.041060 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 957/1883] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:40 2022] DELETE /identity/v3/projects/cc01e444140346ddb99ce02450be7989 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:41.069850 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532f239-adb7-45fb-af8f-9a2c0da55ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:41.070439 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532f239-adb7-45fb-af8f-9a2c0da55ecb admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:41.071298 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532f239-adb7-45fb-af8f-9a2c0da55ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:41.071298 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532f239-adb7-45fb-af8f-9a2c0da55ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:41.071968 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532f239-adb7-45fb-af8f-9a2c0da55ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:41.073856 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532f239-adb7-45fb-af8f-9a2c0da55ecb admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:41.091406 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 927/1884] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:41.096392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efea1bb-eab6-4309-88fa-dc72273cc20f tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:41.102095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2efea1bb-eab6-4309-88fa-dc72273cc20f tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:41.150334 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efea1bb-eab6-4309-88fa-dc72273cc20f tempest-VolumeQuotaClassesTest-1516511217 tempest-VolumeQuotaClassesTest-1516511217-project-admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:41.159024 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc7ae0-c1ca-4d5a-8c17-e17247403367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:41.159980 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc7ae0-c1ca-4d5a-8c17-e17247403367 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:41.160285 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc7ae0-c1ca-4d5a-8c17-e17247403367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:41.160553 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc7ae0-c1ca-4d5a-8c17-e17247403367 admin admin] PATH_INFO: `/v3/projects/e2b5d4f943174cb1afd59dcb51a20b12/users/98c80b8364dc4e02a54f6d965d24ed3c/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:41.182610 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc7ae0-c1ca-4d5a-8c17-e17247403367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b5d4f943174cb1afd59dcb51a20b12, user_id=98c80b8364dc4e02a54f6d965d24ed3c, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:41.185931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc7ae0-c1ca-4d5a-8c17-e17247403367 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:41.207460 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 958/1885] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:41 2022] PUT /identity/v3/projects/e2b5d4f943174cb1afd59dcb51a20b12/users/98c80b8364dc4e02a54f6d965d24ed3c/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:41.221495 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f22cb-dd77-4ed5-847e-a6d5eee2ae5a None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:41.221883 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f22cb-dd77-4ed5-847e-a6d5eee2ae5a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:41.222626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f22cb-dd77-4ed5-847e-a6d5eee2ae5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:41.270986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-617f22cb-dd77-4ed5-847e-a6d5eee2ae5a None None] MFA Rules not processed for user `98c80b8364dc4e02a54f6d965d24ed3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:41.272409 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-617f22cb-dd77-4ed5-847e-a6d5eee2ae5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:41.389184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 928/1886] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:41 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:41.411051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc7ae0-c1ca-4d5a-8c17-e17247403367 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:41.413442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-79bc7ae0-c1ca-4d5a-8c17-e17247403367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:41.423949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f22cb-dd77-4ed5-847e-a6d5eee2ae5a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:41.425344 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-617f22cb-dd77-4ed5-847e-a6d5eee2ae5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:41.491958 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f22cb-dd77-4ed5-847e-a6d5eee2ae5a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:41.497948 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f93ad7-0c8b-4573-8980-96a379898728 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:41.498788 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f93ad7-0c8b-4573-8980-96a379898728 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:41.499126 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f93ad7-0c8b-4573-8980-96a379898728 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:41.499409 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f93ad7-0c8b-4573-8980-96a379898728 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:41.515251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f93ad7-0c8b-4573-8980-96a379898728 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:41.517287 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f93ad7-0c8b-4573-8980-96a379898728 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:41.529968 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 929/1887] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:41 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:40:41.545676 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f93ad7-0c8b-4573-8980-96a379898728 service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:41.551192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc7ae0-c1ca-4d5a-8c17-e17247403367 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:41.559361 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f93ad7-0c8b-4573-8980-96a379898728 service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:41.559569 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03d202-9b63-4dd4-a055-bc99fbcc4f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:41.561022 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03d202-9b63-4dd4-a055-bc99fbcc4f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:41.561334 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03d202-9b63-4dd4-a055-bc99fbcc4f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:41.561779 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03d202-9b63-4dd4-a055-bc99fbcc4f09 admin admin] PATH_INFO: `/v3/users/99010770f75748a7907a73dc28b04b4a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:41.563659 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03d202-9b63-4dd4-a055-bc99fbcc4f09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99010770f75748a7907a73dc28b04b4a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:41.567229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03d202-9b63-4dd4-a055-bc99fbcc4f09 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:41.567389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc1f51-f442-4d87-9ce3-686bd0608c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:41.568272 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc1f51-f442-4d87-9ce3-686bd0608c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:41.569069 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc1f51-f442-4d87-9ce3-686bd0608c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:41.569069 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc1f51-f442-4d87-9ce3-686bd0608c5a admin admin] PATH_INFO: `/v3/users/98c80b8364dc4e02a54f6d965d24ed3c` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:41.577008 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc1f51-f442-4d87-9ce3-686bd0608c5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=98c80b8364dc4e02a54f6d965d24ed3c)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:41.586999 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc1f51-f442-4d87-9ce3-686bd0608c5a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:41.646297 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3c03d202-9b63-4dd4-a055-bc99fbcc4f09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99010770f75748a7907a73dc28b04b4a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:41.662650 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3c03d202-9b63-4dd4-a055-bc99fbcc4f09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99010770f75748a7907a73dc28b04b4a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:41.663264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3c03d202-9b63-4dd4-a055-bc99fbcc4f09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99010770f75748a7907a73dc28b04b4a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:41.678172 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3c03d202-9b63-4dd4-a055-bc99fbcc4f09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99010770f75748a7907a73dc28b04b4a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:41.678987 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3c03d202-9b63-4dd4-a055-bc99fbcc4f09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99010770f75748a7907a73dc28b04b4a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:41.692801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 959/1888] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:41 2022] DELETE /identity/v3/users/99010770f75748a7907a73dc28b04b4a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:41.697290 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bec9e0-333a-4bfe-b3c3-1c1786673d53 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:41.697853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bec9e0-333a-4bfe-b3c3-1c1786673d53 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:41.698103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bec9e0-333a-4bfe-b3c3-1c1786673d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:41.700631 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d9dc1f51-f442-4d87-9ce3-686bd0608c5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98c80b8364dc4e02a54f6d965d24ed3c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:41.711107 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d9dc1f51-f442-4d87-9ce3-686bd0608c5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98c80b8364dc4e02a54f6d965d24ed3c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:41.711966 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d9dc1f51-f442-4d87-9ce3-686bd0608c5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98c80b8364dc4e02a54f6d965d24ed3c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:41.713557 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:41.724350 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-41bec9e0-333a-4bfe-b3c3-1c1786673d53 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:41.725878 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-41bec9e0-333a-4bfe-b3c3-1c1786673d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:41.727782 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d9dc1f51-f442-4d87-9ce3-686bd0608c5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98c80b8364dc4e02a54f6d965d24ed3c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:41.745247 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:41.751206 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d9dc1f51-f442-4d87-9ce3-686bd0608c5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98c80b8364dc4e02a54f6d965d24ed3c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:41.762709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 930/1889] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:41 2022] DELETE /identity/v3/users/98c80b8364dc4e02a54f6d965d24ed3c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:40:41.767499 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee0463-aec7-4300-8955-6a1ef3029e4a None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:41.767669 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee0463-aec7-4300-8955-6a1ef3029e4a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:41.768172 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee0463-aec7-4300-8955-6a1ef3029e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:41.791073 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-36ee0463-aec7-4300-8955-6a1ef3029e4a None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:41.792377 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-36ee0463-aec7-4300-8955-6a1ef3029e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:41.845595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 960/1890] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:41.860641 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bec9e0-333a-4bfe-b3c3-1c1786673d53 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:41.862452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-41bec9e0-333a-4bfe-b3c3-1c1786673d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:41.902934 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 931/1891] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:41.913757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee0463-aec7-4300-8955-6a1ef3029e4a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:41.916118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-36ee0463-aec7-4300-8955-6a1ef3029e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:41.954747 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bec9e0-333a-4bfe-b3c3-1c1786673d53 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:42.004617 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee0463-aec7-4300-8955-6a1ef3029e4a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:42.008842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26cfe0-6c5f-4a5a-9e79-a9ba3549eb26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:42.009680 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26cfe0-6c5f-4a5a-9e79-a9ba3549eb26 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:42.009970 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26cfe0-6c5f-4a5a-9e79-a9ba3549eb26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:42.010905 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26cfe0-6c5f-4a5a-9e79-a9ba3549eb26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:42.023547 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad26cfe0-6c5f-4a5a-9e79-a9ba3549eb26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:42.025087 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad26cfe0-6c5f-4a5a-9e79-a9ba3549eb26 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:42.025966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420ca5d-048f-4e3d-9a55-badf3bdc7ea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:42.026738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420ca5d-048f-4e3d-9a55-badf3bdc7ea0 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:42.027023 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420ca5d-048f-4e3d-9a55-badf3bdc7ea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:42.027297 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420ca5d-048f-4e3d-9a55-badf3bdc7ea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:42.037092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 932/1892] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:42.037391 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420ca5d-048f-4e3d-9a55-badf3bdc7ea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:42.037944 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26cfe0-6c5f-4a5a-9e79-a9ba3549eb26 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:42.038833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420ca5d-048f-4e3d-9a55-badf3bdc7ea0 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:42.039274 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ad26cfe0-6c5f-4a5a-9e79-a9ba3549eb26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:42.050204 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 961/1893] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:40:42.053141 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26cfe0-6c5f-4a5a-9e79-a9ba3549eb26 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:42.058624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0b9cb-3562-452e-aaca-1194b7a44618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:42.059688 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0b9cb-3562-452e-aaca-1194b7a44618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:42.060144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0b9cb-3562-452e-aaca-1194b7a44618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:42.060559 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0b9cb-3562-452e-aaca-1194b7a44618 admin admin] PATH_INFO: `/v3/users/98c3cc8bc5814eb494a07ec7621f644b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:42.062183 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0b9cb-3562-452e-aaca-1194b7a44618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98c3cc8bc5814eb494a07ec7621f644b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:42.065128 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0b9cb-3562-452e-aaca-1194b7a44618 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:42.132196 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c6f0b9cb-3562-452e-aaca-1194b7a44618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98c3cc8bc5814eb494a07ec7621f644b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:42.141145 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c6f0b9cb-3562-452e-aaca-1194b7a44618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98c3cc8bc5814eb494a07ec7621f644b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:42.141880 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c6f0b9cb-3562-452e-aaca-1194b7a44618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98c3cc8bc5814eb494a07ec7621f644b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:42.152828 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c6f0b9cb-3562-452e-aaca-1194b7a44618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98c3cc8bc5814eb494a07ec7621f644b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:42.163079 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:42.172884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c6f0b9cb-3562-452e-aaca-1194b7a44618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98c3cc8bc5814eb494a07ec7621f644b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:42.192275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 933/1894] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:42 2022] DELETE /identity/v3/users/98c3cc8bc5814eb494a07ec7621f644b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:42.195149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e33a1e-73b5-46d7-8365-9192a52394d9 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:42.195149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e33a1e-73b5-46d7-8365-9192a52394d9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:42.195149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e33a1e-73b5-46d7-8365-9192a52394d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:42.214510 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-63e33a1e-73b5-46d7-8365-9192a52394d9 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:42.215830 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-63e33a1e-73b5-46d7-8365-9192a52394d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:42.296865 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 962/1895] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:40:42.308036 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0b9cb-3562-452e-aaca-1194b7a44618 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:42.310537 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c6f0b9cb-3562-452e-aaca-1194b7a44618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:42.473124 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0b9cb-3562-452e-aaca-1194b7a44618 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:42.477791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca6082-5ec4-4022-88fe-a034bae2ebbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:42.478458 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca6082-5ec4-4022-88fe-a034bae2ebbc service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:42.478793 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca6082-5ec4-4022-88fe-a034bae2ebbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:42.479410 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca6082-5ec4-4022-88fe-a034bae2ebbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:42.491298 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca6082-5ec4-4022-88fe-a034bae2ebbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:42.492758 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca6082-5ec4-4022-88fe-a034bae2ebbc service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:42.504006 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 934/1896] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:42.556329 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e33a1e-73b5-46d7-8365-9192a52394d9 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:42.558218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-63e33a1e-73b5-46d7-8365-9192a52394d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:42.575200 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e33a1e-73b5-46d7-8365-9192a52394d9 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:42.580916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e956b-0c72-4ea5-9949-d3659d8ee608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:42.581809 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e956b-0c72-4ea5-9949-d3659d8ee608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:42.582090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e956b-0c72-4ea5-9949-d3659d8ee608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:42.582664 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e956b-0c72-4ea5-9949-d3659d8ee608 admin admin] PATH_INFO: `/v3/projects/34b9584734a24e74940ecef2b8d05b1c` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:42.583724 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e956b-0c72-4ea5-9949-d3659d8ee608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34b9584734a24e74940ecef2b8d05b1c)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:42.585895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e956b-0c72-4ea5-9949-d3659d8ee608 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:42.599595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:42.647891 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8c2e956b-0c72-4ea5-9949-d3659d8ee608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34b9584734a24e74940ecef2b8d05b1c', 'request_id': 'req-8c2e956b-0c72-4ea5-9949-d3659d8ee608'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:42.654799 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8c2e956b-0c72-4ea5-9949-d3659d8ee608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34b9584734a24e74940ecef2b8d05b1c', 'request_id': 'req-8c2e956b-0c72-4ea5-9949-d3659d8ee608'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:42.661408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8c2e956b-0c72-4ea5-9949-d3659d8ee608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34b9584734a24e74940ecef2b8d05b1c', 'request_id': 'req-8c2e956b-0c72-4ea5-9949-d3659d8ee608'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:42.680237 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8c2e956b-0c72-4ea5-9949-d3659d8ee608 admin admin] The token cache is being invalidate because project 34b9584734a24e74940ecef2b8d05b1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:42.680729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8c2e956b-0c72-4ea5-9949-d3659d8ee608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:42.681737 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8c2e956b-0c72-4ea5-9949-d3659d8ee608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:42.684659 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 963/1897] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:42 2022] DELETE /identity/v3/projects/34b9584734a24e74940ecef2b8d05b1c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:42.690851 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca6082-5ec4-4022-88fe-a034bae2ebbc service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:42.700793 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca6082-5ec4-4022-88fe-a034bae2ebbc service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:42.803702 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f643b-1a0a-42f3-b0ee-a8b65199c370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:42.804861 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f643b-1a0a-42f3-b0ee-a8b65199c370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:42.805213 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f643b-1a0a-42f3-b0ee-a8b65199c370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:42.805722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f643b-1a0a-42f3-b0ee-a8b65199c370 admin admin] PATH_INFO: `/v3/users/cfb196d8c35e4e559be41e7b7d7b953d` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:42.807627 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f643b-1a0a-42f3-b0ee-a8b65199c370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfb196d8c35e4e559be41e7b7d7b953d)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:42.810069 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f643b-1a0a-42f3-b0ee-a8b65199c370 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:42.877948 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ad4f643b-1a0a-42f3-b0ee-a8b65199c370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb196d8c35e4e559be41e7b7d7b953d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:42.888880 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ad4f643b-1a0a-42f3-b0ee-a8b65199c370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb196d8c35e4e559be41e7b7d7b953d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:42.889745 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ad4f643b-1a0a-42f3-b0ee-a8b65199c370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb196d8c35e4e559be41e7b7d7b953d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:42.899454 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ad4f643b-1a0a-42f3-b0ee-a8b65199c370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb196d8c35e4e559be41e7b7d7b953d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:42.914324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ad4f643b-1a0a-42f3-b0ee-a8b65199c370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb196d8c35e4e559be41e7b7d7b953d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:42.922123 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 935/1898] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:42 2022] DELETE /identity/v3/users/cfb196d8c35e4e559be41e7b7d7b953d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:40:43.025787 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e956b-0c72-4ea5-9949-d3659d8ee608 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:43.027812 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8c2e956b-0c72-4ea5-9949-d3659d8ee608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:43.053644 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e956b-0c72-4ea5-9949-d3659d8ee608 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:43.211551 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a7e9a-acc7-47ee-8876-ca9ded7f6018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:43.212515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a7e9a-acc7-47ee-8876-ca9ded7f6018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:43.212677 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a7e9a-acc7-47ee-8876-ca9ded7f6018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:43.212951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a7e9a-acc7-47ee-8876-ca9ded7f6018 admin admin] PATH_INFO: `/v3/projects/e2b5d4f943174cb1afd59dcb51a20b12` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:43.214394 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a7e9a-acc7-47ee-8876-ca9ded7f6018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2b5d4f943174cb1afd59dcb51a20b12)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:43.216416 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a7e9a-acc7-47ee-8876-ca9ded7f6018 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:43.342068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f643b-1a0a-42f3-b0ee-a8b65199c370 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:43.343558 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ad4f643b-1a0a-42f3-b0ee-a8b65199c370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:43.361969 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f643b-1a0a-42f3-b0ee-a8b65199c370 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:43.370302 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:43.379347 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2d5a7e9a-acc7-47ee-8876-ca9ded7f6018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b5d4f943174cb1afd59dcb51a20b12', 'request_id': 'req-2d5a7e9a-acc7-47ee-8876-ca9ded7f6018'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:43.395860 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2d5a7e9a-acc7-47ee-8876-ca9ded7f6018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b5d4f943174cb1afd59dcb51a20b12', 'request_id': 'req-2d5a7e9a-acc7-47ee-8876-ca9ded7f6018'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:43.405872 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2d5a7e9a-acc7-47ee-8876-ca9ded7f6018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b5d4f943174cb1afd59dcb51a20b12', 'request_id': 'req-2d5a7e9a-acc7-47ee-8876-ca9ded7f6018'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:43.429981 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2d5a7e9a-acc7-47ee-8876-ca9ded7f6018 admin admin] The token cache is being invalidate because project e2b5d4f943174cb1afd59dcb51a20b12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:43.431141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2d5a7e9a-acc7-47ee-8876-ca9ded7f6018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:43.431911 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2d5a7e9a-acc7-47ee-8876-ca9ded7f6018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:43.436765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 964/1899] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:43 2022] DELETE /identity/v3/projects/e2b5d4f943174cb1afd59dcb51a20b12 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:43.443179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533d737-0f14-4811-85e5-cf982da773d8 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:43.443179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533d737-0f14-4811-85e5-cf982da773d8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:43.443494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533d737-0f14-4811-85e5-cf982da773d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:43.476393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b533d737-0f14-4811-85e5-cf982da773d8 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:43.477851 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b533d737-0f14-4811-85e5-cf982da773d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:43.506110 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689fe03-af3d-48ec-b44b-e126858cf7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:43.507314 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689fe03-af3d-48ec-b44b-e126858cf7c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:43.508474 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689fe03-af3d-48ec-b44b-e126858cf7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:43.509004 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689fe03-af3d-48ec-b44b-e126858cf7c5 admin admin] PATH_INFO: `/v3/projects/67ef7364ca474ca788a374cf9714eb4c` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:43.511461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689fe03-af3d-48ec-b44b-e126858cf7c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67ef7364ca474ca788a374cf9714eb4c)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:43.514024 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689fe03-af3d-48ec-b44b-e126858cf7c5 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:43.539834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:43.596918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 965/1900] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:43.598919 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519758b-54cc-4835-aa43-da97d519cd46 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:43.599209 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519758b-54cc-4835-aa43-da97d519cd46 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:43.599485 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519758b-54cc-4835-aa43-da97d519cd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:43.617063 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e689fe03-af3d-48ec-b44b-e126858cf7c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67ef7364ca474ca788a374cf9714eb4c', 'request_id': 'req-e689fe03-af3d-48ec-b44b-e126858cf7c5'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:43.626309 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4519758b-54cc-4835-aa43-da97d519cd46 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:43.627596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4519758b-54cc-4835-aa43-da97d519cd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:43.637326 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e689fe03-af3d-48ec-b44b-e126858cf7c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67ef7364ca474ca788a374cf9714eb4c', 'request_id': 'req-e689fe03-af3d-48ec-b44b-e126858cf7c5'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:43.647140 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e689fe03-af3d-48ec-b44b-e126858cf7c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67ef7364ca474ca788a374cf9714eb4c', 'request_id': 'req-e689fe03-af3d-48ec-b44b-e126858cf7c5'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:43.667455 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e689fe03-af3d-48ec-b44b-e126858cf7c5 admin admin] The token cache is being invalidate because project 67ef7364ca474ca788a374cf9714eb4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:43.667805 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e689fe03-af3d-48ec-b44b-e126858cf7c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:43.668606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e689fe03-af3d-48ec-b44b-e126858cf7c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:43.670927 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 936/1901] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:43 2022] DELETE /identity/v3/projects/67ef7364ca474ca788a374cf9714eb4c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:40:43.678378 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689fe03-af3d-48ec-b44b-e126858cf7c5 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:43.680495 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e689fe03-af3d-48ec-b44b-e126858cf7c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:43.742419 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 966/1902] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:40:43.745219 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43290b4-1410-469b-ac9d-7ae2011465ed None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:43.745745 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43290b4-1410-469b-ac9d-7ae2011465ed None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:43.746242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43290b4-1410-469b-ac9d-7ae2011465ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:43.774789 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b43290b4-1410-469b-ac9d-7ae2011465ed None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:43.776319 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b43290b4-1410-469b-ac9d-7ae2011465ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:43.785464 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689fe03-af3d-48ec-b44b-e126858cf7c5 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:43.786891 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 967/1903] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:43.788063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43290b4-1410-469b-ac9d-7ae2011465ed None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:43.799219 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a805ea-d79e-4d5e-93cc-4adf2396ca0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:43.800219 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a805ea-d79e-4d5e-93cc-4adf2396ca0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:43.800570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a805ea-d79e-4d5e-93cc-4adf2396ca0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:43.800967 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a805ea-d79e-4d5e-93cc-4adf2396ca0f admin admin] PATH_INFO: `/v3/projects/8b536a5acbce4ffa9e6e9be88f1f2e75` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:43.802305 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a805ea-d79e-4d5e-93cc-4adf2396ca0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b536a5acbce4ffa9e6e9be88f1f2e75)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:43.804695 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a805ea-d79e-4d5e-93cc-4adf2396ca0f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:43.819759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43290b4-1410-469b-ac9d-7ae2011465ed None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:43.828752 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db6253-68f3-4a85-8004-1b7f458f307c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:43.829528 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db6253-68f3-4a85-8004-1b7f458f307c admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:43.830640 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db6253-68f3-4a85-8004-1b7f458f307c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:43.830924 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db6253-68f3-4a85-8004-1b7f458f307c admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:43.831669 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db6253-68f3-4a85-8004-1b7f458f307c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:40:43.832511 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db6253-68f3-4a85-8004-1b7f458f307c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:43.846236 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db6253-68f3-4a85-8004-1b7f458f307c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:43.874496 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 968/1904] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:40:43.874496 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df5fff-f35a-4106-954a-3389a17e7c06 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:43.874496 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df5fff-f35a-4106-954a-3389a17e7c06 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:43.874496 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df5fff-f35a-4106-954a-3389a17e7c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:43.892251 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-12df5fff-f35a-4106-954a-3389a17e7c06 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:43.893175 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-12df5fff-f35a-4106-954a-3389a17e7c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:43.905427 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:43.920284 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e6a805ea-d79e-4d5e-93cc-4adf2396ca0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b536a5acbce4ffa9e6e9be88f1f2e75', 'request_id': 'req-e6a805ea-d79e-4d5e-93cc-4adf2396ca0f'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:43.935102 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e6a805ea-d79e-4d5e-93cc-4adf2396ca0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b536a5acbce4ffa9e6e9be88f1f2e75', 'request_id': 'req-e6a805ea-d79e-4d5e-93cc-4adf2396ca0f'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:43.942425 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e6a805ea-d79e-4d5e-93cc-4adf2396ca0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b536a5acbce4ffa9e6e9be88f1f2e75', 'request_id': 'req-e6a805ea-d79e-4d5e-93cc-4adf2396ca0f'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:43.966899 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e6a805ea-d79e-4d5e-93cc-4adf2396ca0f admin admin] The token cache is being invalidate because project 8b536a5acbce4ffa9e6e9be88f1f2e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:43.967253 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e6a805ea-d79e-4d5e-93cc-4adf2396ca0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:43.968334 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e6a805ea-d79e-4d5e-93cc-4adf2396ca0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:43.972099 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 937/1905] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:43 2022] DELETE /identity/v3/projects/8b536a5acbce4ffa9e6e9be88f1f2e75 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:43.977160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a805ea-d79e-4d5e-93cc-4adf2396ca0f admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:43.981364 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e6a805ea-d79e-4d5e-93cc-4adf2396ca0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:44.032107 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 969/1906] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:44.033150 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df5fff-f35a-4106-954a-3389a17e7c06 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:44.037037 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-12df5fff-f35a-4106-954a-3389a17e7c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:44.060108 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df5fff-f35a-4106-954a-3389a17e7c06 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:44.070281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8259e0-0d68-427a-8559-c213e950d985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:44.071104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8259e0-0d68-427a-8559-c213e950d985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:44.071418 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8259e0-0d68-427a-8559-c213e950d985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:44.071693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8259e0-0d68-427a-8559-c213e950d985 admin admin] PATH_INFO: `/v3/users/74823c50ab7a45aea0a368678fa56a85` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:44.077162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8259e0-0d68-427a-8559-c213e950d985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74823c50ab7a45aea0a368678fa56a85)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:44.079174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8259e0-0d68-427a-8559-c213e950d985 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:44.094905 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a805ea-d79e-4d5e-93cc-4adf2396ca0f admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:44.116008 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9b00d-7bb1-4b95-a5db-6328ed65f0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:44.116764 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9b00d-7bb1-4b95-a5db-6328ed65f0dd admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:44.117059 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9b00d-7bb1-4b95-a5db-6328ed65f0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:44.117429 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9b00d-7bb1-4b95-a5db-6328ed65f0dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:44.121122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9b00d-7bb1-4b95-a5db-6328ed65f0dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:44.124307 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9b00d-7bb1-4b95-a5db-6328ed65f0dd admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:44.186429 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1e8259e0-0d68-427a-8559-c213e950d985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74823c50ab7a45aea0a368678fa56a85'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:44.200012 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 938/1907] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:43 2022] POST /identity/v3/projects => generated 375 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:44.200322 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:44.200443 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9b00d-7bb1-4b95-a5db-6328ed65f0dd admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:44.203278 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1e8259e0-0d68-427a-8559-c213e950d985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74823c50ab7a45aea0a368678fa56a85'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:44.204542 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1e8259e0-0d68-427a-8559-c213e950d985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74823c50ab7a45aea0a368678fa56a85'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:44.229169 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1e8259e0-0d68-427a-8559-c213e950d985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74823c50ab7a45aea0a368678fa56a85'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:44.230249 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1e8259e0-0d68-427a-8559-c213e950d985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74823c50ab7a45aea0a368678fa56a85'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:44.253730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 970/1908] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:44 2022] DELETE /identity/v3/users/74823c50ab7a45aea0a368678fa56a85 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:44.254811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8259e0-0d68-427a-8559-c213e950d985 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:44.260721 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1e8259e0-0d68-427a-8559-c213e950d985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:44.349778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9b00d-7bb1-4b95-a5db-6328ed65f0dd admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:44.363179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8259e0-0d68-427a-8559-c213e950d985 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:44.369117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a785c-0ddc-46f8-9ca9-1c994fd211cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:44.370353 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a785c-0ddc-46f8-9ca9-1c994fd211cd admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:44.370881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a785c-0ddc-46f8-9ca9-1c994fd211cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:44.372053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a785c-0ddc-46f8-9ca9-1c994fd211cd admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:44.373801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a785c-0ddc-46f8-9ca9-1c994fd211cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:44.376254 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a785c-0ddc-46f8-9ca9-1c994fd211cd admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:44.408062 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 971/1909] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:44 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:44.416312 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a785c-0ddc-46f8-9ca9-1c994fd211cd admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:44.416821 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc028ca-ba4e-4388-ba26-c62e732eedb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:44.417481 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc028ca-ba4e-4388-ba26-c62e732eedb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:44.417757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc028ca-ba4e-4388-ba26-c62e732eedb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:44.418037 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc028ca-ba4e-4388-ba26-c62e732eedb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:44.418799 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc028ca-ba4e-4388-ba26-c62e732eedb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:40:44.419110 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc028ca-ba4e-4388-ba26-c62e732eedb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:44.420707 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc028ca-ba4e-4388-ba26-c62e732eedb9 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:44.424408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:44.433885 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a785c-0ddc-46f8-9ca9-1c994fd211cd admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:44.439201 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 939/1910] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:40:44.442279 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efaee8-4e78-4d95-a942-3f82bf2cd751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:44.442973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc028ca-ba4e-4388-ba26-c62e732eedb9 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:44.443467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efaee8-4e78-4d95-a942-3f82bf2cd751 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:44.443979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efaee8-4e78-4d95-a942-3f82bf2cd751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:44.444385 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efaee8-4e78-4d95-a942-3f82bf2cd751 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:44.444978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4cc028ca-ba4e-4388-ba26-c62e732eedb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:44.446219 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20efaee8-4e78-4d95-a942-3f82bf2cd751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:44.448630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20efaee8-4e78-4d95-a942-3f82bf2cd751 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:44.459132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc028ca-ba4e-4388-ba26-c62e732eedb9 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:44.469593 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cb541-6e2d-4c76-9c5f-cd14aa878188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:44.469854 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 972/1911] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:44.470566 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cb541-6e2d-4c76-9c5f-cd14aa878188 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:44.470954 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cb541-6e2d-4c76-9c5f-cd14aa878188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:44.471096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efaee8-4e78-4d95-a942-3f82bf2cd751 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:44.471405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cb541-6e2d-4c76-9c5f-cd14aa878188 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:44.472419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792cb541-6e2d-4c76-9c5f-cd14aa878188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:44.474661 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792cb541-6e2d-4c76-9c5f-cd14aa878188 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:44.483892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efaee8-4e78-4d95-a942-3f82bf2cd751 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:44.489949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f9d0d-329b-41d5-abf6-65fdaf39ed11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:44.490520 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f9d0d-329b-41d5-abf6-65fdaf39ed11 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:44.490965 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f9d0d-329b-41d5-abf6-65fdaf39ed11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:44.491245 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f9d0d-329b-41d5-abf6-65fdaf39ed11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:44.491984 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f9d0d-329b-41d5-abf6-65fdaf39ed11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:44.493964 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f9d0d-329b-41d5-abf6-65fdaf39ed11 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:44.510776 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 973/1912] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:44.514393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f9d0d-329b-41d5-abf6-65fdaf39ed11 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:44.526349 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 940/1913] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:44 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:40:44.532043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cb541-6e2d-4c76-9c5f-cd14aa878188 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:44.535209 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f9d0d-329b-41d5-abf6-65fdaf39ed11 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:44.686306 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cb541-6e2d-4c76-9c5f-cd14aa878188 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:44.693946 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c60007-e429-4701-8e15-f22a05dde5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:44.695054 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c60007-e429-4701-8e15-f22a05dde5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:44.695591 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c60007-e429-4701-8e15-f22a05dde5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:44.696157 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c60007-e429-4701-8e15-f22a05dde5f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:44.696496 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776baefd-fd9b-464a-9301-31a3cc235f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:44.697370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c60007-e429-4701-8e15-f22a05dde5f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:44.697487 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776baefd-fd9b-464a-9301-31a3cc235f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:44.697688 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776baefd-fd9b-464a-9301-31a3cc235f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:44.699865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c60007-e429-4701-8e15-f22a05dde5f0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:44.700110 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776baefd-fd9b-464a-9301-31a3cc235f6c admin admin] PATH_INFO: `/v3/projects/b12c0430b0944b7fa2fc2e17f5e39d55/users/2d30d378773c4c3dac805c6c833115fe/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:44.735986 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776baefd-fd9b-464a-9301-31a3cc235f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b12c0430b0944b7fa2fc2e17f5e39d55, user_id=2d30d378773c4c3dac805c6c833115fe, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:44.741661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776baefd-fd9b-464a-9301-31a3cc235f6c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:44.758821 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 941/1914] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:44 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:44.762946 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c60007-e429-4701-8e15-f22a05dde5f0 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:44.773177 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 974/1915] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:44 2022] PUT /identity/v3/projects/b12c0430b0944b7fa2fc2e17f5e39d55/users/2d30d378773c4c3dac805c6c833115fe/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:40:44.785518 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65444e13-5270-4104-9185-b2969f39f163 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:44.785876 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65444e13-5270-4104-9185-b2969f39f163 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:44.786360 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65444e13-5270-4104-9185-b2969f39f163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:44.798897 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c60007-e429-4701-8e15-f22a05dde5f0 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:44.854127 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-65444e13-5270-4104-9185-b2969f39f163 None None] MFA Rules not processed for user `2d30d378773c4c3dac805c6c833115fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:44.855407 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-65444e13-5270-4104-9185-b2969f39f163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:44.860407 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:44.974504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 975/1916] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:44.975853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65444e13-5270-4104-9185-b2969f39f163 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:44.977485 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-65444e13-5270-4104-9185-b2969f39f163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:45.053266 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f0d05-39f2-48e2-8011-9c3fc6fbc966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:45.053983 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f0d05-39f2-48e2-8011-9c3fc6fbc966 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:45.054327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f0d05-39f2-48e2-8011-9c3fc6fbc966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:45.054841 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f0d05-39f2-48e2-8011-9c3fc6fbc966 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:45.056382 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f0d05-39f2-48e2-8011-9c3fc6fbc966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:45.059856 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f0d05-39f2-48e2-8011-9c3fc6fbc966 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:45.072958 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65444e13-5270-4104-9185-b2969f39f163 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:45.076825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0439971-2ffd-4ec8-8b76-830a14fe5ff4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:45.077500 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0439971-2ffd-4ec8-8b76-830a14fe5ff4 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:45.077778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0439971-2ffd-4ec8-8b76-830a14fe5ff4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:45.078192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0439971-2ffd-4ec8-8b76-830a14fe5ff4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:45.088868 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0439971-2ffd-4ec8-8b76-830a14fe5ff4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:45.090491 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0439971-2ffd-4ec8-8b76-830a14fe5ff4 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:45.104998 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 976/1917] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:45.105877 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0439971-2ffd-4ec8-8b76-830a14fe5ff4 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:45.118479 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0439971-2ffd-4ec8-8b76-830a14fe5ff4 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:45.123642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11dfdf7-975b-4191-8e29-7b129fb897c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:45.124538 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dfdf7-975b-4191-8e29-7b129fb897c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:45.125016 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dfdf7-975b-4191-8e29-7b129fb897c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:45.125509 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dfdf7-975b-4191-8e29-7b129fb897c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:45.126394 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11dfdf7-975b-4191-8e29-7b129fb897c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:45.127056 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 942/1918] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:45.128390 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11dfdf7-975b-4191-8e29-7b129fb897c6 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:45.144370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 977/1919] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:45.147816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f0d05-39f2-48e2-8011-9c3fc6fbc966 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:45.170344 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f0d05-39f2-48e2-8011-9c3fc6fbc966 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:45.179337 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e2ae0-52fd-484a-a325-c329e34ed15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:45.180828 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e2ae0-52fd-484a-a325-c329e34ed15f admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:45.180828 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e2ae0-52fd-484a-a325-c329e34ed15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:45.181087 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e2ae0-52fd-484a-a325-c329e34ed15f admin admin] PATH_INFO: `/v3/projects/8ca13e82f91f489c8779e712eefe593d/users/9f18d87fbff947afb272a8159aadb5ae/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:45.205330 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e2ae0-52fd-484a-a325-c329e34ed15f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca13e82f91f489c8779e712eefe593d, user_id=9f18d87fbff947afb272a8159aadb5ae, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:45.209141 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e2ae0-52fd-484a-a325-c329e34ed15f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:45.262997 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 943/1920] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:45 2022] PUT /identity/v3/projects/8ca13e82f91f489c8779e712eefe593d/users/9f18d87fbff947afb272a8159aadb5ae/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:45.264901 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ff198-4f61-440f-a124-a3bf5d6223e0 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:45.265121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ff198-4f61-440f-a124-a3bf5d6223e0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:45.265401 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ff198-4f61-440f-a124-a3bf5d6223e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:45.301727 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-329ff198-4f61-440f-a124-a3bf5d6223e0 None None] MFA Rules not processed for user `9f18d87fbff947afb272a8159aadb5ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:45.303094 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-329ff198-4f61-440f-a124-a3bf5d6223e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:45.351820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e2ae0-52fd-484a-a325-c329e34ed15f admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:45.355232 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f82e2ae0-52fd-484a-a325-c329e34ed15f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:45.480156 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:45.557184 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 978/1921] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:45.571631 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ff198-4f61-440f-a124-a3bf5d6223e0 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:45.573146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-329ff198-4f61-440f-a124-a3bf5d6223e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:45.576872 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e2ae0-52fd-484a-a325-c329e34ed15f admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:45.599289 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95577274-7f70-4961-ac37-348db7226f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:45.599967 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95577274-7f70-4961-ac37-348db7226f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:45.600424 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95577274-7f70-4961-ac37-348db7226f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:45.600701 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95577274-7f70-4961-ac37-348db7226f26 admin admin] PATH_INFO: `/v3/projects/3e9d6bd9b37f47fc80ef419ef4788f6b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:45.605880 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95577274-7f70-4961-ac37-348db7226f26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e9d6bd9b37f47fc80ef419ef4788f6b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:45.611412 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95577274-7f70-4961-ac37-348db7226f26 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:45.665321 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:45.736719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-95577274-7f70-4961-ac37-348db7226f26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e9d6bd9b37f47fc80ef419ef4788f6b', 'request_id': 'req-95577274-7f70-4961-ac37-348db7226f26'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:45.758476 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-95577274-7f70-4961-ac37-348db7226f26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e9d6bd9b37f47fc80ef419ef4788f6b', 'request_id': 'req-95577274-7f70-4961-ac37-348db7226f26'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:45.781425 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-95577274-7f70-4961-ac37-348db7226f26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e9d6bd9b37f47fc80ef419ef4788f6b', 'request_id': 'req-95577274-7f70-4961-ac37-348db7226f26'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:45.800388 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ff198-4f61-440f-a124-a3bf5d6223e0 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:45.831483 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-95577274-7f70-4961-ac37-348db7226f26 admin admin] The token cache is being invalidate because project 3e9d6bd9b37f47fc80ef419ef4788f6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:45.831876 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-95577274-7f70-4961-ac37-348db7226f26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:45.833567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-95577274-7f70-4961-ac37-348db7226f26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:45.841868 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 944/1922] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:45 2022] DELETE /identity/v3/projects/3e9d6bd9b37f47fc80ef419ef4788f6b => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:40:45.843610 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51dfb7-63fc-49e2-8a6f-acb4c48242f2 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:45.844821 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51dfb7-63fc-49e2-8a6f-acb4c48242f2 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:45.845198 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51dfb7-63fc-49e2-8a6f-acb4c48242f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:45.892599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-cb51dfb7-63fc-49e2-8a6f-acb4c48242f2 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:45.900083 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-cb51dfb7-63fc-49e2-8a6f-acb4c48242f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:46.016087 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005aa9d2-ab9c-4772-a7ce-200ff3e63ad6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:46.016760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005aa9d2-ab9c-4772-a7ce-200ff3e63ad6 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:46.019831 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005aa9d2-ab9c-4772-a7ce-200ff3e63ad6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:46.021252 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005aa9d2-ab9c-4772-a7ce-200ff3e63ad6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:46.026059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-005aa9d2-ab9c-4772-a7ce-200ff3e63ad6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:46.048137 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 945/1923] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:46.060900 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c25e7-6469-4a92-b75c-5a42eea49ff8 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:46.061501 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c25e7-6469-4a92-b75c-5a42eea49ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:46.062080 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c25e7-6469-4a92-b75c-5a42eea49ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:46.087946 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-419c25e7-6469-4a92-b75c-5a42eea49ff8 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:46.092338 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-419c25e7-6469-4a92-b75c-5a42eea49ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:46.146186 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 946/1924] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:46.147459 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c25e7-6469-4a92-b75c-5a42eea49ff8 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:46.159337 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005aa9d2-ab9c-4772-a7ce-200ff3e63ad6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:46.161424 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c25e7-6469-4a92-b75c-5a42eea49ff8 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:46.162622 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005aa9d2-ab9c-4772-a7ce-200ff3e63ad6 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:46.165865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e1be0-434d-4966-ad14-d50a890928ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:46.166718 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e1be0-434d-4966-ad14-d50a890928ca admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:46.167001 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e1be0-434d-4966-ad14-d50a890928ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:46.167275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e1be0-434d-4966-ad14-d50a890928ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:46.168002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e1be0-434d-4966-ad14-d50a890928ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:40:46.168307 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e1be0-434d-4966-ad14-d50a890928ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:46.170073 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e1be0-434d-4966-ad14-d50a890928ca admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:46.177270 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 979/1925] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:46.184034 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 947/1926] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:40:46.188653 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005aa9d2-ab9c-4772-a7ce-200ff3e63ad6 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:46.201003 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005aa9d2-ab9c-4772-a7ce-200ff3e63ad6 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:46.205562 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e1be0-434d-4966-ad14-d50a890928ca admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:46.208924 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-982e1be0-434d-4966-ad14-d50a890928ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:46.209387 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c0ed9-c494-4c88-b95d-7480051acb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:46.210087 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c0ed9-c494-4c88-b95d-7480051acb68 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:46.210334 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c0ed9-c494-4c88-b95d-7480051acb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:46.210678 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c0ed9-c494-4c88-b95d-7480051acb68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:46.211372 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c0ed9-c494-4c88-b95d-7480051acb68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:46.214216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c0ed9-c494-4c88-b95d-7480051acb68 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:46.242155 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e1be0-434d-4966-ad14-d50a890928ca admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:46.249500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf7f1d-a685-4bb7-818a-6b4feb692d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:46.250425 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf7f1d-a685-4bb7-818a-6b4feb692d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:46.250751 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf7f1d-a685-4bb7-818a-6b4feb692d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:46.251020 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf7f1d-a685-4bb7-818a-6b4feb692d7d admin admin] PATH_INFO: `/v3/users/9f18d87fbff947afb272a8159aadb5ae` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:46.252321 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf7f1d-a685-4bb7-818a-6b4feb692d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f18d87fbff947afb272a8159aadb5ae)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:46.254835 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf7f1d-a685-4bb7-818a-6b4feb692d7d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:46.266617 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 980/1927] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:46 2022] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:46.267898 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c0ed9-c494-4c88-b95d-7480051acb68 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:46.313380 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:46.322627 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b3cf7f1d-a685-4bb7-818a-6b4feb692d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f18d87fbff947afb272a8159aadb5ae'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:46.335436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b3cf7f1d-a685-4bb7-818a-6b4feb692d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f18d87fbff947afb272a8159aadb5ae'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:46.337259 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b3cf7f1d-a685-4bb7-818a-6b4feb692d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f18d87fbff947afb272a8159aadb5ae'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:46.347231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b3cf7f1d-a685-4bb7-818a-6b4feb692d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f18d87fbff947afb272a8159aadb5ae'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:46.357467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c0ed9-c494-4c88-b95d-7480051acb68 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:46.360787 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b3cf7f1d-a685-4bb7-818a-6b4feb692d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f18d87fbff947afb272a8159aadb5ae'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:46.362483 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04950f-9c1e-458e-9562-a7c29f55dd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:46.363681 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04950f-9c1e-458e-9562-a7c29f55dd20 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:46.364038 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04950f-9c1e-458e-9562-a7c29f55dd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:46.364317 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04950f-9c1e-458e-9562-a7c29f55dd20 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:46.365016 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04950f-9c1e-458e-9562-a7c29f55dd20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:46.367110 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04950f-9c1e-458e-9562-a7c29f55dd20 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:46.369194 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 948/1928] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:46 2022] DELETE /identity/v3/users/9f18d87fbff947afb272a8159aadb5ae => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:46.373535 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93039690-1d39-4dd7-9168-141a9fe5da89 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:46.373824 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93039690-1d39-4dd7-9168-141a9fe5da89 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:46.374095 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93039690-1d39-4dd7-9168-141a9fe5da89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:46.395125 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-93039690-1d39-4dd7-9168-141a9fe5da89 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:46.396646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-93039690-1d39-4dd7-9168-141a9fe5da89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:46.407796 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 981/1929] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:46 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:46.412137 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04950f-9c1e-458e-9562-a7c29f55dd20 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:46.416338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-eb04950f-9c1e-458e-9562-a7c29f55dd20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:46.426679 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:46.437554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04950f-9c1e-458e-9562-a7c29f55dd20 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:46.486506 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 949/1930] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:46.497100 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93039690-1d39-4dd7-9168-141a9fe5da89 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:46.498493 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-93039690-1d39-4dd7-9168-141a9fe5da89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:46.502332 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b48cc-03b4-46b4-afe8-f47eb520d175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:46.503185 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b48cc-03b4-46b4-afe8-f47eb520d175 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:46.503466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b48cc-03b4-46b4-afe8-f47eb520d175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:46.503971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b48cc-03b4-46b4-afe8-f47eb520d175 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:46.504874 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b48cc-03b4-46b4-afe8-f47eb520d175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:46.506490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b48cc-03b4-46b4-afe8-f47eb520d175 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:46.521460 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 982/1931] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:40:46.522715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b48cc-03b4-46b4-afe8-f47eb520d175 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:46.534223 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b48cc-03b4-46b4-afe8-f47eb520d175 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:46.539409 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7d0c8-7ac1-4234-a608-e8e2791945de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:46.540080 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7d0c8-7ac1-4234-a608-e8e2791945de admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:46.540357 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7d0c8-7ac1-4234-a608-e8e2791945de admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:46.540622 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7d0c8-7ac1-4234-a608-e8e2791945de admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:46.541485 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7d0c8-7ac1-4234-a608-e8e2791945de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:46.543130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7d0c8-7ac1-4234-a608-e8e2791945de admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:46.558848 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 983/1932] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:46.559877 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7d0c8-7ac1-4234-a608-e8e2791945de admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:46.570806 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7d0c8-7ac1-4234-a608-e8e2791945de admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:46.573326 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93039690-1d39-4dd7-9168-141a9fe5da89 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:46.575675 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cbbcd-75d7-4faa-8bd8-5f4b5d58fbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:46.576567 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cbbcd-75d7-4faa-8bd8-5f4b5d58fbc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:46.576844 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cbbcd-75d7-4faa-8bd8-5f4b5d58fbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:46.577005 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e1146-7234-4d78-bc57-3401c77612d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:46.577125 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cbbcd-75d7-4faa-8bd8-5f4b5d58fbc6 admin admin] PATH_INFO: `/v3/projects/eda9b02f1c3b426582848e8a111dca39/users/7287533ce5e84411946b10e266f458e9/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:46.577699 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e1146-7234-4d78-bc57-3401c77612d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:46.578071 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e1146-7234-4d78-bc57-3401c77612d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:46.578348 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e1146-7234-4d78-bc57-3401c77612d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:46.587697 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e1146-7234-4d78-bc57-3401c77612d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:46.589146 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e1146-7234-4d78-bc57-3401c77612d1 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:46.592893 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cbbcd-75d7-4faa-8bd8-5f4b5d58fbc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda9b02f1c3b426582848e8a111dca39, user_id=7287533ce5e84411946b10e266f458e9, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:46.595981 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cbbcd-75d7-4faa-8bd8-5f4b5d58fbc6 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:46.600220 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 950/1933] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:40:46.613891 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 984/1934] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:46 2022] PUT /identity/v3/projects/eda9b02f1c3b426582848e8a111dca39/users/7287533ce5e84411946b10e266f458e9/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:46.626324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cd4cc-a8df-4e66-a636-092ac622b578 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:46.626690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cd4cc-a8df-4e66-a636-092ac622b578 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:46.627050 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cd4cc-a8df-4e66-a636-092ac622b578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:46.663951 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-366cd4cc-a8df-4e66-a636-092ac622b578 None None] MFA Rules not processed for user `7287533ce5e84411946b10e266f458e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:46.665341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-366cd4cc-a8df-4e66-a636-092ac622b578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:46.730689 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:46.753248 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 951/1935] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:40:46.759518 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cbbcd-75d7-4faa-8bd8-5f4b5d58fbc6 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:46.853541 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cbbcd-75d7-4faa-8bd8-5f4b5d58fbc6 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:46.860682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f333e04-5157-43f9-b0a6-62569abcd2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:46.861452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f333e04-5157-43f9-b0a6-62569abcd2da admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:46.861803 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f333e04-5157-43f9-b0a6-62569abcd2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:46.862145 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f333e04-5157-43f9-b0a6-62569abcd2da admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:46.862991 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f333e04-5157-43f9-b0a6-62569abcd2da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:46.865617 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f333e04-5157-43f9-b0a6-62569abcd2da admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:46.903368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 985/1936] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:46 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:46.904907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366cd4cc-a8df-4e66-a636-092ac622b578 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:46.913093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f333e04-5157-43f9-b0a6-62569abcd2da admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:46.916980 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3f333e04-5157-43f9-b0a6-62569abcd2da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:46.921122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366cd4cc-a8df-4e66-a636-092ac622b578 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:46.982186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:46.995029 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d616b-5b88-4f66-8cb7-ecdb30799014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:46.995729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d616b-5b88-4f66-8cb7-ecdb30799014 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:46.995940 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d616b-5b88-4f66-8cb7-ecdb30799014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:46.996212 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d616b-5b88-4f66-8cb7-ecdb30799014 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:46.996908 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d616b-5b88-4f66-8cb7-ecdb30799014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:46.997821 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f333e04-5157-43f9-b0a6-62569abcd2da admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:46.998831 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d616b-5b88-4f66-8cb7-ecdb30799014 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:47.003176 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00655d2f-eba7-4058-9068-41abadc1a8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:47.004174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00655d2f-eba7-4058-9068-41abadc1a8b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:47.004513 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00655d2f-eba7-4058-9068-41abadc1a8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:47.004787 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00655d2f-eba7-4058-9068-41abadc1a8b1 admin admin] PATH_INFO: `/v3/projects/8ca13e82f91f489c8779e712eefe593d` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:47.006300 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00655d2f-eba7-4058-9068-41abadc1a8b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ca13e82f91f489c8779e712eefe593d)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:47.008595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00655d2f-eba7-4058-9068-41abadc1a8b1 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:47.028937 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 952/1937] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:46 2022] POST /identity/v3/users => generated 295 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:47.032785 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d616b-5b88-4f66-8cb7-ecdb30799014 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:47.044341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d616b-5b88-4f66-8cb7-ecdb30799014 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:47.048903 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c843a62-d64d-4d76-98c8-2c31d5cbe301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:47.049606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c843a62-d64d-4d76-98c8-2c31d5cbe301 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:47.050072 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c843a62-d64d-4d76-98c8-2c31d5cbe301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:47.050312 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c843a62-d64d-4d76-98c8-2c31d5cbe301 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:47.051199 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c843a62-d64d-4d76-98c8-2c31d5cbe301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:47.052795 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c843a62-d64d-4d76-98c8-2c31d5cbe301 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:47.066097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 953/1938] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:47.067360 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c843a62-d64d-4d76-98c8-2c31d5cbe301 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:47.067866 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-00655d2f-eba7-4058-9068-41abadc1a8b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ca13e82f91f489c8779e712eefe593d', 'request_id': 'req-00655d2f-eba7-4058-9068-41abadc1a8b1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:47.074116 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-00655d2f-eba7-4058-9068-41abadc1a8b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ca13e82f91f489c8779e712eefe593d', 'request_id': 'req-00655d2f-eba7-4058-9068-41abadc1a8b1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:47.078503 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c843a62-d64d-4d76-98c8-2c31d5cbe301 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:47.082498 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-00655d2f-eba7-4058-9068-41abadc1a8b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ca13e82f91f489c8779e712eefe593d', 'request_id': 'req-00655d2f-eba7-4058-9068-41abadc1a8b1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:47.099002 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-00655d2f-eba7-4058-9068-41abadc1a8b1 admin admin] The token cache is being invalidate because project 8ca13e82f91f489c8779e712eefe593d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:47.099611 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-00655d2f-eba7-4058-9068-41abadc1a8b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:47.100418 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-00655d2f-eba7-4058-9068-41abadc1a8b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:47.102241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 986/1939] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:46 2022] DELETE /identity/v3/projects/8ca13e82f91f489c8779e712eefe593d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:40:47.107162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af17b27-e773-47f0-bd25-3789e06e10f6 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:47.107394 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af17b27-e773-47f0-bd25-3789e06e10f6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:47.107680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af17b27-e773-47f0-bd25-3789e06e10f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:47.129681 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-7af17b27-e773-47f0-bd25-3789e06e10f6 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:47.131039 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7af17b27-e773-47f0-bd25-3789e06e10f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:47.146907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba8853-3168-4bb9-a647-ee9f1b6f8461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:47.147816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba8853-3168-4bb9-a647-ee9f1b6f8461 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:47.148096 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba8853-3168-4bb9-a647-ee9f1b6f8461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:47.148396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba8853-3168-4bb9-a647-ee9f1b6f8461 admin admin] PATH_INFO: `/v3/projects/7505b67572e748b48cb7dd3a12f8378c/users/a324efcf4a684d62910c141294fa2875/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:47.166295 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba8853-3168-4bb9-a647-ee9f1b6f8461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7505b67572e748b48cb7dd3a12f8378c, user_id=a324efcf4a684d62910c141294fa2875, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:47.169325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba8853-3168-4bb9-a647-ee9f1b6f8461 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:47.184686 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 954/1940] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:47 2022] PUT /identity/v3/projects/7505b67572e748b48cb7dd3a12f8378c/users/a324efcf4a684d62910c141294fa2875/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:47.188615 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba8853-3168-4bb9-a647-ee9f1b6f8461 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:47.190425 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8aba8853-3168-4bb9-a647-ee9f1b6f8461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:47.200359 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 987/1941] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:40:47.209142 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4bf44-2df6-4737-aebf-c0bd797b1031 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:47.209546 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4bf44-2df6-4737-aebf-c0bd797b1031 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:47.209879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4bf44-2df6-4737-aebf-c0bd797b1031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:47.255592 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:47.264923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-dfc4bf44-2df6-4737-aebf-c0bd797b1031 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:47.266875 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-dfc4bf44-2df6-4737-aebf-c0bd797b1031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:47.270357 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba8853-3168-4bb9-a647-ee9f1b6f8461 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:47.288884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635a7bd-7561-407f-a9d4-9116087aeb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:47.290017 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635a7bd-7561-407f-a9d4-9116087aeb2c admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:47.290326 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635a7bd-7561-407f-a9d4-9116087aeb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:47.290629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635a7bd-7561-407f-a9d4-9116087aeb2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:47.291425 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635a7bd-7561-407f-a9d4-9116087aeb2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:47.293184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635a7bd-7561-407f-a9d4-9116087aeb2c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:47.317914 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 988/1942] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:47.321367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 955/1943] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:40:47.325172 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4bf44-2df6-4737-aebf-c0bd797b1031 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:47.334561 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635a7bd-7561-407f-a9d4-9116087aeb2c admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:47.337345 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4bf44-2df6-4737-aebf-c0bd797b1031 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:47.347873 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69cd79-79fb-4f2e-9e62-32f6fccc5555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:47.349039 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69cd79-79fb-4f2e-9e62-32f6fccc5555 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:47.349481 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69cd79-79fb-4f2e-9e62-32f6fccc5555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:47.350194 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69cd79-79fb-4f2e-9e62-32f6fccc5555 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:47.351255 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69cd79-79fb-4f2e-9e62-32f6fccc5555 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:40:47.351727 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69cd79-79fb-4f2e-9e62-32f6fccc5555 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:47.352066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635a7bd-7561-407f-a9d4-9116087aeb2c admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:47.354111 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69cd79-79fb-4f2e-9e62-32f6fccc5555 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:47.358746 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a1f39-65dd-4fcd-935c-ac667ee244e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:47.359958 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a1f39-65dd-4fcd-935c-ac667ee244e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:47.360666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a1f39-65dd-4fcd-935c-ac667ee244e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:47.360871 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a1f39-65dd-4fcd-935c-ac667ee244e1 admin admin] PATH_INFO: `/v3/projects/7505b67572e748b48cb7dd3a12f8378c/users/a324efcf4a684d62910c141294fa2875/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:47.364204 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a1f39-65dd-4fcd-935c-ac667ee244e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7505b67572e748b48cb7dd3a12f8378c, user_id=a324efcf4a684d62910c141294fa2875, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:47.367187 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a1f39-65dd-4fcd-935c-ac667ee244e1 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:47.373469 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 989/1944] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:40:47.379515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69cd79-79fb-4f2e-9e62-32f6fccc5555 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:47.391223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 956/1945] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:47 2022] PUT /identity/v3/projects/7505b67572e748b48cb7dd3a12f8378c/users/a324efcf4a684d62910c141294fa2875/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:47.393046 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97b524-5a1f-40ed-890a-ca8ac8c9278d None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:47.393726 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97b524-5a1f-40ed-890a-ca8ac8c9278d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:47.393726 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97b524-5a1f-40ed-890a-ca8ac8c9278d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:47.413400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69cd79-79fb-4f2e-9e62-32f6fccc5555 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:47.439820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-6f97b524-5a1f-40ed-890a-ca8ac8c9278d None None] MFA Rules not processed for user `a324efcf4a684d62910c141294fa2875`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:47.441054 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6f97b524-5a1f-40ed-890a-ca8ac8c9278d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:47.511893 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b779a5-1e48-4e9e-9d7b-be6b01c13306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:47.513083 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b779a5-1e48-4e9e-9d7b-be6b01c13306 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:47.513482 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b779a5-1e48-4e9e-9d7b-be6b01c13306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:47.514791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b779a5-1e48-4e9e-9d7b-be6b01c13306 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:47.515704 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b779a5-1e48-4e9e-9d7b-be6b01c13306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:47.518559 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b779a5-1e48-4e9e-9d7b-be6b01c13306 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:47.525971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:47.575386 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 990/1946] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:47 2022] POST /identity/v3/projects => generated 371 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:47.579402 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b779a5-1e48-4e9e-9d7b-be6b01c13306 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:47.591496 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 957/1947] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:47.598769 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97b524-5a1f-40ed-890a-ca8ac8c9278d None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:47.600930 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6f97b524-5a1f-40ed-890a-ca8ac8c9278d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:47.682197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97b524-5a1f-40ed-890a-ca8ac8c9278d None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:47.700334 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b779a5-1e48-4e9e-9d7b-be6b01c13306 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:47.706380 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a8161-b9cb-4184-b4cf-7d77a8b4a7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:47.707906 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a8161-b9cb-4184-b4cf-7d77a8b4a7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:47.708227 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a8161-b9cb-4184-b4cf-7d77a8b4a7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:47.708912 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a8161-b9cb-4184-b4cf-7d77a8b4a7e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:47.709640 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a8161-b9cb-4184-b4cf-7d77a8b4a7e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:47.711919 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a8161-b9cb-4184-b4cf-7d77a8b4a7e6 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:47.739887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c9a3c-a9e8-4074-9952-d7e536e410a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:47.740565 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c9a3c-a9e8-4074-9952-d7e536e410a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:47.740846 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c9a3c-a9e8-4074-9952-d7e536e410a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:47.741128 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c9a3c-a9e8-4074-9952-d7e536e410a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:47.741749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 991/1948] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:47 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:40:47.745573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-782c9a3c-a9e8-4074-9952-d7e536e410a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:47.745751 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a8161-b9cb-4184-b4cf-7d77a8b4a7e6 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:47.756751 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a8161-b9cb-4184-b4cf-7d77a8b4a7e6 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:47.773744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08b565-0523-4e36-bfff-e650fbe5acca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:47.773744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08b565-0523-4e36-bfff-e650fbe5acca admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:47.773744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08b565-0523-4e36-bfff-e650fbe5acca admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:47.773744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08b565-0523-4e36-bfff-e650fbe5acca admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:47.774096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08b565-0523-4e36-bfff-e650fbe5acca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:47.774096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08b565-0523-4e36-bfff-e650fbe5acca admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:47.786834 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:47.787251 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 992/1949] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:47.791190 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08b565-0523-4e36-bfff-e650fbe5acca admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:47.802291 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08b565-0523-4e36-bfff-e650fbe5acca admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:47.807271 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a00101-7a2d-4b89-b06d-cedcd88201ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:47.807943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a00101-7a2d-4b89-b06d-cedcd88201ab admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:47.808220 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a00101-7a2d-4b89-b06d-cedcd88201ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:47.808493 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a00101-7a2d-4b89-b06d-cedcd88201ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:47.809225 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a00101-7a2d-4b89-b06d-cedcd88201ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:47.810856 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a00101-7a2d-4b89-b06d-cedcd88201ab admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:47.817918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c9a3c-a9e8-4074-9952-d7e536e410a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:47.819400 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c9a3c-a9e8-4074-9952-d7e536e410a6 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:47.821959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 993/1950] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:40:47.826511 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a00101-7a2d-4b89-b06d-cedcd88201ab admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:47.828871 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 958/1951] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:40:47.836896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a00101-7a2d-4b89-b06d-cedcd88201ab admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:47.842870 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3e194-1ed3-4c74-ac65-0bebaed2a757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:47.843904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3e194-1ed3-4c74-ac65-0bebaed2a757 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:47.844256 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3e194-1ed3-4c74-ac65-0bebaed2a757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:47.844525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3e194-1ed3-4c74-ac65-0bebaed2a757 admin admin] PATH_INFO: `/v3/projects/9f9eed21fdfa402389d322d474356f74/users/461687e1c4d74d78bac372e6b9b64119/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:47.859586 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3e194-1ed3-4c74-ac65-0bebaed2a757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f9eed21fdfa402389d322d474356f74, user_id=461687e1c4d74d78bac372e6b9b64119, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:47.862263 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3e194-1ed3-4c74-ac65-0bebaed2a757 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:47.888795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 994/1952] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:47 2022] PUT /identity/v3/projects/9f9eed21fdfa402389d322d474356f74/users/461687e1c4d74d78bac372e6b9b64119/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:40:47.890633 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe97d1-fbfd-4b2a-b2f7-6bc7cd03b4fa None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:47.890912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe97d1-fbfd-4b2a-b2f7-6bc7cd03b4fa None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:47.891233 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe97d1-fbfd-4b2a-b2f7-6bc7cd03b4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:47.920010 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-32fe97d1-fbfd-4b2a-b2f7-6bc7cd03b4fa None None] MFA Rules not processed for user `461687e1c4d74d78bac372e6b9b64119`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:47.921234 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-32fe97d1-fbfd-4b2a-b2f7-6bc7cd03b4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:48.010517 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 959/1953] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:48.020191 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3e194-1ed3-4c74-ac65-0bebaed2a757 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:48.022486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-28e3e194-1ed3-4c74-ac65-0bebaed2a757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:48.102129 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3e194-1ed3-4c74-ac65-0bebaed2a757 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:48.107469 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec993b4-bc86-42f0-966a-cdc76f531024 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22df4e0d98e34758963d3b1465a3a377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:48.108621 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec993b4-bc86-42f0-966a-cdc76f531024 service glance] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:48.109082 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec993b4-bc86-42f0-966a-cdc76f531024 service glance] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:48.109738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec993b4-bc86-42f0-966a-cdc76f531024 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:48.121637 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec993b4-bc86-42f0-966a-cdc76f531024 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:48.124756 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec993b4-bc86-42f0-966a-cdc76f531024 service glance] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:48.148562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 995/1954] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:50.750587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe97d1-fbfd-4b2a-b2f7-6bc7cd03b4fa None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:50.752223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-32fe97d1-fbfd-4b2a-b2f7-6bc7cd03b4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:50.816529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe97d1-fbfd-4b2a-b2f7-6bc7cd03b4fa None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:50.820532 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1dd55-2b53-4424-8212-532abe5a61c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:50.821206 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1dd55-2b53-4424-8212-532abe5a61c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:50.821487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1dd55-2b53-4424-8212-532abe5a61c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:50.821760 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1dd55-2b53-4424-8212-532abe5a61c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:50.888377 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1dd55-2b53-4424-8212-532abe5a61c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:50.890043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1dd55-2b53-4424-8212-532abe5a61c4 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:50.901356 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 960/1955] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:57.699131 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a3323-cc8a-421b-a0f2-06b23aa60408 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:57.699706 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a3323-cc8a-421b-a0f2-06b23aa60408 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:57.699706 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a3323-cc8a-421b-a0f2-06b23aa60408 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:57.701295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 996/1956] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 13:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:40:57.748681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012395d6-1fe0-4cf6-ae13-d5ab3b4004d2 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:57.749255 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012395d6-1fe0-4cf6-ae13-d5ab3b4004d2 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:57.749528 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012395d6-1fe0-4cf6-ae13-d5ab3b4004d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:57.777530 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-012395d6-1fe0-4cf6-ae13-d5ab3b4004d2 None None] MFA Rules not processed for user `2f7ea9741a5d409d87b8ebb4390a74ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:57.779679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-012395d6-1fe0-4cf6-ae13-d5ab3b4004d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:57.786016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:57.796995 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a3323-cc8a-421b-a0f2-06b23aa60408 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:57.798851 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-616a3323-cc8a-421b-a0f2-06b23aa60408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:57.850561 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:57.885417 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a3323-cc8a-421b-a0f2-06b23aa60408 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:57.890438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc9647-fc21-4260-82a0-6db806c46425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:57.891684 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc9647-fc21-4260-82a0-6db806c46425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:57.891684 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc9647-fc21-4260-82a0-6db806c46425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:57.892524 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc9647-fc21-4260-82a0-6db806c46425 admin admin] PATH_INFO: `/v3/users/e3a5c3879b064a65b080faf964155c09` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:57.894218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc9647-fc21-4260-82a0-6db806c46425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a5c3879b064a65b080faf964155c09)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:57.896630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc9647-fc21-4260-82a0-6db806c46425 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:57.924598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 961/1957] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 13:40:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:57.949117 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012395d6-1fe0-4cf6-ae13-d5ab3b4004d2 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:57.950976 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-012395d6-1fe0-4cf6-ae13-d5ab3b4004d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:57.971458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cabc9647-fc21-4260-82a0-6db806c46425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a5c3879b064a65b080faf964155c09'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:57.981255 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cabc9647-fc21-4260-82a0-6db806c46425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a5c3879b064a65b080faf964155c09'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:57.982471 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cabc9647-fc21-4260-82a0-6db806c46425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a5c3879b064a65b080faf964155c09'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:57.996432 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012395d6-1fe0-4cf6-ae13-d5ab3b4004d2 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:58.006711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cabc9647-fc21-4260-82a0-6db806c46425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a5c3879b064a65b080faf964155c09'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:58.006711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cabc9647-fc21-4260-82a0-6db806c46425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a5c3879b064a65b080faf964155c09'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:58.013637 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c050ac8-c506-49f0-9420-43b781635750 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f7ea9741a5d409d87b8ebb4390a74ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:58.014604 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c050ac8-c506-49f0-9420-43b781635750 service placement] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:58.015031 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c050ac8-c506-49f0-9420-43b781635750 service placement] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:58.015462 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c050ac8-c506-49f0-9420-43b781635750 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:58.028288 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8c050ac8-c506-49f0-9420-43b781635750 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:58.031418 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 997/1958] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:57 2022] DELETE /identity/v3/users/e3a5c3879b064a65b080faf964155c09 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:40:58.043441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c050ac8-c506-49f0-9420-43b781635750 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:58.045957 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c050ac8-c506-49f0-9420-43b781635750 service placement] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:58.061757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 962/1959] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:58.359067 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc9647-fc21-4260-82a0-6db806c46425 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:58.360847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cabc9647-fc21-4260-82a0-6db806c46425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:58.453548 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc9647-fc21-4260-82a0-6db806c46425 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:58.458700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc37ef5-e737-4afa-8a05-41efe586bb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:58.459977 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc37ef5-e737-4afa-8a05-41efe586bb42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:58.459977 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc37ef5-e737-4afa-8a05-41efe586bb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:58.461907 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc37ef5-e737-4afa-8a05-41efe586bb42 admin admin] PATH_INFO: `/v3/projects/4c456e95a5d34674a02f12f4eb76d2a0` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:58.466189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc37ef5-e737-4afa-8a05-41efe586bb42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c456e95a5d34674a02f12f4eb76d2a0)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:58.468956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc37ef5-e737-4afa-8a05-41efe586bb42 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:58.532265 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-bcc37ef5-e737-4afa-8a05-41efe586bb42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c456e95a5d34674a02f12f4eb76d2a0', 'request_id': 'req-bcc37ef5-e737-4afa-8a05-41efe586bb42'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:58.537043 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:58.539605 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-bcc37ef5-e737-4afa-8a05-41efe586bb42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c456e95a5d34674a02f12f4eb76d2a0', 'request_id': 'req-bcc37ef5-e737-4afa-8a05-41efe586bb42'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:58.550852 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-bcc37ef5-e737-4afa-8a05-41efe586bb42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c456e95a5d34674a02f12f4eb76d2a0', 'request_id': 'req-bcc37ef5-e737-4afa-8a05-41efe586bb42'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:58.579282 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-bcc37ef5-e737-4afa-8a05-41efe586bb42 admin admin] The token cache is being invalidate because project 4c456e95a5d34674a02f12f4eb76d2a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:58.579377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-bcc37ef5-e737-4afa-8a05-41efe586bb42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:58.580113 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-bcc37ef5-e737-4afa-8a05-41efe586bb42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:58.584083 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 998/1960] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:58 2022] DELETE /identity/v3/projects/4c456e95a5d34674a02f12f4eb76d2a0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:58.590835 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799e5c2-aa59-4ef7-b781-259cbb10246b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:58.591420 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799e5c2-aa59-4ef7-b781-259cbb10246b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:58.591764 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799e5c2-aa59-4ef7-b781-259cbb10246b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:58.612014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-b799e5c2-aa59-4ef7-b781-259cbb10246b None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:58.613354 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b799e5c2-aa59-4ef7-b781-259cbb10246b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:58.696990 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 963/1961] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:58.705068 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8f0a1-f7bc-4be3-85e4-d72a4d3d661f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:58.705609 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8f0a1-f7bc-4be3-85e4-d72a4d3d661f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:58.705609 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8f0a1-f7bc-4be3-85e4-d72a4d3d661f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:58.726196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c9a8f0a1-f7bc-4be3-85e4-d72a4d3d661f None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:58.727691 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c9a8f0a1-f7bc-4be3-85e4-d72a4d3d661f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:58.735605 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 999/1962] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:58.740239 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799e5c2-aa59-4ef7-b781-259cbb10246b None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:58.750210 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799e5c2-aa59-4ef7-b781-259cbb10246b None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:58.754980 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501eece-5b4b-4867-b7a2-55d638239fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:58.755660 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501eece-5b4b-4867-b7a2-55d638239fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:58.755936 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501eece-5b4b-4867-b7a2-55d638239fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:58.756203 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501eece-5b4b-4867-b7a2-55d638239fd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:58.756930 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501eece-5b4b-4867-b7a2-55d638239fd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:40:58.757232 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501eece-5b4b-4867-b7a2-55d638239fd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:58.758854 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501eece-5b4b-4867-b7a2-55d638239fd8 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:58.775332 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 964/1963] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:40:58.777060 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8f0a1-f7bc-4be3-85e4-d72a4d3d661f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:58.788510 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8f0a1-f7bc-4be3-85e4-d72a4d3d661f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:58.793638 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68b3f0-09db-40b2-b78e-eb37df1900dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:58.794451 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68b3f0-09db-40b2-b78e-eb37df1900dc admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:58.794821 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68b3f0-09db-40b2-b78e-eb37df1900dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:58.795156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68b3f0-09db-40b2-b78e-eb37df1900dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:58.795921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68b3f0-09db-40b2-b78e-eb37df1900dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:58.798380 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68b3f0-09db-40b2-b78e-eb37df1900dc admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:58.832809 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1000/1964] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:58 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:40:58.838186 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501eece-5b4b-4867-b7a2-55d638239fd8 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:58.850308 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501eece-5b4b-4867-b7a2-55d638239fd8 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:58.925122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5bc44-e6fa-4094-aa70-b5cc612bb401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:58.925885 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5bc44-e6fa-4094-aa70-b5cc612bb401 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:58.926164 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5bc44-e6fa-4094-aa70-b5cc612bb401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:58.926430 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5bc44-e6fa-4094-aa70-b5cc612bb401 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:58.927163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5bc44-e6fa-4094-aa70-b5cc612bb401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:58.930895 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5bc44-e6fa-4094-aa70-b5cc612bb401 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:58.963058 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 965/1965] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:58 2022] POST /identity/v3/users => generated 291 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:58.963465 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68b3f0-09db-40b2-b78e-eb37df1900dc admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:58.976793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68b3f0-09db-40b2-b78e-eb37df1900dc admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:58.987516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9895ce-8fbc-41b2-a3ef-f6a444bb415a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:58.991919 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9895ce-8fbc-41b2-a3ef-f6a444bb415a admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:58.992233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9895ce-8fbc-41b2-a3ef-f6a444bb415a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:58.992481 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9895ce-8fbc-41b2-a3ef-f6a444bb415a admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:58.993329 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9895ce-8fbc-41b2-a3ef-f6a444bb415a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:58.995022 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9895ce-8fbc-41b2-a3ef-f6a444bb415a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:59.009455 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1001/1966] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:59.013244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5bc44-e6fa-4094-aa70-b5cc612bb401 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:59.028402 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5bc44-e6fa-4094-aa70-b5cc612bb401 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:59.033881 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27ffda-bf73-472a-8ef6-077c42216d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:59.034590 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27ffda-bf73-472a-8ef6-077c42216d3d admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:59.035224 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27ffda-bf73-472a-8ef6-077c42216d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:59.035738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27ffda-bf73-472a-8ef6-077c42216d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:59.036605 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27ffda-bf73-472a-8ef6-077c42216d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:59.044446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27ffda-bf73-472a-8ef6-077c42216d3d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:59.050632 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:59.061056 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 966/1967] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:59.065691 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9895ce-8fbc-41b2-a3ef-f6a444bb415a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:59.076493 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9895ce-8fbc-41b2-a3ef-f6a444bb415a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:59.081762 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f84746-40c4-4a2d-852f-d5bfc1e08f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:59.082985 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f84746-40c4-4a2d-852f-d5bfc1e08f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:59.083428 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f84746-40c4-4a2d-852f-d5bfc1e08f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:59.083972 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f84746-40c4-4a2d-852f-d5bfc1e08f0d admin admin] PATH_INFO: `/v3/projects/cfee968569d644a18d3f176e50dbf6d4/users/905b0a36b614458480311e12987ab5fc/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:59.111035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f84746-40c4-4a2d-852f-d5bfc1e08f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfee968569d644a18d3f176e50dbf6d4, user_id=905b0a36b614458480311e12987ab5fc, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:59.113792 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f84746-40c4-4a2d-852f-d5bfc1e08f0d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:59.114051 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27ffda-bf73-472a-8ef6-077c42216d3d admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:59.116116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3f27ffda-bf73-472a-8ef6-077c42216d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:59.130749 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27ffda-bf73-472a-8ef6-077c42216d3d admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:59.134844 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1002/1968] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:59 2022] PUT /identity/v3/projects/cfee968569d644a18d3f176e50dbf6d4/users/905b0a36b614458480311e12987ab5fc/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:59.159563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5de5e-a1cd-4d3f-b550-476b32aa1a13 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:59.166789 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5de5e-a1cd-4d3f-b550-476b32aa1a13 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:59.169969 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5de5e-a1cd-4d3f-b550-476b32aa1a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:59.210184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f5b6c-6147-4b43-be19-214d56596b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:59.211338 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f5b6c-6147-4b43-be19-214d56596b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:59.211338 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f5b6c-6147-4b43-be19-214d56596b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:59.211604 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f5b6c-6147-4b43-be19-214d56596b12 admin admin] PATH_INFO: `/v3/users/2d30d378773c4c3dac805c6c833115fe` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:59.212745 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f5b6c-6147-4b43-be19-214d56596b12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d30d378773c4c3dac805c6c833115fe)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:59.214735 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f5b6c-6147-4b43-be19-214d56596b12 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:59.222326 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a7f5de5e-a1cd-4d3f-b550-476b32aa1a13 None None] MFA Rules not processed for user `905b0a36b614458480311e12987ab5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:59.223828 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a7f5de5e-a1cd-4d3f-b550-476b32aa1a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:59.282027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-499f5b6c-6147-4b43-be19-214d56596b12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d30d378773c4c3dac805c6c833115fe'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:59.297456 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-499f5b6c-6147-4b43-be19-214d56596b12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d30d378773c4c3dac805c6c833115fe'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:59.298193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-499f5b6c-6147-4b43-be19-214d56596b12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d30d378773c4c3dac805c6c833115fe'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:59.312534 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-499f5b6c-6147-4b43-be19-214d56596b12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d30d378773c4c3dac805c6c833115fe'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:59.331124 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1003/1969] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:59.332843 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5de5e-a1cd-4d3f-b550-476b32aa1a13 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:59.335173 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a7f5de5e-a1cd-4d3f-b550-476b32aa1a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:59.351932 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5de5e-a1cd-4d3f-b550-476b32aa1a13 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:59.357740 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-499f5b6c-6147-4b43-be19-214d56596b12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d30d378773c4c3dac805c6c833115fe'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:59.361590 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7466b13-1a11-4ba4-b2b3-70824ade2b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:59.362016 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7466b13-1a11-4ba4-b2b3-70824ade2b9c admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:59.362298 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7466b13-1a11-4ba4-b2b3-70824ade2b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:59.362591 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7466b13-1a11-4ba4-b2b3-70824ade2b9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:59.363376 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7466b13-1a11-4ba4-b2b3-70824ade2b9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:59.365348 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7466b13-1a11-4ba4-b2b3-70824ade2b9c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:59.373844 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 967/1970] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:59 2022] DELETE /identity/v3/users/2d30d378773c4c3dac805c6c833115fe => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:59.378969 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d2bf4-92bb-43cd-a9b8-a348e904c74b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:59.379712 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d2bf4-92bb-43cd-a9b8-a348e904c74b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:59.379900 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d2bf4-92bb-43cd-a9b8-a348e904c74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:59.408143 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-7a3d2bf4-92bb-43cd-a9b8-a348e904c74b None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:59.409413 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7a3d2bf4-92bb-43cd-a9b8-a348e904c74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:59.428242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1004/1971] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:59 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:59.433009 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7466b13-1a11-4ba4-b2b3-70824ade2b9c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:59.545953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:59.548940 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 968/1972] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:40:59.567748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7466b13-1a11-4ba4-b2b3-70824ade2b9c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:59.568557 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d2bf4-92bb-43cd-a9b8-a348e904c74b None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:59.578344 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7a3d2bf4-92bb-43cd-a9b8-a348e904c74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:59.610267 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac08ec0-e4d7-4274-aed4-406181daeb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:59.611013 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:59.611181 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac08ec0-e4d7-4274-aed4-406181daeb6f admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:59.611396 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac08ec0-e4d7-4274-aed4-406181daeb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:59.611673 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac08ec0-e4d7-4274-aed4-406181daeb6f admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:59.612409 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac08ec0-e4d7-4274-aed4-406181daeb6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:59.615296 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac08ec0-e4d7-4274-aed4-406181daeb6f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:59.668908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1005/1973] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:59 2022] POST /identity/v3/users => generated 297 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:59.672570 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac08ec0-e4d7-4274-aed4-406181daeb6f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:59.681333 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d2bf4-92bb-43cd-a9b8-a348e904c74b None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:59.689177 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac08ec0-e4d7-4274-aed4-406181daeb6f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:59.694673 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a197e0c-4f59-45f2-9b56-88ba81e75046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:59.695669 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a197e0c-4f59-45f2-9b56-88ba81e75046 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:59.695949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a197e0c-4f59-45f2-9b56-88ba81e75046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:59.696216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a197e0c-4f59-45f2-9b56-88ba81e75046 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:59.696945 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a197e0c-4f59-45f2-9b56-88ba81e75046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:59.698601 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a197e0c-4f59-45f2-9b56-88ba81e75046 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:59.711429 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1006/1974] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:59.716088 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a197e0c-4f59-45f2-9b56-88ba81e75046 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:59.726995 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a197e0c-4f59-45f2-9b56-88ba81e75046 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:59.732798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90399a-539e-4bf1-97c4-c697ba0ce5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:59.734020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90399a-539e-4bf1-97c4-c697ba0ce5df admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:59.734362 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90399a-539e-4bf1-97c4-c697ba0ce5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:59.734752 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90399a-539e-4bf1-97c4-c697ba0ce5df admin admin] PATH_INFO: `/v3/projects/e45410bacf4e4fb5baa938651643aa38/users/36cb1a932aa44ccda5ffaff3b87d8451/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:59.737394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ad6cf-3dac-4bd3-a6a2-bed30fa41fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:59.738285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ad6cf-3dac-4bd3-a6a2-bed30fa41fde service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:59.738802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ad6cf-3dac-4bd3-a6a2-bed30fa41fde service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:59.739185 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ad6cf-3dac-4bd3-a6a2-bed30fa41fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:59.751309 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ad6cf-3dac-4bd3-a6a2-bed30fa41fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:59.751940 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90399a-539e-4bf1-97c4-c697ba0ce5df admin admin] RBAC: Authorizing `identity:create_grant(project_id=e45410bacf4e4fb5baa938651643aa38, user_id=36cb1a932aa44ccda5ffaff3b87d8451, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:59.752926 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ad6cf-3dac-4bd3-a6a2-bed30fa41fde service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:59.754712 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90399a-539e-4bf1-97c4-c697ba0ce5df admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:59.764888 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 969/1975] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:59.770929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1007/1976] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:59 2022] PUT /identity/v3/projects/e45410bacf4e4fb5baa938651643aa38/users/36cb1a932aa44ccda5ffaff3b87d8451/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:59.775708 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ad6cf-3dac-4bd3-a6a2-bed30fa41fde service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:59.787834 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ad6cf-3dac-4bd3-a6a2-bed30fa41fde service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:59.852431 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd0a38-b6f2-4d1f-8b0c-1172a4f83043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:59.853044 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd0a38-b6f2-4d1f-8b0c-1172a4f83043 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:59.853325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd0a38-b6f2-4d1f-8b0c-1172a4f83043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:59.853612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd0a38-b6f2-4d1f-8b0c-1172a4f83043 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:59.854370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd0a38-b6f2-4d1f-8b0c-1172a4f83043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:59.856061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd0a38-b6f2-4d1f-8b0c-1172a4f83043 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:59.869796 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 970/1977] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:59.872894 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90399a-539e-4bf1-97c4-c697ba0ce5df admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:59.884587 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90399a-539e-4bf1-97c4-c697ba0ce5df admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:59.889671 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739291a8-ea70-493a-9123-1d626bf3f902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:59.890652 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739291a8-ea70-493a-9123-1d626bf3f902 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:59.890934 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739291a8-ea70-493a-9123-1d626bf3f902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:59.891233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739291a8-ea70-493a-9123-1d626bf3f902 admin admin] PATH_INFO: `/v3/projects/e45410bacf4e4fb5baa938651643aa38/users/36cb1a932aa44ccda5ffaff3b87d8451/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:59.893298 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739291a8-ea70-493a-9123-1d626bf3f902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e45410bacf4e4fb5baa938651643aa38, user_id=36cb1a932aa44ccda5ffaff3b87d8451, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:59.896589 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739291a8-ea70-493a-9123-1d626bf3f902 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:59.908492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1008/1978] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:59 2022] PUT /identity/v3/projects/e45410bacf4e4fb5baa938651643aa38/users/36cb1a932aa44ccda5ffaff3b87d8451/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:59.923922 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319624b-8b00-4cb1-ba71-8d6aa601fe88 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:59.924047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319624b-8b00-4cb1-ba71-8d6aa601fe88 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:59.924437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319624b-8b00-4cb1-ba71-8d6aa601fe88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:59.954630 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-c319624b-8b00-4cb1-ba71-8d6aa601fe88 None None] MFA Rules not processed for user `36cb1a932aa44ccda5ffaff3b87d8451`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:59.955893 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c319624b-8b00-4cb1-ba71-8d6aa601fe88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:00.026657 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:00.030996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 971/1979] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:40:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:00.042844 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739291a8-ea70-493a-9123-1d626bf3f902 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:00.044621 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-739291a8-ea70-493a-9123-1d626bf3f902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:00.061973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319624b-8b00-4cb1-ba71-8d6aa601fe88 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:00.067802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c319624b-8b00-4cb1-ba71-8d6aa601fe88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:00.124138 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739291a8-ea70-493a-9123-1d626bf3f902 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:00.127827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f55869-1e86-46e2-b38a-8e35c1bc3c31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:00.128522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f55869-1e86-46e2-b38a-8e35c1bc3c31 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:00.128980 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f55869-1e86-46e2-b38a-8e35c1bc3c31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:00.129274 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f55869-1e86-46e2-b38a-8e35c1bc3c31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:00.145240 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f55869-1e86-46e2-b38a-8e35c1bc3c31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:00.148312 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f55869-1e86-46e2-b38a-8e35c1bc3c31 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:00.148457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319624b-8b00-4cb1-ba71-8d6aa601fe88 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:00.153082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cbc77-3eb6-47ab-988a-3135bcd444c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:00.154024 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cbc77-3eb6-47ab-988a-3135bcd444c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:00.154369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cbc77-3eb6-47ab-988a-3135bcd444c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:00.154799 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cbc77-3eb6-47ab-988a-3135bcd444c1 admin admin] PATH_INFO: `/v3/projects/b12c0430b0944b7fa2fc2e17f5e39d55` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:00.156078 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cbc77-3eb6-47ab-988a-3135bcd444c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b12c0430b0944b7fa2fc2e17f5e39d55)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:00.158204 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cbc77-3eb6-47ab-988a-3135bcd444c1 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:00.159318 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1009/1980] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:00.206794 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-038cbc77-3eb6-47ab-988a-3135bcd444c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b12c0430b0944b7fa2fc2e17f5e39d55', 'request_id': 'req-038cbc77-3eb6-47ab-988a-3135bcd444c1'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:00.212851 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-038cbc77-3eb6-47ab-988a-3135bcd444c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b12c0430b0944b7fa2fc2e17f5e39d55', 'request_id': 'req-038cbc77-3eb6-47ab-988a-3135bcd444c1'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:00.219588 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-038cbc77-3eb6-47ab-988a-3135bcd444c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b12c0430b0944b7fa2fc2e17f5e39d55', 'request_id': 'req-038cbc77-3eb6-47ab-988a-3135bcd444c1'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:00.235035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f55869-1e86-46e2-b38a-8e35c1bc3c31 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:00.241470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-038cbc77-3eb6-47ab-988a-3135bcd444c1 admin admin] The token cache is being invalidate because project b12c0430b0944b7fa2fc2e17f5e39d55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:41:00.241767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-038cbc77-3eb6-47ab-988a-3135bcd444c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:00.242478 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-038cbc77-3eb6-47ab-988a-3135bcd444c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:00.244149 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 972/1981] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:41:00 2022] DELETE /identity/v3/projects/b12c0430b0944b7fa2fc2e17f5e39d55 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:00.249015 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f55869-1e86-46e2-b38a-8e35c1bc3c31 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:00.249233 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83c580-3d0e-47fc-896e-77eba3d17828 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:00.251779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83c580-3d0e-47fc-896e-77eba3d17828 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:00.252051 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83c580-3d0e-47fc-896e-77eba3d17828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:00.271328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-6e83c580-3d0e-47fc-896e-77eba3d17828 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:00.272615 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6e83c580-3d0e-47fc-896e-77eba3d17828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:00.298417 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ff2a1-3301-422c-adf8-54c7394ce5d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:00.299097 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ff2a1-3301-422c-adf8-54c7394ce5d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:00.299403 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ff2a1-3301-422c-adf8-54c7394ce5d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:00.299784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ff2a1-3301-422c-adf8-54c7394ce5d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:00.301972 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-572ff2a1-3301-422c-adf8-54c7394ce5d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:00.335108 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 973/1982] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:41:00.342842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5eaaa-ee30-4f79-96c3-289ed6f607e6 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:00.343173 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5eaaa-ee30-4f79-96c3-289ed6f607e6 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:00.343450 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5eaaa-ee30-4f79-96c3-289ed6f607e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:00.351611 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:00.361344 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-78e5eaaa-ee30-4f79-96c3-289ed6f607e6 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:00.362543 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-78e5eaaa-ee30-4f79-96c3-289ed6f607e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:00.366677 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ff2a1-3301-422c-adf8-54c7394ce5d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:00.368115 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ff2a1-3301-422c-adf8-54c7394ce5d8 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:00.370678 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 974/1983] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:41:00.374845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5eaaa-ee30-4f79-96c3-289ed6f607e6 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:00.377188 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1010/1984] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:00.384598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5eaaa-ee30-4f79-96c3-289ed6f607e6 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:00.390143 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a34da9-fb77-4b18-9e81-9b8cf775eb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:00.391012 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a34da9-fb77-4b18-9e81-9b8cf775eb09 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:00.391347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a34da9-fb77-4b18-9e81-9b8cf775eb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:00.391636 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a34da9-fb77-4b18-9e81-9b8cf775eb09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:00.392336 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a34da9-fb77-4b18-9e81-9b8cf775eb09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:41:00.392631 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a34da9-fb77-4b18-9e81-9b8cf775eb09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:00.394790 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a34da9-fb77-4b18-9e81-9b8cf775eb09 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:00.410621 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 975/1985] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:41:00.412835 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ff2a1-3301-422c-adf8-54c7394ce5d8 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:00.425525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ff2a1-3301-422c-adf8-54c7394ce5d8 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:00.430362 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd816fbe-35bc-4560-8ac1-9d440f0bca2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:00.431084 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd816fbe-35bc-4560-8ac1-9d440f0bca2c admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:00.431361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd816fbe-35bc-4560-8ac1-9d440f0bca2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:00.431628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd816fbe-35bc-4560-8ac1-9d440f0bca2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:00.432389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd816fbe-35bc-4560-8ac1-9d440f0bca2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:00.434391 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd816fbe-35bc-4560-8ac1-9d440f0bca2c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:00.465070 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1011/1986] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:41:00 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:41:00.471331 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a34da9-fb77-4b18-9e81-9b8cf775eb09 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:00.482654 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a34da9-fb77-4b18-9e81-9b8cf775eb09 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:00.491193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:00.551050 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983b8a8-cb04-413b-8f13-a9cac8d725ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:00.551808 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983b8a8-cb04-413b-8f13-a9cac8d725ef admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:00.552086 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983b8a8-cb04-413b-8f13-a9cac8d725ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:00.552356 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983b8a8-cb04-413b-8f13-a9cac8d725ef admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:00.553062 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983b8a8-cb04-413b-8f13-a9cac8d725ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:00.555094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983b8a8-cb04-413b-8f13-a9cac8d725ef admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:00.576003 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 976/1987] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:41:00 2022] POST /identity/v3/users => generated 286 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:41:00.580178 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd816fbe-35bc-4560-8ac1-9d440f0bca2c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:00.592120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd816fbe-35bc-4560-8ac1-9d440f0bca2c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:00.596726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbd7a9-8cae-4d59-ae6a-225f659cedd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:00.597558 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbd7a9-8cae-4d59-ae6a-225f659cedd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:00.599006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbd7a9-8cae-4d59-ae6a-225f659cedd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:00.599299 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbd7a9-8cae-4d59-ae6a-225f659cedd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:00.600012 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbd7a9-8cae-4d59-ae6a-225f659cedd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:00.601669 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbd7a9-8cae-4d59-ae6a-225f659cedd3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:00.612568 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1012/1988] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:41:00.616717 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983b8a8-cb04-413b-8f13-a9cac8d725ef admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:00.627814 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983b8a8-cb04-413b-8f13-a9cac8d725ef admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:00.632983 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c1e7c-03ae-445d-ae3f-b4e91923e2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:00.633663 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c1e7c-03ae-445d-ae3f-b4e91923e2ae admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:00.633966 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c1e7c-03ae-445d-ae3f-b4e91923e2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:00.634241 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c1e7c-03ae-445d-ae3f-b4e91923e2ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:00.635017 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c1e7c-03ae-445d-ae3f-b4e91923e2ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:00.637492 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c1e7c-03ae-445d-ae3f-b4e91923e2ae admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:00.650827 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 977/1989] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:41:00.655368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbd7a9-8cae-4d59-ae6a-225f659cedd3 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:00.666065 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbd7a9-8cae-4d59-ae6a-225f659cedd3 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:00.670957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dddd61-8134-4335-9865-2dc6870e857f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:00.671863 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dddd61-8134-4335-9865-2dc6870e857f admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:00.672273 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dddd61-8134-4335-9865-2dc6870e857f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:00.672557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dddd61-8134-4335-9865-2dc6870e857f admin admin] PATH_INFO: `/v3/projects/98592f6c58c14eb9b1e77255235cfedb/users/956843b989184396a3bfb844f18fd5ff/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:00.691625 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dddd61-8134-4335-9865-2dc6870e857f admin admin] RBAC: Authorizing `identity:create_grant(project_id=98592f6c58c14eb9b1e77255235cfedb, user_id=956843b989184396a3bfb844f18fd5ff, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:00.694516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dddd61-8134-4335-9865-2dc6870e857f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:00.718655 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1013/1990] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:41:00 2022] PUT /identity/v3/projects/98592f6c58c14eb9b1e77255235cfedb/users/956843b989184396a3bfb844f18fd5ff/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:41:00.725871 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba13f1-fc1d-4fc7-bf8a-5a71237456c1 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:00.726175 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba13f1-fc1d-4fc7-bf8a-5a71237456c1 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:00.726437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba13f1-fc1d-4fc7-bf8a-5a71237456c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:00.764102 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-8aba13f1-fc1d-4fc7-bf8a-5a71237456c1 None None] MFA Rules not processed for user `956843b989184396a3bfb844f18fd5ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:00.765908 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8aba13f1-fc1d-4fc7-bf8a-5a71237456c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:00.845476 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 978/1991] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:41:00.856871 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dddd61-8134-4335-9865-2dc6870e857f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:00.858766 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-04dddd61-8134-4335-9865-2dc6870e857f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:00.915099 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dddd61-8134-4335-9865-2dc6870e857f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:00.919021 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa0dca-a747-49a5-b0da-50af929a067b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:00.919671 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa0dca-a747-49a5-b0da-50af929a067b service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:00.919947 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa0dca-a747-49a5-b0da-50af929a067b service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:00.920221 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa0dca-a747-49a5-b0da-50af929a067b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:00.928642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa0dca-a747-49a5-b0da-50af929a067b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:00.930067 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa0dca-a747-49a5-b0da-50af929a067b service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:00.938747 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1014/1992] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:00.963838 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba13f1-fc1d-4fc7-bf8a-5a71237456c1 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:01.033075 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba13f1-fc1d-4fc7-bf8a-5a71237456c1 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:01.038435 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06d8fa-c755-4c7c-915f-cbe32a4dd760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:01.039364 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06d8fa-c755-4c7c-915f-cbe32a4dd760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:01.039648 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06d8fa-c755-4c7c-915f-cbe32a4dd760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:01.039916 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06d8fa-c755-4c7c-915f-cbe32a4dd760 admin admin] PATH_INFO: `/v3/users/956843b989184396a3bfb844f18fd5ff` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:01.041146 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06d8fa-c755-4c7c-915f-cbe32a4dd760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=956843b989184396a3bfb844f18fd5ff)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:01.043089 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06d8fa-c755-4c7c-915f-cbe32a4dd760 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:01.065050 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:01.094789 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2b06d8fa-c755-4c7c-915f-cbe32a4dd760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '956843b989184396a3bfb844f18fd5ff'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:01.102679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2b06d8fa-c755-4c7c-915f-cbe32a4dd760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '956843b989184396a3bfb844f18fd5ff'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:01.103319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2b06d8fa-c755-4c7c-915f-cbe32a4dd760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '956843b989184396a3bfb844f18fd5ff'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:01.110925 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2b06d8fa-c755-4c7c-915f-cbe32a4dd760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '956843b989184396a3bfb844f18fd5ff'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:01.124703 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2b06d8fa-c755-4c7c-915f-cbe32a4dd760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '956843b989184396a3bfb844f18fd5ff'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:01.131362 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 979/1993] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:41:00 2022] DELETE /identity/v3/users/956843b989184396a3bfb844f18fd5ff => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:01.136185 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef41983-26ca-44dc-b7e2-f6a0d5379c66 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:01.143045 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef41983-26ca-44dc-b7e2-f6a0d5379c66 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:01.143308 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef41983-26ca-44dc-b7e2-f6a0d5379c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:01.166353 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-fef41983-26ca-44dc-b7e2-f6a0d5379c66 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:01.167498 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fef41983-26ca-44dc-b7e2-f6a0d5379c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:01.229596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1015/1994] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:01.241489 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06d8fa-c755-4c7c-915f-cbe32a4dd760 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:01.243054 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2b06d8fa-c755-4c7c-915f-cbe32a4dd760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:01.305217 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06d8fa-c755-4c7c-915f-cbe32a4dd760 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:01.309757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145a55d-3e25-422f-bb68-7f02d60d76d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:01.310427 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145a55d-3e25-422f-bb68-7f02d60d76d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:01.310735 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145a55d-3e25-422f-bb68-7f02d60d76d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:01.311065 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145a55d-3e25-422f-bb68-7f02d60d76d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:01.320909 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145a55d-3e25-422f-bb68-7f02d60d76d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:01.322343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145a55d-3e25-422f-bb68-7f02d60d76d4 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:01.332258 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 980/1995] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:01.622899 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef41983-26ca-44dc-b7e2-f6a0d5379c66 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:01.624712 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fef41983-26ca-44dc-b7e2-f6a0d5379c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:01.642630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef41983-26ca-44dc-b7e2-f6a0d5379c66 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:01.650523 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c05b4-a30e-436e-abb6-b20df601373e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:01.651352 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c05b4-a30e-436e-abb6-b20df601373e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:01.651644 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c05b4-a30e-436e-abb6-b20df601373e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:01.651948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c05b4-a30e-436e-abb6-b20df601373e admin admin] PATH_INFO: `/v3/projects/98592f6c58c14eb9b1e77255235cfedb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:01.653938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c05b4-a30e-436e-abb6-b20df601373e admin admin] RBAC: Authorizing `identity:delete_project(project_id=98592f6c58c14eb9b1e77255235cfedb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:01.656246 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c05b4-a30e-436e-abb6-b20df601373e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:01.696695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:01.715433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a12c05b4-a30e-436e-abb6-b20df601373e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98592f6c58c14eb9b1e77255235cfedb', 'request_id': 'req-a12c05b4-a30e-436e-abb6-b20df601373e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:01.720898 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a12c05b4-a30e-436e-abb6-b20df601373e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98592f6c58c14eb9b1e77255235cfedb', 'request_id': 'req-a12c05b4-a30e-436e-abb6-b20df601373e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:01.728191 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a12c05b4-a30e-436e-abb6-b20df601373e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98592f6c58c14eb9b1e77255235cfedb', 'request_id': 'req-a12c05b4-a30e-436e-abb6-b20df601373e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:01.744378 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a12c05b4-a30e-436e-abb6-b20df601373e admin admin] The token cache is being invalidate because project 98592f6c58c14eb9b1e77255235cfedb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:41:01.744680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a12c05b4-a30e-436e-abb6-b20df601373e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:01.745320 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a12c05b4-a30e-436e-abb6-b20df601373e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:01.746967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1016/1996] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:41:01 2022] DELETE /identity/v3/projects/98592f6c58c14eb9b1e77255235cfedb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:01.752376 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad5c7f-87f1-441a-8116-e96be3700b97 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:01.752707 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad5c7f-87f1-441a-8116-e96be3700b97 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:01.753041 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad5c7f-87f1-441a-8116-e96be3700b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:01.776317 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-8aad5c7f-87f1-441a-8116-e96be3700b97 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:01.777699 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8aad5c7f-87f1-441a-8116-e96be3700b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:01.865941 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 981/1997] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:41:01.873548 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d5608-c647-46c1-a45c-a7b0f5fc31f0 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:01.873835 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d5608-c647-46c1-a45c-a7b0f5fc31f0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:01.874409 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d5608-c647-46c1-a45c-a7b0f5fc31f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:01.909619 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8e3d5608-c647-46c1-a45c-a7b0f5fc31f0 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:01.912353 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8e3d5608-c647-46c1-a45c-a7b0f5fc31f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:01.923024 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1017/1998] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:01.927723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad5c7f-87f1-441a-8116-e96be3700b97 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:01.952077 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad5c7f-87f1-441a-8116-e96be3700b97 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:01.959584 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f6744-bb90-4206-bf0c-d0d64f98a18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:01.960383 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f6744-bb90-4206-bf0c-d0d64f98a18c admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:01.960765 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f6744-bb90-4206-bf0c-d0d64f98a18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:01.961141 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f6744-bb90-4206-bf0c-d0d64f98a18c admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:01.962826 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f6744-bb90-4206-bf0c-d0d64f98a18c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:41:01.963257 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f6744-bb90-4206-bf0c-d0d64f98a18c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:01.964970 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f6744-bb90-4206-bf0c-d0d64f98a18c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:01.984084 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 982/1999] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:41:01.988144 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d5608-c647-46c1-a45c-a7b0f5fc31f0 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:01.998175 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d5608-c647-46c1-a45c-a7b0f5fc31f0 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:02.015335 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dea7cc-10ef-45b3-8dd7-cc2d8a943217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:02.016027 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dea7cc-10ef-45b3-8dd7-cc2d8a943217 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:02.016309 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dea7cc-10ef-45b3-8dd7-cc2d8a943217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:02.016571 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dea7cc-10ef-45b3-8dd7-cc2d8a943217 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:02.017271 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dea7cc-10ef-45b3-8dd7-cc2d8a943217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:02.019679 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dea7cc-10ef-45b3-8dd7-cc2d8a943217 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:02.093291 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1018/2000] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:41:01 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:41:02.096014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f6744-bb90-4206-bf0c-d0d64f98a18c admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:02.107134 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f6744-bb90-4206-bf0c-d0d64f98a18c admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:02.136180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:02.173574 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c8154-be28-465d-b41f-2d8c6f9150d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:02.174265 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c8154-be28-465d-b41f-2d8c6f9150d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:02.174541 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c8154-be28-465d-b41f-2d8c6f9150d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:02.174846 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c8154-be28-465d-b41f-2d8c6f9150d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:02.176053 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c8154-be28-465d-b41f-2d8c6f9150d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:02.179750 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c8154-be28-465d-b41f-2d8c6f9150d7 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:02.202540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 983/2001] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:41:02 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:41:02.206772 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dea7cc-10ef-45b3-8dd7-cc2d8a943217 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:02.220393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dea7cc-10ef-45b3-8dd7-cc2d8a943217 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:02.227185 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acab506-286a-4f25-a86e-27f5dc013e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:02.228005 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acab506-286a-4f25-a86e-27f5dc013e32 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:02.228283 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acab506-286a-4f25-a86e-27f5dc013e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:02.228552 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acab506-286a-4f25-a86e-27f5dc013e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:02.229305 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acab506-286a-4f25-a86e-27f5dc013e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:02.230913 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acab506-286a-4f25-a86e-27f5dc013e32 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:02.244294 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1019/2002] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:41:02.248711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c8154-be28-465d-b41f-2d8c6f9150d7 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:02.259232 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c8154-be28-465d-b41f-2d8c6f9150d7 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:02.263763 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35df4d5-d379-46fc-a0ec-6bed9b05ff8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:02.264420 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35df4d5-d379-46fc-a0ec-6bed9b05ff8a admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:02.264696 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35df4d5-d379-46fc-a0ec-6bed9b05ff8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:02.264984 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35df4d5-d379-46fc-a0ec-6bed9b05ff8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:02.265743 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35df4d5-d379-46fc-a0ec-6bed9b05ff8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:02.267342 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35df4d5-d379-46fc-a0ec-6bed9b05ff8a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:02.279774 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 984/2003] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:41:02.283830 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acab506-286a-4f25-a86e-27f5dc013e32 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:02.294090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acab506-286a-4f25-a86e-27f5dc013e32 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:02.299731 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728943e-f269-4a2a-920f-917b13eb4bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:02.300856 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728943e-f269-4a2a-920f-917b13eb4bca admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:02.301140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728943e-f269-4a2a-920f-917b13eb4bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:02.301569 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728943e-f269-4a2a-920f-917b13eb4bca admin admin] PATH_INFO: `/v3/projects/ce8a4689c5744b8e9b0cfdf40c5e4e8e/users/bc022eae29434380af8bfdb9561e238d/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:02.317242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728943e-f269-4a2a-920f-917b13eb4bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce8a4689c5744b8e9b0cfdf40c5e4e8e, user_id=bc022eae29434380af8bfdb9561e238d, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:02.319913 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728943e-f269-4a2a-920f-917b13eb4bca admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:02.336701 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1020/2004] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:41:02 2022] PUT /identity/v3/projects/ce8a4689c5744b8e9b0cfdf40c5e4e8e/users/bc022eae29434380af8bfdb9561e238d/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:02.342286 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b8df5-e7cc-44e7-8627-6e3ffc0b4f5d None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:02.342600 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b8df5-e7cc-44e7-8627-6e3ffc0b4f5d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:02.343071 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b8df5-e7cc-44e7-8627-6e3ffc0b4f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:02.361612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-5d9b8df5-e7cc-44e7-8627-6e3ffc0b4f5d None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:02.362907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5d9b8df5-e7cc-44e7-8627-6e3ffc0b4f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:02.432276 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 985/2005] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:02.440210 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728943e-f269-4a2a-920f-917b13eb4bca admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:02.442619 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f728943e-f269-4a2a-920f-917b13eb4bca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:02.499294 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728943e-f269-4a2a-920f-917b13eb4bca admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:02.503312 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577c17f-48f2-4e3c-a730-ef8e6edded7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:02.504019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577c17f-48f2-4e3c-a730-ef8e6edded7a service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:02.504302 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577c17f-48f2-4e3c-a730-ef8e6edded7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:02.504665 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577c17f-48f2-4e3c-a730-ef8e6edded7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:02.515548 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577c17f-48f2-4e3c-a730-ef8e6edded7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:02.516976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577c17f-48f2-4e3c-a730-ef8e6edded7a service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:02.528851 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1021/2006] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:04.640974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b8df5-e7cc-44e7-8627-6e3ffc0b4f5d None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:04.643457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5d9b8df5-e7cc-44e7-8627-6e3ffc0b4f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:04.666595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b8df5-e7cc-44e7-8627-6e3ffc0b4f5d None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:04.683855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf2780-ea2c-4463-a214-8851adfbdfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:04.684776 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf2780-ea2c-4463-a214-8851adfbdfe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:04.685050 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf2780-ea2c-4463-a214-8851adfbdfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:04.685321 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf2780-ea2c-4463-a214-8851adfbdfe7 admin admin] PATH_INFO: `/v3/users/7287533ce5e84411946b10e266f458e9` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:04.692436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf2780-ea2c-4463-a214-8851adfbdfe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7287533ce5e84411946b10e266f458e9)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:04.694380 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf2780-ea2c-4463-a214-8851adfbdfe7 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:04.761472 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-87bf2780-ea2c-4463-a214-8851adfbdfe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7287533ce5e84411946b10e266f458e9'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:04.771938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-87bf2780-ea2c-4463-a214-8851adfbdfe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7287533ce5e84411946b10e266f458e9'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:04.772626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-87bf2780-ea2c-4463-a214-8851adfbdfe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7287533ce5e84411946b10e266f458e9'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:04.783669 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-87bf2780-ea2c-4463-a214-8851adfbdfe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7287533ce5e84411946b10e266f458e9'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:04.805342 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-87bf2780-ea2c-4463-a214-8851adfbdfe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7287533ce5e84411946b10e266f458e9'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:04.812845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 986/2007] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:41:04 2022] DELETE /identity/v3/users/7287533ce5e84411946b10e266f458e9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:04.817537 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98515bef-d306-4ce6-830f-3cc77c17cee2 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:04.818060 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98515bef-d306-4ce6-830f-3cc77c17cee2 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:04.818060 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98515bef-d306-4ce6-830f-3cc77c17cee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:04.843449 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-98515bef-d306-4ce6-830f-3cc77c17cee2 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:04.844667 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-98515bef-d306-4ce6-830f-3cc77c17cee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:04.983435 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:05.037596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1022/2008] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:05.048883 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf2780-ea2c-4463-a214-8851adfbdfe7 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:05.050687 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-87bf2780-ea2c-4463-a214-8851adfbdfe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:05.109285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:05.179112 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf2780-ea2c-4463-a214-8851adfbdfe7 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:05.187239 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a862b9c-a83f-4e35-86f9-a2ebcb2e6bbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:05.187798 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a862b9c-a83f-4e35-86f9-a2ebcb2e6bbd service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:05.188048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a862b9c-a83f-4e35-86f9-a2ebcb2e6bbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:05.188340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a862b9c-a83f-4e35-86f9-a2ebcb2e6bbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:05.202132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a862b9c-a83f-4e35-86f9-a2ebcb2e6bbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:05.217855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a862b9c-a83f-4e35-86f9-a2ebcb2e6bbd service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:05.266259 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 987/2009] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:05.658215 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98515bef-d306-4ce6-830f-3cc77c17cee2 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:05.659804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-98515bef-d306-4ce6-830f-3cc77c17cee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:05.681186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98515bef-d306-4ce6-830f-3cc77c17cee2 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:05.691649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b4669-b00b-48a8-9e88-08ca05223d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:05.692637 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b4669-b00b-48a8-9e88-08ca05223d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:05.692913 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b4669-b00b-48a8-9e88-08ca05223d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:05.693181 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b4669-b00b-48a8-9e88-08ca05223d08 admin admin] PATH_INFO: `/v3/projects/eda9b02f1c3b426582848e8a111dca39` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:05.694405 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b4669-b00b-48a8-9e88-08ca05223d08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eda9b02f1c3b426582848e8a111dca39)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:05.703120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b4669-b00b-48a8-9e88-08ca05223d08 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:05.814960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0e7b4669-b00b-48a8-9e88-08ca05223d08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eda9b02f1c3b426582848e8a111dca39', 'request_id': 'req-0e7b4669-b00b-48a8-9e88-08ca05223d08'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:05.831327 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0e7b4669-b00b-48a8-9e88-08ca05223d08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eda9b02f1c3b426582848e8a111dca39', 'request_id': 'req-0e7b4669-b00b-48a8-9e88-08ca05223d08'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:05.843800 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0e7b4669-b00b-48a8-9e88-08ca05223d08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eda9b02f1c3b426582848e8a111dca39', 'request_id': 'req-0e7b4669-b00b-48a8-9e88-08ca05223d08'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:05.874776 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0e7b4669-b00b-48a8-9e88-08ca05223d08 admin admin] The token cache is being invalidate because project eda9b02f1c3b426582848e8a111dca39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:41:05.875073 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0e7b4669-b00b-48a8-9e88-08ca05223d08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:05.876435 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0e7b4669-b00b-48a8-9e88-08ca05223d08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:05.879875 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1023/2010] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:41:05 2022] DELETE /identity/v3/projects/eda9b02f1c3b426582848e8a111dca39 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:05.883610 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a862b9c-a83f-4e35-86f9-a2ebcb2e6bbd service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:05.898377 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a862b9c-a83f-4e35-86f9-a2ebcb2e6bbd service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:05.979879 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22e1f8-1f27-4510-8fb5-7cbc271c9721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:05.981331 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22e1f8-1f27-4510-8fb5-7cbc271c9721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:05.981830 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22e1f8-1f27-4510-8fb5-7cbc271c9721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:05.982318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22e1f8-1f27-4510-8fb5-7cbc271c9721 admin admin] PATH_INFO: `/v3/users/a324efcf4a684d62910c141294fa2875` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:05.984620 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed22e1f8-1f27-4510-8fb5-7cbc271c9721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a324efcf4a684d62910c141294fa2875)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:05.987414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed22e1f8-1f27-4510-8fb5-7cbc271c9721 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:06.089497 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ed22e1f8-1f27-4510-8fb5-7cbc271c9721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a324efcf4a684d62910c141294fa2875'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:06.104571 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ed22e1f8-1f27-4510-8fb5-7cbc271c9721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a324efcf4a684d62910c141294fa2875'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:06.108872 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ed22e1f8-1f27-4510-8fb5-7cbc271c9721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a324efcf4a684d62910c141294fa2875'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:06.124955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ed22e1f8-1f27-4510-8fb5-7cbc271c9721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a324efcf4a684d62910c141294fa2875'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:06.153607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ed22e1f8-1f27-4510-8fb5-7cbc271c9721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a324efcf4a684d62910c141294fa2875'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:06.174934 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 988/2011] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:41:05 2022] DELETE /identity/v3/users/a324efcf4a684d62910c141294fa2875 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:06.589638 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b4669-b00b-48a8-9e88-08ca05223d08 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:06.591901 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0e7b4669-b00b-48a8-9e88-08ca05223d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:06.620275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b4669-b00b-48a8-9e88-08ca05223d08 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:06.715205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69759b8-6adf-4c58-811a-a279e8f95d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:06.716155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69759b8-6adf-4c58-811a-a279e8f95d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:06.716429 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69759b8-6adf-4c58-811a-a279e8f95d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:06.717226 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69759b8-6adf-4c58-811a-a279e8f95d52 admin admin] PATH_INFO: `/v3/projects/7505b67572e748b48cb7dd3a12f8378c` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:06.718520 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69759b8-6adf-4c58-811a-a279e8f95d52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7505b67572e748b48cb7dd3a12f8378c)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:06.722311 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69759b8-6adf-4c58-811a-a279e8f95d52 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:06.795267 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c69759b8-6adf-4c58-811a-a279e8f95d52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7505b67572e748b48cb7dd3a12f8378c', 'request_id': 'req-c69759b8-6adf-4c58-811a-a279e8f95d52'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:06.801781 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c69759b8-6adf-4c58-811a-a279e8f95d52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7505b67572e748b48cb7dd3a12f8378c', 'request_id': 'req-c69759b8-6adf-4c58-811a-a279e8f95d52'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:06.809832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c69759b8-6adf-4c58-811a-a279e8f95d52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7505b67572e748b48cb7dd3a12f8378c', 'request_id': 'req-c69759b8-6adf-4c58-811a-a279e8f95d52'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:06.827938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c69759b8-6adf-4c58-811a-a279e8f95d52 admin admin] The token cache is being invalidate because project 7505b67572e748b48cb7dd3a12f8378c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:41:06.828231 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c69759b8-6adf-4c58-811a-a279e8f95d52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:06.829369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c69759b8-6adf-4c58-811a-a279e8f95d52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:06.835093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1024/2012] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:41:06 2022] DELETE /identity/v3/projects/7505b67572e748b48cb7dd3a12f8378c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:06.837317 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc298e1-1f57-410f-b58e-9e1fbf7b8319 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:06.837710 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc298e1-1f57-410f-b58e-9e1fbf7b8319 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:06.837992 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc298e1-1f57-410f-b58e-9e1fbf7b8319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:06.860586 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-3cc298e1-1f57-410f-b58e-9e1fbf7b8319 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:06.862123 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3cc298e1-1f57-410f-b58e-9e1fbf7b8319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:06.914108 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:06.951561 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 989/2013] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:06.962962 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1d9b7-c44d-4b74-8479-6ce75f1338e4 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:06.962962 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1d9b7-c44d-4b74-8479-6ce75f1338e4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:06.962962 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1d9b7-c44d-4b74-8479-6ce75f1338e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:06.990976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:06.994258 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-bcd1d9b7-c44d-4b74-8479-6ce75f1338e4 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:06.995788 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-bcd1d9b7-c44d-4b74-8479-6ce75f1338e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:07.017340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc298e1-1f57-410f-b58e-9e1fbf7b8319 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:07.028992 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc298e1-1f57-410f-b58e-9e1fbf7b8319 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:07.042124 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1025/2014] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:07.068883 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2aaeee-c60e-4cb6-92e4-6a926a95d9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:07.069745 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aaeee-c60e-4cb6-92e4-6a926a95d9da admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:07.070037 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aaeee-c60e-4cb6-92e4-6a926a95d9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:07.070325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aaeee-c60e-4cb6-92e4-6a926a95d9da admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:07.071277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2aaeee-c60e-4cb6-92e4-6a926a95d9da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:41:07.071644 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2aaeee-c60e-4cb6-92e4-6a926a95d9da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:07.073384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2aaeee-c60e-4cb6-92e4-6a926a95d9da admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:07.108948 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 990/2015] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:41:07.112168 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1d9b7-c44d-4b74-8479-6ce75f1338e4 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:07.139945 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1d9b7-c44d-4b74-8479-6ce75f1338e4 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:07.173395 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a95ef-08fb-4f4a-a2de-58a2b9716256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:07.174395 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a95ef-08fb-4f4a-a2de-58a2b9716256 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:07.175046 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a95ef-08fb-4f4a-a2de-58a2b9716256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:07.176112 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a95ef-08fb-4f4a-a2de-58a2b9716256 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:07.177175 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a95ef-08fb-4f4a-a2de-58a2b9716256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:07.180054 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a95ef-08fb-4f4a-a2de-58a2b9716256 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:07.247295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1026/2016] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:41:07 2022] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:41:07.253915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2aaeee-c60e-4cb6-92e4-6a926a95d9da admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:07.273856 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2aaeee-c60e-4cb6-92e4-6a926a95d9da admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:07.374069 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd530ed-94f8-4d82-b422-4d8f6b23c0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:07.374889 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd530ed-94f8-4d82-b422-4d8f6b23c0d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:07.375173 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd530ed-94f8-4d82-b422-4d8f6b23c0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:07.376158 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd530ed-94f8-4d82-b422-4d8f6b23c0d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:07.377369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd530ed-94f8-4d82-b422-4d8f6b23c0d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:07.379557 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd530ed-94f8-4d82-b422-4d8f6b23c0d4 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:07.415732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 991/2017] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:41:07 2022] POST /identity/v3/users => generated 294 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:41:07.416354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a95ef-08fb-4f4a-a2de-58a2b9716256 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:07.431485 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a95ef-08fb-4f4a-a2de-58a2b9716256 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:07.440064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1e0a3-397c-4056-8aeb-efbbc377c7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:07.441060 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1e0a3-397c-4056-8aeb-efbbc377c7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:07.441436 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1e0a3-397c-4056-8aeb-efbbc377c7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:07.441806 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1e0a3-397c-4056-8aeb-efbbc377c7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:07.442692 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1e0a3-397c-4056-8aeb-efbbc377c7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:07.444533 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1e0a3-397c-4056-8aeb-efbbc377c7b5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:07.464833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1027/2018] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:41:07.465170 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd530ed-94f8-4d82-b422-4d8f6b23c0d4 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:07.477367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd530ed-94f8-4d82-b422-4d8f6b23c0d4 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:07.484536 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5078d5-9156-460c-9c01-5e515e97270d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:07.485231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5078d5-9156-460c-9c01-5e515e97270d admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:07.485508 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5078d5-9156-460c-9c01-5e515e97270d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:07.485807 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5078d5-9156-460c-9c01-5e515e97270d admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:07.486779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5078d5-9156-460c-9c01-5e515e97270d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:07.488416 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5078d5-9156-460c-9c01-5e515e97270d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:07.504638 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1e0a3-397c-4056-8aeb-efbbc377c7b5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:07.506687 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 992/2019] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:41:07.517072 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1e0a3-397c-4056-8aeb-efbbc377c7b5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:07.523313 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d93647-2ff9-4277-b10d-5d76e23d37d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:07.524333 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d93647-2ff9-4277-b10d-5d76e23d37d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:07.524682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d93647-2ff9-4277-b10d-5d76e23d37d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:07.525028 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d93647-2ff9-4277-b10d-5d76e23d37d5 admin admin] PATH_INFO: `/v3/projects/b3e0f3e435da4ba8998eadb520ad8309/users/fe8f47d100cd42338bdda994f255f6a6/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:07.543266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d93647-2ff9-4277-b10d-5d76e23d37d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3e0f3e435da4ba8998eadb520ad8309, user_id=fe8f47d100cd42338bdda994f255f6a6, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:07.550500 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d93647-2ff9-4277-b10d-5d76e23d37d5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:07.568400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1028/2020] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:41:07 2022] PUT /identity/v3/projects/b3e0f3e435da4ba8998eadb520ad8309/users/fe8f47d100cd42338bdda994f255f6a6/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:41:07.580044 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6d405-4b7b-4106-92ba-0150e5bd817c None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:07.580400 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6d405-4b7b-4106-92ba-0150e5bd817c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:07.580780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6d405-4b7b-4106-92ba-0150e5bd817c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:07.615488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d5f6d405-4b7b-4106-92ba-0150e5bd817c None None] MFA Rules not processed for user `fe8f47d100cd42338bdda994f255f6a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:07.616728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d5f6d405-4b7b-4106-92ba-0150e5bd817c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:07.621121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a26ee-082e-4af6-b807-369207282d2e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:07.621468 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a26ee-082e-4af6-b807-369207282d2e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:07.621736 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a26ee-082e-4af6-b807-369207282d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:07.657471 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f00a26ee-082e-4af6-b807-369207282d2e None None] MFA Rules not processed for user `bc022eae29434380af8bfdb9561e238d`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:07.658911 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f00a26ee-082e-4af6-b807-369207282d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:07.705796 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 993/2021] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:07.710634 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6d405-4b7b-4106-92ba-0150e5bd817c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:07.736349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1029/2022] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:41:07.741109 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a26ee-082e-4af6-b807-369207282d2e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:07.742685 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f00a26ee-082e-4af6-b807-369207282d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:07.761126 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:07.789832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6d405-4b7b-4106-92ba-0150e5bd817c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:07.794474 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55ec96-f1c1-4a95-ad54-1d7ee26e0dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:07.795188 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55ec96-f1c1-4a95-ad54-1d7ee26e0dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:07.795488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55ec96-f1c1-4a95-ad54-1d7ee26e0dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:07.795750 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55ec96-f1c1-4a95-ad54-1d7ee26e0dd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:07.796462 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55ec96-f1c1-4a95-ad54-1d7ee26e0dd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:07.798382 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55ec96-f1c1-4a95-ad54-1d7ee26e0dd3 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:07.819334 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a26ee-082e-4af6-b807-369207282d2e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:07.826932 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427de81-d8ea-4d17-ad0c-2167997b651d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:07.828467 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427de81-d8ea-4d17-ad0c-2167997b651d admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:07.828754 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427de81-d8ea-4d17-ad0c-2167997b651d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:07.829167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427de81-d8ea-4d17-ad0c-2167997b651d admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:07.830123 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427de81-d8ea-4d17-ad0c-2167997b651d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:07.832338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427de81-d8ea-4d17-ad0c-2167997b651d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:07.836097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 994/2023] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:41:07 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:41:07.844428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55ec96-f1c1-4a95-ad54-1d7ee26e0dd3 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:07.869813 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1030/2024] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:41:07 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:41:07.875385 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427de81-d8ea-4d17-ad0c-2167997b651d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:07.913490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:07.955862 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55ec96-f1c1-4a95-ad54-1d7ee26e0dd3 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:07.961375 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c723b6-bd65-4d4e-ad0e-d69907f5ce37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:07.962081 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c723b6-bd65-4d4e-ad0e-d69907f5ce37 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:07.962363 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c723b6-bd65-4d4e-ad0e-d69907f5ce37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:07.962739 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c723b6-bd65-4d4e-ad0e-d69907f5ce37 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:07.963403 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c723b6-bd65-4d4e-ad0e-d69907f5ce37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:07.965459 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c723b6-bd65-4d4e-ad0e-d69907f5ce37 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:07.972132 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427de81-d8ea-4d17-ad0c-2167997b651d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:07.978366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd6e3e-34e0-4098-98d4-b4aa74050ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:07.979173 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd6e3e-34e0-4098-98d4-b4aa74050ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:07.979452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd6e3e-34e0-4098-98d4-b4aa74050ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:07.979857 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd6e3e-34e0-4098-98d4-b4aa74050ee8 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:07.980597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd6e3e-34e0-4098-98d4-b4aa74050ee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:07.982530 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd6e3e-34e0-4098-98d4-b4aa74050ee8 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:07.990517 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 995/2025] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:41:07 2022] POST /identity/v3/users => generated 300 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:41:07.995591 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c723b6-bd65-4d4e-ad0e-d69907f5ce37 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:08.013646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c723b6-bd65-4d4e-ad0e-d69907f5ce37 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:08.021499 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9d1b4-9f80-42ff-9ca8-9589fb32f814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:08.023305 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9d1b4-9f80-42ff-9ca8-9589fb32f814 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:08.023668 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9d1b4-9f80-42ff-9ca8-9589fb32f814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:08.024064 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9d1b4-9f80-42ff-9ca8-9589fb32f814 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:08.025019 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9d1b4-9f80-42ff-9ca8-9589fb32f814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:08.026539 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9d1b4-9f80-42ff-9ca8-9589fb32f814 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:08.032046 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1031/2026] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:41:07 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:41:08.033082 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd6e3e-34e0-4098-98d4-b4aa74050ee8 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:08.037629 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cddd6e3e-34e0-4098-98d4-b4aa74050ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:08.042527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 996/2027] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:41:08.043785 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9d1b4-9f80-42ff-9ca8-9589fb32f814 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:08.050652 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd6e3e-34e0-4098-98d4-b4aa74050ee8 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:08.054125 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9d1b4-9f80-42ff-9ca8-9589fb32f814 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:08.056047 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee27169-3c8b-4296-8039-9b018228840a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:08.057146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee27169-3c8b-4296-8039-9b018228840a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:08.057433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee27169-3c8b-4296-8039-9b018228840a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:08.057703 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee27169-3c8b-4296-8039-9b018228840a admin admin] PATH_INFO: `/v3/users/905b0a36b614458480311e12987ab5fc` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:08.058931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee27169-3c8b-4296-8039-9b018228840a admin admin] RBAC: Authorizing `identity:delete_user(user_id=905b0a36b614458480311e12987ab5fc)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:08.059719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36096a4-1082-4665-a7d2-c4beee25283b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:08.060391 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36096a4-1082-4665-a7d2-c4beee25283b admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:08.060671 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36096a4-1082-4665-a7d2-c4beee25283b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:08.060884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee27169-3c8b-4296-8039-9b018228840a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:08.060998 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36096a4-1082-4665-a7d2-c4beee25283b admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:08.061675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36096a4-1082-4665-a7d2-c4beee25283b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:08.063894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36096a4-1082-4665-a7d2-c4beee25283b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:08.075291 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 997/2028] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:41:08.076141 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36096a4-1082-4665-a7d2-c4beee25283b admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:08.086857 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36096a4-1082-4665-a7d2-c4beee25283b admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:08.093076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e50bf3-1a89-4bc9-a039-b361d234ff89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:08.094282 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e50bf3-1a89-4bc9-a039-b361d234ff89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:08.094775 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e50bf3-1a89-4bc9-a039-b361d234ff89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:08.095093 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e50bf3-1a89-4bc9-a039-b361d234ff89 admin admin] PATH_INFO: `/v3/projects/3e7477723e024f66b1437cc6cc530c12/users/6874005bd5d64d898f1d94fe99cc71c7/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:08.111752 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e50bf3-1a89-4bc9-a039-b361d234ff89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e7477723e024f66b1437cc6cc530c12, user_id=6874005bd5d64d898f1d94fe99cc71c7, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:08.114473 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e50bf3-1a89-4bc9-a039-b361d234ff89 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:08.121892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-aee27169-3c8b-4296-8039-9b018228840a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '905b0a36b614458480311e12987ab5fc'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:08.129954 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 998/2029] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:41:08 2022] PUT /identity/v3/projects/3e7477723e024f66b1437cc6cc530c12/users/6874005bd5d64d898f1d94fe99cc71c7/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:08.130804 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e50bf3-1a89-4bc9-a039-b361d234ff89 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:08.132587 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-aee27169-3c8b-4296-8039-9b018228840a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '905b0a36b614458480311e12987ab5fc'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:08.133279 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-aee27169-3c8b-4296-8039-9b018228840a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '905b0a36b614458480311e12987ab5fc'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:08.148260 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-aee27169-3c8b-4296-8039-9b018228840a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '905b0a36b614458480311e12987ab5fc'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:08.148972 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-aee27169-3c8b-4296-8039-9b018228840a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '905b0a36b614458480311e12987ab5fc'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:08.162648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1032/2030] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:41:08 2022] DELETE /identity/v3/users/905b0a36b614458480311e12987ab5fc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:08.163761 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee27169-3c8b-4296-8039-9b018228840a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:08.164820 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-aee27169-3c8b-4296-8039-9b018228840a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:08.199814 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e50bf3-1a89-4bc9-a039-b361d234ff89 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:08.208965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:08.235010 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee27169-3c8b-4296-8039-9b018228840a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:08.240365 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f1e9a-530b-412b-8079-f77d40f5163d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:08.241050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f1e9a-530b-412b-8079-f77d40f5163d admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:08.241807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f1e9a-530b-412b-8079-f77d40f5163d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:08.242093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f1e9a-530b-412b-8079-f77d40f5163d admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:08.242883 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f1e9a-530b-412b-8079-f77d40f5163d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:08.245027 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f1e9a-530b-412b-8079-f77d40f5163d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:08.270643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1033/2031] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:41:08.271187 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66fe50-e1db-4377-bac3-2a6fc205d861 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:08.271539 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66fe50-e1db-4377-bac3-2a6fc205d861 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:08.271882 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66fe50-e1db-4377-bac3-2a6fc205d861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:08.277576 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4229350-8e55-4441-9f0e-34ea30e5489e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:08.278758 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4229350-8e55-4441-9f0e-34ea30e5489e admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:08.279979 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4229350-8e55-4441-9f0e-34ea30e5489e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:08.280268 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4229350-8e55-4441-9f0e-34ea30e5489e admin admin] PATH_INFO: `/v3/projects/2d06e6c44bb74cf6aa6751de574647bf/users/5e7ef880080b482fad46596bbd6e32d1/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:08.290292 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-cf66fe50-e1db-4377-bac3-2a6fc205d861 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:08.291661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cf66fe50-e1db-4377-bac3-2a6fc205d861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:08.298701 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4229350-8e55-4441-9f0e-34ea30e5489e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d06e6c44bb74cf6aa6751de574647bf, user_id=5e7ef880080b482fad46596bbd6e32d1, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:08.299677 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1034/2032] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:08.301839 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4229350-8e55-4441-9f0e-34ea30e5489e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:08.303434 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66fe50-e1db-4377-bac3-2a6fc205d861 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:08.315521 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66fe50-e1db-4377-bac3-2a6fc205d861 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:08.321414 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 999/2033] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:41:08 2022] PUT /identity/v3/projects/2d06e6c44bb74cf6aa6751de574647bf/users/5e7ef880080b482fad46596bbd6e32d1/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:08.322895 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4229350-8e55-4441-9f0e-34ea30e5489e admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:08.325428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f4229350-8e55-4441-9f0e-34ea30e5489e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:08.328580 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:08.395230 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4229350-8e55-4441-9f0e-34ea30e5489e admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:08.399023 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73014e-c0b1-4b5f-bcd3-5574e7a3ece6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:08.399179 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfb176-8754-4236-a97a-0618828bca11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:08.399760 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfb176-8754-4236-a97a-0618828bca11 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:08.399928 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73014e-c0b1-4b5f-bcd3-5574e7a3ece6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:08.400037 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfb176-8754-4236-a97a-0618828bca11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:08.400221 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73014e-c0b1-4b5f-bcd3-5574e7a3ece6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:08.400314 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfb176-8754-4236-a97a-0618828bca11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:08.400482 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73014e-c0b1-4b5f-bcd3-5574e7a3ece6 admin admin] PATH_INFO: `/v3/projects/3e7477723e024f66b1437cc6cc530c12/users/6874005bd5d64d898f1d94fe99cc71c7/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:08.402469 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73014e-c0b1-4b5f-bcd3-5574e7a3ece6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e7477723e024f66b1437cc6cc530c12, user_id=6874005bd5d64d898f1d94fe99cc71c7, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:08.405221 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73014e-c0b1-4b5f-bcd3-5574e7a3ece6 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:08.410475 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfb176-8754-4236-a97a-0618828bca11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:08.412035 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfb176-8754-4236-a97a-0618828bca11 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:08.420408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1035/2034] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:41:08 2022] PUT /identity/v3/projects/3e7477723e024f66b1437cc6cc530c12/users/6874005bd5d64d898f1d94fe99cc71c7/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:08.421175 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73014e-c0b1-4b5f-bcd3-5574e7a3ece6 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:08.423112 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5f73014e-c0b1-4b5f-bcd3-5574e7a3ece6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:08.425986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1000/2035] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:08.432114 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2c765-4f40-4b4c-a819-546c89aa65b7 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:08.432524 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2c765-4f40-4b4c-a819-546c89aa65b7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:08.432931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2c765-4f40-4b4c-a819-546c89aa65b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:08.465031 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-a6f2c765-4f40-4b4c-a819-546c89aa65b7 None None] MFA Rules not processed for user `6874005bd5d64d898f1d94fe99cc71c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:08.466789 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a6f2c765-4f40-4b4c-a819-546c89aa65b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:08.494278 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73014e-c0b1-4b5f-bcd3-5574e7a3ece6 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:08.499209 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8dbf75-c1c3-4a85-a270-fffbdeafa8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:08.499894 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dbf75-c1c3-4a85-a270-fffbdeafa8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:08.500175 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dbf75-c1c3-4a85-a270-fffbdeafa8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:08.500442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dbf75-c1c3-4a85-a270-fffbdeafa8d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:08.501256 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8dbf75-c1c3-4a85-a270-fffbdeafa8d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:08.502886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8dbf75-c1c3-4a85-a270-fffbdeafa8d1 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:08.516134 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1036/2036] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:41:08.521268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8dbf75-c1c3-4a85-a270-fffbdeafa8d1 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:08.538683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8dbf75-c1c3-4a85-a270-fffbdeafa8d1 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:08.544422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd19122-bd47-46ca-8f51-e03da9e30a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:08.545286 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd19122-bd47-46ca-8f51-e03da9e30a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:08.545463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd19122-bd47-46ca-8f51-e03da9e30a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:08.545747 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd19122-bd47-46ca-8f51-e03da9e30a15 admin admin] PATH_INFO: `/v3/projects/2d06e6c44bb74cf6aa6751de574647bf/users/5e7ef880080b482fad46596bbd6e32d1/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:08.547881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd19122-bd47-46ca-8f51-e03da9e30a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d06e6c44bb74cf6aa6751de574647bf, user_id=5e7ef880080b482fad46596bbd6e32d1, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:08.548998 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1001/2037] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:08.550822 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd19122-bd47-46ca-8f51-e03da9e30a15 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:08.561395 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2c765-4f40-4b4c-a819-546c89aa65b7 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:08.563253 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a6f2c765-4f40-4b4c-a819-546c89aa65b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:08.564444 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1037/2038] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:41:08 2022] PUT /identity/v3/projects/2d06e6c44bb74cf6aa6751de574647bf/users/5e7ef880080b482fad46596bbd6e32d1/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:08.603069 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:08.659528 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2c765-4f40-4b4c-a819-546c89aa65b7 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:08.739066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a011f7-aca8-4eb3-94d0-9bad68218758 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:08.740037 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a011f7-aca8-4eb3-94d0-9bad68218758 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:08.740425 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a011f7-aca8-4eb3-94d0-9bad68218758 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:08.740722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a011f7-aca8-4eb3-94d0-9bad68218758 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:08.840449 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a011f7-aca8-4eb3-94d0-9bad68218758 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:08.842526 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a011f7-aca8-4eb3-94d0-9bad68218758 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:08.860079 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1002/2039] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:41:08.886204 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd19122-bd47-46ca-8f51-e03da9e30a15 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:08.886204 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7bd19122-bd47-46ca-8f51-e03da9e30a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:08.984143 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd19122-bd47-46ca-8f51-e03da9e30a15 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:08.990347 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823be081-3592-4692-b7d0-80c08b196080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:08.991701 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823be081-3592-4692-b7d0-80c08b196080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:08.991976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823be081-3592-4692-b7d0-80c08b196080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:08.992248 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823be081-3592-4692-b7d0-80c08b196080 admin admin] PATH_INFO: `/v3/projects/cfee968569d644a18d3f176e50dbf6d4` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:08.993503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823be081-3592-4692-b7d0-80c08b196080 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfee968569d644a18d3f176e50dbf6d4)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:08.995422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823be081-3592-4692-b7d0-80c08b196080 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:09.055595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a011f7-aca8-4eb3-94d0-9bad68218758 service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:09.061853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:09.073713 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a011f7-aca8-4eb3-94d0-9bad68218758 service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:09.095819 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-823be081-3592-4692-b7d0-80c08b196080 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfee968569d644a18d3f176e50dbf6d4', 'request_id': 'req-823be081-3592-4692-b7d0-80c08b196080'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:09.107232 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-823be081-3592-4692-b7d0-80c08b196080 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfee968569d644a18d3f176e50dbf6d4', 'request_id': 'req-823be081-3592-4692-b7d0-80c08b196080'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:09.119893 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-823be081-3592-4692-b7d0-80c08b196080 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfee968569d644a18d3f176e50dbf6d4', 'request_id': 'req-823be081-3592-4692-b7d0-80c08b196080'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:09.153505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-823be081-3592-4692-b7d0-80c08b196080 admin admin] The token cache is being invalidate because project cfee968569d644a18d3f176e50dbf6d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:41:09.154059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-823be081-3592-4692-b7d0-80c08b196080 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:09.154972 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-823be081-3592-4692-b7d0-80c08b196080 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:09.156540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0dc5d7-8ced-408f-a573-59f4cfd217ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:09.157166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1038/2040] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:41:08 2022] DELETE /identity/v3/projects/cfee968569d644a18d3f176e50dbf6d4 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:09.157894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0dc5d7-8ced-408f-a573-59f4cfd217ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:09.158245 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0dc5d7-8ced-408f-a573-59f4cfd217ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:09.158603 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0dc5d7-8ced-408f-a573-59f4cfd217ee admin admin] PATH_INFO: `/v3/users/fe8f47d100cd42338bdda994f255f6a6` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:09.160366 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0dc5d7-8ced-408f-a573-59f4cfd217ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe8f47d100cd42338bdda994f255f6a6)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:09.161471 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823be081-3592-4692-b7d0-80c08b196080 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:09.163156 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0dc5d7-8ced-408f-a573-59f4cfd217ee admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:09.164091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-823be081-3592-4692-b7d0-80c08b196080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:09.185502 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823be081-3592-4692-b7d0-80c08b196080 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:09.193082 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff8301-8e7c-4467-9bf3-f377325fd2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:09.194246 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff8301-8e7c-4467-9bf3-f377325fd2b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:09.194757 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff8301-8e7c-4467-9bf3-f377325fd2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:09.195347 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff8301-8e7c-4467-9bf3-f377325fd2b7 admin admin] PATH_INFO: `/v3/users/36cb1a932aa44ccda5ffaff3b87d8451` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:09.197279 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff8301-8e7c-4467-9bf3-f377325fd2b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36cb1a932aa44ccda5ffaff3b87d8451)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:09.200862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff8301-8e7c-4467-9bf3-f377325fd2b7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:09.220227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:09.250722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fa0dc5d7-8ced-408f-a573-59f4cfd217ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe8f47d100cd42338bdda994f255f6a6'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:09.260738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fa0dc5d7-8ced-408f-a573-59f4cfd217ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe8f47d100cd42338bdda994f255f6a6'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:09.261795 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fa0dc5d7-8ced-408f-a573-59f4cfd217ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe8f47d100cd42338bdda994f255f6a6'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:09.274451 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fa0dc5d7-8ced-408f-a573-59f4cfd217ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe8f47d100cd42338bdda994f255f6a6'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:09.293168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fa0dc5d7-8ced-408f-a573-59f4cfd217ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe8f47d100cd42338bdda994f255f6a6'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:09.295998 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-96ff8301-8e7c-4467-9bf3-f377325fd2b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36cb1a932aa44ccda5ffaff3b87d8451'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:09.301552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1003/2041] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:41:09 2022] DELETE /identity/v3/users/fe8f47d100cd42338bdda994f255f6a6 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:09.305833 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de7cb8-9363-44f6-94f2-c80692495b53 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:09.306625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de7cb8-9363-44f6-94f2-c80692495b53 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:09.306997 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de7cb8-9363-44f6-94f2-c80692495b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:09.311346 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-96ff8301-8e7c-4467-9bf3-f377325fd2b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36cb1a932aa44ccda5ffaff3b87d8451'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:09.312053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-96ff8301-8e7c-4467-9bf3-f377325fd2b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36cb1a932aa44ccda5ffaff3b87d8451'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:09.335609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-69de7cb8-9363-44f6-94f2-c80692495b53 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:09.336395 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-96ff8301-8e7c-4467-9bf3-f377325fd2b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36cb1a932aa44ccda5ffaff3b87d8451'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:09.337025 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-69de7cb8-9363-44f6-94f2-c80692495b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:09.337780 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-96ff8301-8e7c-4467-9bf3-f377325fd2b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36cb1a932aa44ccda5ffaff3b87d8451'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:09.360933 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1039/2042] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:41:09 2022] DELETE /identity/v3/users/36cb1a932aa44ccda5ffaff3b87d8451 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:09.430743 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1004/2043] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:41:09.445882 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff8301-8e7c-4467-9bf3-f377325fd2b7 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:09.451043 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-96ff8301-8e7c-4467-9bf3-f377325fd2b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:09.537579 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff8301-8e7c-4467-9bf3-f377325fd2b7 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:09.549619 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09727b-5759-415d-a43e-dc0531cf2f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:09.550632 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09727b-5759-415d-a43e-dc0531cf2f44 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:09.550914 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09727b-5759-415d-a43e-dc0531cf2f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:09.551193 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09727b-5759-415d-a43e-dc0531cf2f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:09.622061 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:09.682408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09727b-5759-415d-a43e-dc0531cf2f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:09.684569 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09727b-5759-415d-a43e-dc0531cf2f44 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:09.702762 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1040/2044] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:09.857359 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de7cb8-9363-44f6-94f2-c80692495b53 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:09.858831 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-69de7cb8-9363-44f6-94f2-c80692495b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:09.873638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de7cb8-9363-44f6-94f2-c80692495b53 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:09.881281 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a243b7-a802-4410-912b-7657338617cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:09.882497 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a243b7-a802-4410-912b-7657338617cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:09.883016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a243b7-a802-4410-912b-7657338617cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:09.883618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a243b7-a802-4410-912b-7657338617cb admin admin] PATH_INFO: `/v3/projects/e45410bacf4e4fb5baa938651643aa38` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:09.885107 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a243b7-a802-4410-912b-7657338617cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e45410bacf4e4fb5baa938651643aa38)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:09.888768 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a243b7-a802-4410-912b-7657338617cb admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:09.990998 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c2a243b7-a802-4410-912b-7657338617cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e45410bacf4e4fb5baa938651643aa38', 'request_id': 'req-c2a243b7-a802-4410-912b-7657338617cb'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:09.998587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c2a243b7-a802-4410-912b-7657338617cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e45410bacf4e4fb5baa938651643aa38', 'request_id': 'req-c2a243b7-a802-4410-912b-7657338617cb'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:10.005959 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c2a243b7-a802-4410-912b-7657338617cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e45410bacf4e4fb5baa938651643aa38', 'request_id': 'req-c2a243b7-a802-4410-912b-7657338617cb'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:10.023257 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c2a243b7-a802-4410-912b-7657338617cb admin admin] The token cache is being invalidate because project e45410bacf4e4fb5baa938651643aa38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:41:10.024462 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c2a243b7-a802-4410-912b-7657338617cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:10.024462 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c2a243b7-a802-4410-912b-7657338617cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:10.029579 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1005/2045] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:41:09 2022] DELETE /identity/v3/projects/e45410bacf4e4fb5baa938651643aa38 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:10.031701 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba695e3-5d93-4b6b-b45d-f9a5e06d2d22 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:10.032278 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba695e3-5d93-4b6b-b45d-f9a5e06d2d22 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:10.032278 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba695e3-5d93-4b6b-b45d-f9a5e06d2d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:10.052249 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-5ba695e3-5d93-4b6b-b45d-f9a5e06d2d22 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:10.053581 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5ba695e3-5d93-4b6b-b45d-f9a5e06d2d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:10.121656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1041/2046] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:10.130845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4beb8a9-1dc7-4992-b5fc-7119586d15f6 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:10.131404 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4beb8a9-1dc7-4992-b5fc-7119586d15f6 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:10.132148 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4beb8a9-1dc7-4992-b5fc-7119586d15f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:10.152985 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d4beb8a9-1dc7-4992-b5fc-7119586d15f6 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:10.154826 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d4beb8a9-1dc7-4992-b5fc-7119586d15f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:10.169005 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1006/2047] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:10.176427 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba695e3-5d93-4b6b-b45d-f9a5e06d2d22 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:10.193369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba695e3-5d93-4b6b-b45d-f9a5e06d2d22 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:10.203631 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce039ab0-83c2-45e2-935b-6ddf8fb51b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:10.204502 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce039ab0-83c2-45e2-935b-6ddf8fb51b63 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:10.204928 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce039ab0-83c2-45e2-935b-6ddf8fb51b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:10.205370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce039ab0-83c2-45e2-935b-6ddf8fb51b63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:10.206688 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce039ab0-83c2-45e2-935b-6ddf8fb51b63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:41:10.206870 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce039ab0-83c2-45e2-935b-6ddf8fb51b63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:10.210853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce039ab0-83c2-45e2-935b-6ddf8fb51b63 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:10.244863 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1042/2048] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:41:10.249055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4beb8a9-1dc7-4992-b5fc-7119586d15f6 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:10.259363 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4beb8a9-1dc7-4992-b5fc-7119586d15f6 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:10.264762 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe55d75-f93f-4160-ad1e-2188a9cdc671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:10.265441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe55d75-f93f-4160-ad1e-2188a9cdc671 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:10.265721 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe55d75-f93f-4160-ad1e-2188a9cdc671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:10.266051 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe55d75-f93f-4160-ad1e-2188a9cdc671 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:10.266732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe55d75-f93f-4160-ad1e-2188a9cdc671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:10.270268 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe55d75-f93f-4160-ad1e-2188a9cdc671 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:10.306444 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1007/2049] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:41:10 2022] POST /identity/v3/projects => generated 407 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:41:10.307689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce039ab0-83c2-45e2-935b-6ddf8fb51b63 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:10.337029 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce039ab0-83c2-45e2-935b-6ddf8fb51b63 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:10.346718 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe55d75-f93f-4160-ad1e-2188a9cdc671 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:10.379306 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-afe55d75-f93f-4160-ad1e-2188a9cdc671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:10.392624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:10.421620 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fd981-3837-494c-a688-12706cbadf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:10.422913 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fd981-3837-494c-a688-12706cbadf74 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:10.423203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fd981-3837-494c-a688-12706cbadf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:10.423479 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fd981-3837-494c-a688-12706cbadf74 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:10.424413 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fd981-3837-494c-a688-12706cbadf74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:10.427171 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fd981-3837-494c-a688-12706cbadf74 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:10.454301 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1043/2050] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:41:10 2022] POST /identity/v3/users => generated 304 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:41:10.458063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fd981-3837-494c-a688-12706cbadf74 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:10.472275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fd981-3837-494c-a688-12706cbadf74 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:10.480450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59e053-d48b-45c6-9952-918dc969640d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:10.481142 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59e053-d48b-45c6-9952-918dc969640d admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:10.481419 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59e053-d48b-45c6-9952-918dc969640d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:10.482742 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59e053-d48b-45c6-9952-918dc969640d admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:10.492357 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59e053-d48b-45c6-9952-918dc969640d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:10.494051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59e053-d48b-45c6-9952-918dc969640d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:10.506392 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe55d75-f93f-4160-ad1e-2188a9cdc671 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:10.509800 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1044/2051] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:41:10.510841 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59e053-d48b-45c6-9952-918dc969640d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:10.515275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d3118-f42d-4473-93ff-1589345975bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:10.516638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d3118-f42d-4473-93ff-1589345975bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:10.517386 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d3118-f42d-4473-93ff-1589345975bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:10.519805 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d3118-f42d-4473-93ff-1589345975bb admin admin] PATH_INFO: `/v3/projects/b3e0f3e435da4ba8998eadb520ad8309` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:10.522002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d3118-f42d-4473-93ff-1589345975bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3e0f3e435da4ba8998eadb520ad8309)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:10.524392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59e053-d48b-45c6-9952-918dc969640d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:10.528177 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d3118-f42d-4473-93ff-1589345975bb admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:10.530921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f485b-850c-4829-bcef-f4a1a3980619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:10.532383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f485b-850c-4829-bcef-f4a1a3980619 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:10.532685 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f485b-850c-4829-bcef-f4a1a3980619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:10.533058 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f485b-850c-4829-bcef-f4a1a3980619 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:10.534222 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f485b-850c-4829-bcef-f4a1a3980619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:10.537482 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f485b-850c-4829-bcef-f4a1a3980619 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:10.559242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1045/2052] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:41:10.560169 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f485b-850c-4829-bcef-f4a1a3980619 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:10.576776 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f485b-850c-4829-bcef-f4a1a3980619 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:10.587185 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34706d-c028-42ae-9932-42e8d5e58acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:10.588723 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34706d-c028-42ae-9932-42e8d5e58acd admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:10.588992 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34706d-c028-42ae-9932-42e8d5e58acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:10.589468 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34706d-c028-42ae-9932-42e8d5e58acd admin admin] PATH_INFO: `/v3/projects/b2c534d0183245968349b71b424c02ae/users/f82b1ac9dc4b493eadaaa83e847ae6d2/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:10.604135 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-159d3118-f42d-4473-93ff-1589345975bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3e0f3e435da4ba8998eadb520ad8309', 'request_id': 'req-159d3118-f42d-4473-93ff-1589345975bb'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:10.612436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-159d3118-f42d-4473-93ff-1589345975bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3e0f3e435da4ba8998eadb520ad8309', 'request_id': 'req-159d3118-f42d-4473-93ff-1589345975bb'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:10.616078 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34706d-c028-42ae-9932-42e8d5e58acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2c534d0183245968349b71b424c02ae, user_id=f82b1ac9dc4b493eadaaa83e847ae6d2, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:10.619321 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34706d-c028-42ae-9932-42e8d5e58acd admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:10.620961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-159d3118-f42d-4473-93ff-1589345975bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3e0f3e435da4ba8998eadb520ad8309', 'request_id': 'req-159d3118-f42d-4473-93ff-1589345975bb'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:10.655730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-159d3118-f42d-4473-93ff-1589345975bb admin admin] The token cache is being invalidate because project b3e0f3e435da4ba8998eadb520ad8309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:41:10.656079 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-159d3118-f42d-4473-93ff-1589345975bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:10.657250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-159d3118-f42d-4473-93ff-1589345975bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:10.662405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1008/2054] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:41:10 2022] DELETE /identity/v3/projects/b3e0f3e435da4ba8998eadb520ad8309 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:10.663408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d3118-f42d-4473-93ff-1589345975bb admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:10.667343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1046/2054] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:41:10 2022] PUT /identity/v3/projects/b2c534d0183245968349b71b424c02ae/users/f82b1ac9dc4b493eadaaa83e847ae6d2/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:10.668228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-159d3118-f42d-4473-93ff-1589345975bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:10.674403 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed34a33-b0ac-43bd-9734-acb518163aba None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:10.674734 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed34a33-b0ac-43bd-9734-acb518163aba None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:10.675057 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed34a33-b0ac-43bd-9734-acb518163aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:10.709956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:10.729295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4ed34a33-b0ac-43bd-9734-acb518163aba None None] MFA Rules not processed for user `f82b1ac9dc4b493eadaaa83e847ae6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:10.731628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4ed34a33-b0ac-43bd-9734-acb518163aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:10.810161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d3118-f42d-4473-93ff-1589345975bb admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:10.843351 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1047/2055] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:10 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:41:10.847885 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed34a33-b0ac-43bd-9734-acb518163aba None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:10.849587 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4ed34a33-b0ac-43bd-9734-acb518163aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:10.907944 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:10.947369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e5d55-7414-41e1-ab73-b72352efdfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:10.948596 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e5d55-7414-41e1-ab73-b72352efdfa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:10.948881 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e5d55-7414-41e1-ab73-b72352efdfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:10.950378 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e5d55-7414-41e1-ab73-b72352efdfa4 admin admin] PATH_INFO: `/v3/users/6874005bd5d64d898f1d94fe99cc71c7` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:10.955190 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e5d55-7414-41e1-ab73-b72352efdfa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6874005bd5d64d898f1d94fe99cc71c7)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:10.960271 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e5d55-7414-41e1-ab73-b72352efdfa4 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:11.002078 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed34a33-b0ac-43bd-9734-acb518163aba None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:11.015987 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef10f22-062b-4e8b-8f53-73ffc4964062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:11.016730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef10f22-062b-4e8b-8f53-73ffc4964062 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:11.017210 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef10f22-062b-4e8b-8f53-73ffc4964062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:11.018081 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef10f22-062b-4e8b-8f53-73ffc4964062 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:11.019350 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef10f22-062b-4e8b-8f53-73ffc4964062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:11.021327 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef10f22-062b-4e8b-8f53-73ffc4964062 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:11.056301 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8e2e5d55-7414-41e1-ab73-b72352efdfa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6874005bd5d64d898f1d94fe99cc71c7'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:11.064650 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1048/2056] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:41:10 2022] POST /identity/v3/projects => generated 407 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:41:11.069411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef10f22-062b-4e8b-8f53-73ffc4964062 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:11.085223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8e2e5d55-7414-41e1-ab73-b72352efdfa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6874005bd5d64d898f1d94fe99cc71c7'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:11.086435 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8e2e5d55-7414-41e1-ab73-b72352efdfa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6874005bd5d64d898f1d94fe99cc71c7'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:11.097278 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8e2e5d55-7414-41e1-ab73-b72352efdfa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6874005bd5d64d898f1d94fe99cc71c7'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:11.117994 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8e2e5d55-7414-41e1-ab73-b72352efdfa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6874005bd5d64d898f1d94fe99cc71c7'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:11.128165 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1009/2057] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:41:10 2022] DELETE /identity/v3/users/6874005bd5d64d898f1d94fe99cc71c7 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:11.218946 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef10f22-062b-4e8b-8f53-73ffc4964062 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:11.277356 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:11.371306 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437eba1-c818-4f23-bb7e-437c0bd5e872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:11.372027 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437eba1-c818-4f23-bb7e-437c0bd5e872 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:11.372310 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437eba1-c818-4f23-bb7e-437c0bd5e872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:11.372588 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437eba1-c818-4f23-bb7e-437c0bd5e872 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:11.374052 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437eba1-c818-4f23-bb7e-437c0bd5e872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:11.375355 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437eba1-c818-4f23-bb7e-437c0bd5e872 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:11.424442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1049/2058] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:41:11 2022] POST /identity/v3/users => generated 310 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:41:11.432578 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e5d55-7414-41e1-ab73-b72352efdfa4 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:11.436814 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8e2e5d55-7414-41e1-ab73-b72352efdfa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:11.472196 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e5d55-7414-41e1-ab73-b72352efdfa4 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:11.487311 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81efd8-8d04-4927-81a6-593414deaddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:11.488901 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81efd8-8d04-4927-81a6-593414deaddd admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:11.489273 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81efd8-8d04-4927-81a6-593414deaddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:11.489622 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81efd8-8d04-4927-81a6-593414deaddd admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:11.490463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81efd8-8d04-4927-81a6-593414deaddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:11.493973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81efd8-8d04-4927-81a6-593414deaddd admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:11.524799 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1010/2059] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:41:11.532271 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437eba1-c818-4f23-bb7e-437c0bd5e872 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:11.617784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437eba1-c818-4f23-bb7e-437c0bd5e872 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:11.639425 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27b262-965b-49e5-a5fc-a2531beb26f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:11.640979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27b262-965b-49e5-a5fc-a2531beb26f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:11.641420 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27b262-965b-49e5-a5fc-a2531beb26f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:11.641786 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27b262-965b-49e5-a5fc-a2531beb26f3 admin admin] PATH_INFO: `/v3/projects/d829ce56b09a4ccbbef721c21632a560/users/4a121670847546b9ac5ce0a45ac16f7c/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:11.684841 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27b262-965b-49e5-a5fc-a2531beb26f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d829ce56b09a4ccbbef721c21632a560, user_id=4a121670847546b9ac5ce0a45ac16f7c, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:11.694180 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27b262-965b-49e5-a5fc-a2531beb26f3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:11.721331 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1050/2060] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:41:11 2022] PUT /identity/v3/projects/d829ce56b09a4ccbbef721c21632a560/users/4a121670847546b9ac5ce0a45ac16f7c/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:11.726876 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81efd8-8d04-4927-81a6-593414deaddd admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:11.753053 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81efd8-8d04-4927-81a6-593414deaddd admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:11.928674 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95548057-cdb6-4ddb-ad1b-37fc290375fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:11.930465 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95548057-cdb6-4ddb-ad1b-37fc290375fa admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:11.931347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95548057-cdb6-4ddb-ad1b-37fc290375fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:11.931641 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95548057-cdb6-4ddb-ad1b-37fc290375fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:11.932573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95548057-cdb6-4ddb-ad1b-37fc290375fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:11.935043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95548057-cdb6-4ddb-ad1b-37fc290375fa admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:11.947492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27b262-965b-49e5-a5fc-a2531beb26f3 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:11.949421 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4e27b262-965b-49e5-a5fc-a2531beb26f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:11.954801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1011/2061] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:41:11.959751 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95548057-cdb6-4ddb-ad1b-37fc290375fa admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:11.973913 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27b262-965b-49e5-a5fc-a2531beb26f3 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:11.985832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e178d8-407b-4850-81dd-eddad82b33ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:11.986779 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e178d8-407b-4850-81dd-eddad82b33ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:11.987058 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e178d8-407b-4850-81dd-eddad82b33ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:11.989468 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95548057-cdb6-4ddb-ad1b-37fc290375fa admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:11.989623 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e178d8-407b-4850-81dd-eddad82b33ce admin admin] PATH_INFO: `/v3/projects/3e7477723e024f66b1437cc6cc530c12` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:11.991953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e178d8-407b-4850-81dd-eddad82b33ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e7477723e024f66b1437cc6cc530c12)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:11.995395 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af049650-35c1-4a58-8afe-d70d6e9dad5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:11.996173 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e178d8-407b-4850-81dd-eddad82b33ce admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:11.996383 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af049650-35c1-4a58-8afe-d70d6e9dad5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:11.996671 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af049650-35c1-4a58-8afe-d70d6e9dad5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:11.996950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af049650-35c1-4a58-8afe-d70d6e9dad5a admin admin] PATH_INFO: `/v3/projects/d829ce56b09a4ccbbef721c21632a560/users/4a121670847546b9ac5ce0a45ac16f7c/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:12.001609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af049650-35c1-4a58-8afe-d70d6e9dad5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d829ce56b09a4ccbbef721c21632a560, user_id=4a121670847546b9ac5ce0a45ac16f7c, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:12.006499 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af049650-35c1-4a58-8afe-d70d6e9dad5a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:12.033493 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1012/2062] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:41:11 2022] PUT /identity/v3/projects/d829ce56b09a4ccbbef721c21632a560/users/4a121670847546b9ac5ce0a45ac16f7c/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:12.035309 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347ba70-17f5-4d7b-9fc1-e0a60af854bf None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:12.035602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347ba70-17f5-4d7b-9fc1-e0a60af854bf None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:12.035879 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347ba70-17f5-4d7b-9fc1-e0a60af854bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:12.067795 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d347ba70-17f5-4d7b-9fc1-e0a60af854bf None None] MFA Rules not processed for user `4a121670847546b9ac5ce0a45ac16f7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:12.069037 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d347ba70-17f5-4d7b-9fc1-e0a60af854bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:12.098814 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:12.122762 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e2e178d8-407b-4850-81dd-eddad82b33ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e7477723e024f66b1437cc6cc530c12', 'request_id': 'req-e2e178d8-407b-4850-81dd-eddad82b33ce'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:12.138476 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e2e178d8-407b-4850-81dd-eddad82b33ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e7477723e024f66b1437cc6cc530c12', 'request_id': 'req-e2e178d8-407b-4850-81dd-eddad82b33ce'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:12.157799 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e2e178d8-407b-4850-81dd-eddad82b33ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e7477723e024f66b1437cc6cc530c12', 'request_id': 'req-e2e178d8-407b-4850-81dd-eddad82b33ce'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:12.184634 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e2e178d8-407b-4850-81dd-eddad82b33ce admin admin] The token cache is being invalidate because project 3e7477723e024f66b1437cc6cc530c12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:41:12.184634 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e2e178d8-407b-4850-81dd-eddad82b33ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:12.184923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e2e178d8-407b-4850-81dd-eddad82b33ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:12.188237 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1051/2063] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:41:11 2022] DELETE /identity/v3/projects/3e7477723e024f66b1437cc6cc530c12 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:12.193220 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907f98e-4476-4f6e-a6c7-5cc38ca97ab7 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:12.193321 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907f98e-4476-4f6e-a6c7-5cc38ca97ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:12.193579 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907f98e-4476-4f6e-a6c7-5cc38ca97ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:12.207013 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1013/2064] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:12 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:12.219823 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347ba70-17f5-4d7b-9fc1-e0a60af854bf None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:12.222373 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d347ba70-17f5-4d7b-9fc1-e0a60af854bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:12.242308 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-5907f98e-4476-4f6e-a6c7-5cc38ca97ab7 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:12.244209 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5907f98e-4476-4f6e-a6c7-5cc38ca97ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:12.335955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347ba70-17f5-4d7b-9fc1-e0a60af854bf None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:12.381063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1052/2065] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:12.386274 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807a6dd-ecbd-49fe-9898-e08d69eab7fd None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:12.386605 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807a6dd-ecbd-49fe-9898-e08d69eab7fd None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:12.386906 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807a6dd-ecbd-49fe-9898-e08d69eab7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:12.436484 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6807a6dd-ecbd-49fe-9898-e08d69eab7fd None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:12.436484 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6807a6dd-ecbd-49fe-9898-e08d69eab7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:12.463577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1053/2066] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:41:12.468321 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807a6dd-ecbd-49fe-9898-e08d69eab7fd None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:12.477778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41012eb0-2242-4fb4-afa2-e7687a29509d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:12.478378 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41012eb0-2242-4fb4-afa2-e7687a29509d service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:12.478474 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41012eb0-2242-4fb4-afa2-e7687a29509d service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:12.481268 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41012eb0-2242-4fb4-afa2-e7687a29509d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:12.487049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807a6dd-ecbd-49fe-9898-e08d69eab7fd None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:12.492015 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-41012eb0-2242-4fb4-afa2-e7687a29509d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:12.514524 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d718fd-9084-4cdf-8e94-cd2ee7204299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:12.515275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d718fd-9084-4cdf-8e94-cd2ee7204299 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:12.516223 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d718fd-9084-4cdf-8e94-cd2ee7204299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:12.516223 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d718fd-9084-4cdf-8e94-cd2ee7204299 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:12.516548 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d718fd-9084-4cdf-8e94-cd2ee7204299 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:41:12.516854 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d718fd-9084-4cdf-8e94-cd2ee7204299 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:12.519269 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d718fd-9084-4cdf-8e94-cd2ee7204299 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:12.543155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:12.549231 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1054/2067] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:41:12.555620 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d718fd-9084-4cdf-8e94-cd2ee7204299 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:12.569799 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d718fd-9084-4cdf-8e94-cd2ee7204299 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:12.593217 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398fee4-d60b-4f0d-a3d8-4445983e3753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:12.593906 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398fee4-d60b-4f0d-a3d8-4445983e3753 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:12.594372 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398fee4-d60b-4f0d-a3d8-4445983e3753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:12.594824 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398fee4-d60b-4f0d-a3d8-4445983e3753 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:12.595596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a398fee4-d60b-4f0d-a3d8-4445983e3753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:12.597536 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a398fee4-d60b-4f0d-a3d8-4445983e3753 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:12.688948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1055/2068] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:41:12 2022] POST /identity/v3/projects => generated 387 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:41:12.689201 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398fee4-d60b-4f0d-a3d8-4445983e3753 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:12.702397 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41012eb0-2242-4fb4-afa2-e7687a29509d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:12.704438 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41012eb0-2242-4fb4-afa2-e7687a29509d service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:12.728269 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1014/2069] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:12 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:41:12.848789 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398fee4-d60b-4f0d-a3d8-4445983e3753 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:12.855231 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acafd8b-40f4-4627-a973-27a47f640d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:12.855933 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acafd8b-40f4-4627-a973-27a47f640d1b admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:12.856215 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acafd8b-40f4-4627-a973-27a47f640d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:12.856487 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acafd8b-40f4-4627-a973-27a47f640d1b admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:12.857188 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acafd8b-40f4-4627-a973-27a47f640d1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:12.859346 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acafd8b-40f4-4627-a973-27a47f640d1b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:12.934627 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1056/2070] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:41:12 2022] POST /identity/v3/users => generated 294 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:41:12.938092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41012eb0-2242-4fb4-afa2-e7687a29509d service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:12.958300 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41012eb0-2242-4fb4-afa2-e7687a29509d service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:12.967348 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bf397-1a21-4461-868f-d01116a8244c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:12.968226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bf397-1a21-4461-868f-d01116a8244c admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:12.968906 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bf397-1a21-4461-868f-d01116a8244c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:12.969438 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bf397-1a21-4461-868f-d01116a8244c admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:12.970811 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bf397-1a21-4461-868f-d01116a8244c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:12.974351 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bf397-1a21-4461-868f-d01116a8244c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:13.003620 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acafd8b-40f4-4627-a973-27a47f640d1b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:13.008117 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1015/2071] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:41:13.017342 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acafd8b-40f4-4627-a973-27a47f640d1b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:13.029357 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cffa90-961f-4a53-a756-b02a99586887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:13.030054 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cffa90-961f-4a53-a756-b02a99586887 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:13.030336 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cffa90-961f-4a53-a756-b02a99586887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:13.030662 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cffa90-961f-4a53-a756-b02a99586887 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:13.031367 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cffa90-961f-4a53-a756-b02a99586887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:13.035035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cffa90-961f-4a53-a756-b02a99586887 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:13.059067 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bf397-1a21-4461-868f-d01116a8244c admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:13.061183 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1057/2072] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:41:13.080028 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bf397-1a21-4461-868f-d01116a8244c admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:13.096444 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ef74f-1af4-4d34-a31f-4ee3a7bd845d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:13.097936 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ef74f-1af4-4d34-a31f-4ee3a7bd845d admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:13.099725 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ef74f-1af4-4d34-a31f-4ee3a7bd845d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:13.100196 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ef74f-1af4-4d34-a31f-4ee3a7bd845d admin admin] PATH_INFO: `/v3/projects/694b7959d2c6457aad2c51c1ed63c066/users/ecc367df2228469d86280dc28b61c548/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:13.122779 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cffa90-961f-4a53-a756-b02a99586887 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:13.126996 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-66cffa90-961f-4a53-a756-b02a99586887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:13.148792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:13.161896 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ef74f-1af4-4d34-a31f-4ee3a7bd845d admin admin] RBAC: Authorizing `identity:create_grant(project_id=694b7959d2c6457aad2c51c1ed63c066, user_id=ecc367df2228469d86280dc28b61c548, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:13.174666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ef74f-1af4-4d34-a31f-4ee3a7bd845d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:13.209696 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1016/2073] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:41:13 2022] PUT /identity/v3/projects/694b7959d2c6457aad2c51c1ed63c066/users/ecc367df2228469d86280dc28b61c548/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:13.220164 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a449a38-4418-426c-b1fc-486c9593d3aa None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:13.221014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a449a38-4418-426c-b1fc-486c9593d3aa None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:13.221433 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a449a38-4418-426c-b1fc-486c9593d3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:13.283943 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-5a449a38-4418-426c-b1fc-486c9593d3aa None None] MFA Rules not processed for user `ecc367df2228469d86280dc28b61c548`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:13.285747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5a449a38-4418-426c-b1fc-486c9593d3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:13.287599 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cffa90-961f-4a53-a756-b02a99586887 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:13.385567 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bee9a9-cb46-4fd8-9fac-c50011dabe49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:13.387578 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bee9a9-cb46-4fd8-9fac-c50011dabe49 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:13.388199 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bee9a9-cb46-4fd8-9fac-c50011dabe49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:13.389248 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bee9a9-cb46-4fd8-9fac-c50011dabe49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:13.393712 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-37bee9a9-cb46-4fd8-9fac-c50011dabe49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:13.427074 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1017/2074] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:13.430124 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a449a38-4418-426c-b1fc-486c9593d3aa None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:13.473573 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:13.553757 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bee9a9-cb46-4fd8-9fac-c50011dabe49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:13.556347 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bee9a9-cb46-4fd8-9fac-c50011dabe49 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:13.582602 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1058/2075] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:13 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:13.591490 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a449a38-4418-426c-b1fc-486c9593d3aa None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:13.596813 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cb987-e91c-4794-ae4f-159220e1e0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:13.597557 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cb987-e91c-4794-ae4f-159220e1e0d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:13.597838 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cb987-e91c-4794-ae4f-159220e1e0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:13.598115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cb987-e91c-4794-ae4f-159220e1e0d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:13.598888 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cb987-e91c-4794-ae4f-159220e1e0d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:13.601909 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cb987-e91c-4794-ae4f-159220e1e0d9 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:13.646227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1018/2076] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:41:13 2022] POST /identity/v3/projects => generated 385 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:41:13.650079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bee9a9-cb46-4fd8-9fac-c50011dabe49 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:13.664625 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bee9a9-cb46-4fd8-9fac-c50011dabe49 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:13.746006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767b842-770a-4ea2-8d67-2a14683a3026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:13.746659 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767b842-770a-4ea2-8d67-2a14683a3026 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:13.747044 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767b842-770a-4ea2-8d67-2a14683a3026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:13.747764 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767b842-770a-4ea2-8d67-2a14683a3026 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:13.748571 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767b842-770a-4ea2-8d67-2a14683a3026 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:13.750964 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767b842-770a-4ea2-8d67-2a14683a3026 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:13.793464 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1059/2077] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:41:13 2022] POST /identity/v3/users => generated 299 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:41:13.797666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cb987-e91c-4794-ae4f-159220e1e0d9 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:13.813460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cb987-e91c-4794-ae4f-159220e1e0d9 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:13.822226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eab5bc-495b-41d1-adeb-54a0cc912b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:13.823056 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eab5bc-495b-41d1-adeb-54a0cc912b20 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:13.823404 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eab5bc-495b-41d1-adeb-54a0cc912b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:13.823745 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eab5bc-495b-41d1-adeb-54a0cc912b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:13.824705 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eab5bc-495b-41d1-adeb-54a0cc912b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:13.826327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eab5bc-495b-41d1-adeb-54a0cc912b20 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:13.843834 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1019/2078] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:41:13.847881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767b842-770a-4ea2-8d67-2a14683a3026 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:13.861013 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767b842-770a-4ea2-8d67-2a14683a3026 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:13.867344 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b1d4b-74e1-4349-ae0a-5aaec3feda90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:13.868654 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b1d4b-74e1-4349-ae0a-5aaec3feda90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:13.869043 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b1d4b-74e1-4349-ae0a-5aaec3feda90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:13.869417 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b1d4b-74e1-4349-ae0a-5aaec3feda90 admin admin] PATH_INFO: `/v3/projects/6e328188744a43bbbef6133919cfa517/users/222817700f3f424a80b67c4d9b39f380/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:13.910753 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b1d4b-74e1-4349-ae0a-5aaec3feda90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e328188744a43bbbef6133919cfa517, user_id=222817700f3f424a80b67c4d9b39f380, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:13.916442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b1d4b-74e1-4349-ae0a-5aaec3feda90 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:13.962328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1060/2079] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:41:13 2022] PUT /identity/v3/projects/6e328188744a43bbbef6133919cfa517/users/222817700f3f424a80b67c4d9b39f380/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:13.966764 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eab5bc-495b-41d1-adeb-54a0cc912b20 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:13.982916 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eab5bc-495b-41d1-adeb-54a0cc912b20 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:14.176082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:14.204972 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520dcfc-e904-4ab0-b476-4e1317d58377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:14.207211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520dcfc-e904-4ab0-b476-4e1317d58377 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:14.207501 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520dcfc-e904-4ab0-b476-4e1317d58377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:14.207781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520dcfc-e904-4ab0-b476-4e1317d58377 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:14.211371 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520dcfc-e904-4ab0-b476-4e1317d58377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:14.216662 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520dcfc-e904-4ab0-b476-4e1317d58377 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:14.256243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1020/2080] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:41:14.260568 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b1d4b-74e1-4349-ae0a-5aaec3feda90 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:14.289858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b1d4b-74e1-4349-ae0a-5aaec3feda90 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:14.316964 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635bfb2-241b-4b96-b426-cd3040953d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:14.324432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635bfb2-241b-4b96-b426-cd3040953d0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:14.326559 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635bfb2-241b-4b96-b426-cd3040953d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:14.328794 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635bfb2-241b-4b96-b426-cd3040953d0c admin admin] PATH_INFO: `/v3/projects/6e328188744a43bbbef6133919cfa517/users/222817700f3f424a80b67c4d9b39f380/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:14.337448 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635bfb2-241b-4b96-b426-cd3040953d0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e328188744a43bbbef6133919cfa517, user_id=222817700f3f424a80b67c4d9b39f380, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:14.343650 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635bfb2-241b-4b96-b426-cd3040953d0c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:14.396403 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1061/2081] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:41:14 2022] PUT /identity/v3/projects/6e328188744a43bbbef6133919cfa517/users/222817700f3f424a80b67c4d9b39f380/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:14.414513 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c1869-936f-4964-b987-467fe74d8537 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:14.414815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c1869-936f-4964-b987-467fe74d8537 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:14.415091 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c1869-936f-4964-b987-467fe74d8537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:14.500358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-f19c1869-936f-4964-b987-467fe74d8537 None None] MFA Rules not processed for user `222817700f3f424a80b67c4d9b39f380`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:14.501936 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f19c1869-936f-4964-b987-467fe74d8537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:14.626028 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1021/2082] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:14.637764 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635bfb2-241b-4b96-b426-cd3040953d0c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:14.713257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635bfb2-241b-4b96-b426-cd3040953d0c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:14.718239 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beaf837-1476-4292-a06e-e6aaa81cde44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:14.719254 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaf837-1476-4292-a06e-e6aaa81cde44 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:14.719662 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaf837-1476-4292-a06e-e6aaa81cde44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:14.720088 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaf837-1476-4292-a06e-e6aaa81cde44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:14.733287 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaf837-1476-4292-a06e-e6aaa81cde44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:14.734996 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaf837-1476-4292-a06e-e6aaa81cde44 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:14.766049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1062/2083] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:15.420174 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777fe17-42ea-43e9-bf8d-e34d7df6838c None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:15.420600 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777fe17-42ea-43e9-bf8d-e34d7df6838c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:15.421044 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777fe17-42ea-43e9-bf8d-e34d7df6838c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:15.486424 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-3777fe17-42ea-43e9-bf8d-e34d7df6838c None None] MFA Rules not processed for user `5e7ef880080b482fad46596bbd6e32d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:15.488298 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3777fe17-42ea-43e9-bf8d-e34d7df6838c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:15.650092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1022/2084] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:15.662253 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beaf837-1476-4292-a06e-e6aaa81cde44 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:15.663213 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777fe17-42ea-43e9-bf8d-e34d7df6838c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:15.664891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3777fe17-42ea-43e9-bf8d-e34d7df6838c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:15.697007 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:15.763598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777fe17-42ea-43e9-bf8d-e34d7df6838c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:15.767877 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa421d-425c-4983-a9d1-02be8575fe24 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22df4e0d98e34758963d3b1465a3a377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:15.768987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa421d-425c-4983-a9d1-02be8575fe24 service glance] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:15.769844 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa421d-425c-4983-a9d1-02be8575fe24 service glance] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:15.770324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa421d-425c-4983-a9d1-02be8575fe24 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:15.772571 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-bfaa421d-425c-4983-a9d1-02be8575fe24 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:15.791378 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:15.799627 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beaf837-1476-4292-a06e-e6aaa81cde44 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:15.826738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfce981-345c-4f26-9889-1b0e3c65c73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:15.827761 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfce981-345c-4f26-9889-1b0e3c65c73a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:15.828160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfce981-345c-4f26-9889-1b0e3c65c73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:15.828533 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfce981-345c-4f26-9889-1b0e3c65c73a admin admin] PATH_INFO: `/v3/users/ecc367df2228469d86280dc28b61c548` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:15.832135 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfce981-345c-4f26-9889-1b0e3c65c73a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecc367df2228469d86280dc28b61c548)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:15.837059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfce981-345c-4f26-9889-1b0e3c65c73a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:15.918036 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa421d-425c-4983-a9d1-02be8575fe24 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:15.919530 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa421d-425c-4983-a9d1-02be8575fe24 service glance] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:15.942710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fdfce981-345c-4f26-9889-1b0e3c65c73a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecc367df2228469d86280dc28b61c548'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:15.950945 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1023/2085] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:15.953140 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fdfce981-345c-4f26-9889-1b0e3c65c73a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecc367df2228469d86280dc28b61c548'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:15.954296 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fdfce981-345c-4f26-9889-1b0e3c65c73a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecc367df2228469d86280dc28b61c548'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:15.972570 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fdfce981-345c-4f26-9889-1b0e3c65c73a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecc367df2228469d86280dc28b61c548'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:15.974528 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fdfce981-345c-4f26-9889-1b0e3c65c73a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecc367df2228469d86280dc28b61c548'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:15.993134 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1063/2086] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:41:15 2022] DELETE /identity/v3/users/ecc367df2228469d86280dc28b61c548 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:15.997525 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72bfb2-0a2e-4373-a863-4034a7c25ec6 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:15.997740 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72bfb2-0a2e-4373-a863-4034a7c25ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:15.998013 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72bfb2-0a2e-4373-a863-4034a7c25ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:16.019543 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-dc72bfb2-0a2e-4373-a863-4034a7c25ec6 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:16.021568 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-dc72bfb2-0a2e-4373-a863-4034a7c25ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:16.060922 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2332f34-c5d8-45c1-89e6-078594e38adf None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:16.061332 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2332f34-c5d8-45c1-89e6-078594e38adf None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:16.061691 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2332f34-c5d8-45c1-89e6-078594e38adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:16.087150 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a2332f34-c5d8-45c1-89e6-078594e38adf None None] MFA Rules not processed for user `cbf7d6db675047cbb3a3f16631c59622`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:16.088461 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a2332f34-c5d8-45c1-89e6-078594e38adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:16.141375 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1024/2087] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:41:16.176707 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72bfb2-0a2e-4373-a863-4034a7c25ec6 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:16.178873 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-dc72bfb2-0a2e-4373-a863-4034a7c25ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:16.211694 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1064/2088] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 13:41:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:41:16.242669 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72bfb2-0a2e-4373-a863-4034a7c25ec6 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:16.246357 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881713d-e986-4650-a69b-4224eff30830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:16.247072 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881713d-e986-4650-a69b-4224eff30830 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:16.247809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881713d-e986-4650-a69b-4224eff30830 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:16.247809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881713d-e986-4650-a69b-4224eff30830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:16.257297 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2332f34-c5d8-45c1-89e6-078594e38adf None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:16.259477 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a2332f34-c5d8-45c1-89e6-078594e38adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:16.263034 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881713d-e986-4650-a69b-4224eff30830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:16.265581 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881713d-e986-4650-a69b-4224eff30830 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:16.281871 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1025/2089] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:16.321770 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:16.350996 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2332f34-c5d8-45c1-89e6-078594e38adf None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:16.357452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7e852-781d-43ec-bc5b-d5a36fe7ce94 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd0e37b0404419bb5752228bd809be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:16.358102 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7e852-781d-43ec-bc5b-d5a36fe7ce94 service swift] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:16.358366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7e852-781d-43ec-bc5b-d5a36fe7ce94 service swift] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:16.358653 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7e852-781d-43ec-bc5b-d5a36fe7ce94 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:16.369292 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7e852-781d-43ec-bc5b-d5a36fe7ce94 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:16.371004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7e852-781d-43ec-bc5b-d5a36fe7ce94 service swift] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:16.381768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1065/2090] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 13:41:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:41:16.638824 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881713d-e986-4650-a69b-4224eff30830 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:16.644961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0881713d-e986-4650-a69b-4224eff30830 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:16.667551 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881713d-e986-4650-a69b-4224eff30830 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:16.673977 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e51bc-5eee-48dd-94d0-806f11c59e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:16.676086 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e51bc-5eee-48dd-94d0-806f11c59e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:16.677288 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e51bc-5eee-48dd-94d0-806f11c59e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:16.677775 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e51bc-5eee-48dd-94d0-806f11c59e05 admin admin] PATH_INFO: `/v3/projects/694b7959d2c6457aad2c51c1ed63c066` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:16.680273 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e51bc-5eee-48dd-94d0-806f11c59e05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=694b7959d2c6457aad2c51c1ed63c066)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:16.683482 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e51bc-5eee-48dd-94d0-806f11c59e05 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:16.744848 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5f2e51bc-5eee-48dd-94d0-806f11c59e05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '694b7959d2c6457aad2c51c1ed63c066', 'request_id': 'req-5f2e51bc-5eee-48dd-94d0-806f11c59e05'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:16.747314 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:16.760338 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5f2e51bc-5eee-48dd-94d0-806f11c59e05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '694b7959d2c6457aad2c51c1ed63c066', 'request_id': 'req-5f2e51bc-5eee-48dd-94d0-806f11c59e05'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:16.766333 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5f2e51bc-5eee-48dd-94d0-806f11c59e05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '694b7959d2c6457aad2c51c1ed63c066', 'request_id': 'req-5f2e51bc-5eee-48dd-94d0-806f11c59e05'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:16.787549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5f2e51bc-5eee-48dd-94d0-806f11c59e05 admin admin] The token cache is being invalidate because project 694b7959d2c6457aad2c51c1ed63c066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:41:16.787754 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5f2e51bc-5eee-48dd-94d0-806f11c59e05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:16.788486 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5f2e51bc-5eee-48dd-94d0-806f11c59e05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:16.793206 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1026/2091] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:41:16 2022] DELETE /identity/v3/projects/694b7959d2c6457aad2c51c1ed63c066 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:16.794673 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7e852-781d-43ec-bc5b-d5a36fe7ce94 service swift] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:16.810279 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7e852-781d-43ec-bc5b-d5a36fe7ce94 service swift] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:16.896788 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5b275-6185-46e2-971b-b831200a505c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:16.897978 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5b275-6185-46e2-971b-b831200a505c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:16.898411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5b275-6185-46e2-971b-b831200a505c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:16.898896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5b275-6185-46e2-971b-b831200a505c admin admin] PATH_INFO: `/v3/users/222817700f3f424a80b67c4d9b39f380` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:16.900436 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5b275-6185-46e2-971b-b831200a505c admin admin] RBAC: Authorizing `identity:delete_user(user_id=222817700f3f424a80b67c4d9b39f380)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:16.903118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5b275-6185-46e2-971b-b831200a505c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:16.995408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0fa5b275-6185-46e2-971b-b831200a505c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '222817700f3f424a80b67c4d9b39f380'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:17.021575 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0fa5b275-6185-46e2-971b-b831200a505c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '222817700f3f424a80b67c4d9b39f380'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:17.022282 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0fa5b275-6185-46e2-971b-b831200a505c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '222817700f3f424a80b67c4d9b39f380'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:17.063865 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0fa5b275-6185-46e2-971b-b831200a505c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '222817700f3f424a80b67c4d9b39f380'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:17.064411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0fa5b275-6185-46e2-971b-b831200a505c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '222817700f3f424a80b67c4d9b39f380'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:17.086263 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1066/2092] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:41:16 2022] DELETE /identity/v3/users/222817700f3f424a80b67c4d9b39f380 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:17.609942 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e51bc-5eee-48dd-94d0-806f11c59e05 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:17.611991 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5f2e51bc-5eee-48dd-94d0-806f11c59e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:17.641052 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e51bc-5eee-48dd-94d0-806f11c59e05 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:17.743364 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b48151-609d-4e2e-b841-46af58d65e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:17.744438 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b48151-609d-4e2e-b841-46af58d65e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:17.744933 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b48151-609d-4e2e-b841-46af58d65e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:17.745301 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b48151-609d-4e2e-b841-46af58d65e00 admin admin] PATH_INFO: `/v3/projects/6e328188744a43bbbef6133919cfa517` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:17.746712 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b48151-609d-4e2e-b841-46af58d65e00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e328188744a43bbbef6133919cfa517)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:17.749079 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b48151-609d-4e2e-b841-46af58d65e00 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:17.827500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-19b48151-609d-4e2e-b841-46af58d65e00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e328188744a43bbbef6133919cfa517', 'request_id': 'req-19b48151-609d-4e2e-b841-46af58d65e00'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:17.835371 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-19b48151-609d-4e2e-b841-46af58d65e00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e328188744a43bbbef6133919cfa517', 'request_id': 'req-19b48151-609d-4e2e-b841-46af58d65e00'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:17.843726 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-19b48151-609d-4e2e-b841-46af58d65e00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e328188744a43bbbef6133919cfa517', 'request_id': 'req-19b48151-609d-4e2e-b841-46af58d65e00'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:17.862162 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-19b48151-609d-4e2e-b841-46af58d65e00 admin admin] The token cache is being invalidate because project 6e328188744a43bbbef6133919cfa517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:41:17.862963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-19b48151-609d-4e2e-b841-46af58d65e00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:17.866598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-19b48151-609d-4e2e-b841-46af58d65e00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:17.882225 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1027/2093] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:41:17 2022] DELETE /identity/v3/projects/6e328188744a43bbbef6133919cfa517 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:17.884265 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63241a26-c26f-4ecf-89a5-4ad5ab52f5c8 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:17.885003 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63241a26-c26f-4ecf-89a5-4ad5ab52f5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:17.885003 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63241a26-c26f-4ecf-89a5-4ad5ab52f5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:17.915912 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-63241a26-c26f-4ecf-89a5-4ad5ab52f5c8 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:17.918846 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-63241a26-c26f-4ecf-89a5-4ad5ab52f5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:17.987856 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:18.005405 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1067/2094] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:18.013369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebc671-d5d0-4b4b-aecb-24ee52c03773 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:18.013673 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebc671-d5d0-4b4b-aecb-24ee52c03773 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:18.014636 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebc671-d5d0-4b4b-aecb-24ee52c03773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:18.041405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-63ebc671-d5d0-4b4b-aecb-24ee52c03773 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:18.042862 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-63ebc671-d5d0-4b4b-aecb-24ee52c03773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:18.057106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1028/2095] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:18.060761 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63241a26-c26f-4ecf-89a5-4ad5ab52f5c8 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:18.073263 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63241a26-c26f-4ecf-89a5-4ad5ab52f5c8 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:18.080312 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71215819-e2d4-45a8-ae1b-66c523432633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:18.080971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71215819-e2d4-45a8-ae1b-66c523432633 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:18.081367 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71215819-e2d4-45a8-ae1b-66c523432633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:18.081825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71215819-e2d4-45a8-ae1b-66c523432633 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:18.082600 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71215819-e2d4-45a8-ae1b-66c523432633 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:41:18.082924 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71215819-e2d4-45a8-ae1b-66c523432633 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:18.084531 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71215819-e2d4-45a8-ae1b-66c523432633 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:18.099242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1068/2096] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:41:18.103727 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebc671-d5d0-4b4b-aecb-24ee52c03773 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:18.116340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebc671-d5d0-4b4b-aecb-24ee52c03773 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:18.121243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42728ab7-94e7-4653-a7f7-d775130069bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:18.121926 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42728ab7-94e7-4653-a7f7-d775130069bf admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:18.122230 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42728ab7-94e7-4653-a7f7-d775130069bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:18.122479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42728ab7-94e7-4653-a7f7-d775130069bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:18.123211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42728ab7-94e7-4653-a7f7-d775130069bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:18.125184 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42728ab7-94e7-4653-a7f7-d775130069bf admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:18.167430 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1029/2097] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:41:18 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:41:18.171148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71215819-e2d4-45a8-ae1b-66c523432633 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:18.188155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71215819-e2d4-45a8-ae1b-66c523432633 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:18.271095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96867f3-6079-45b6-a297-33377ee31862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:18.271963 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96867f3-6079-45b6-a297-33377ee31862 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:18.272539 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96867f3-6079-45b6-a297-33377ee31862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:18.272829 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96867f3-6079-45b6-a297-33377ee31862 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:18.274023 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96867f3-6079-45b6-a297-33377ee31862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:18.276793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96867f3-6079-45b6-a297-33377ee31862 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:18.318515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1069/2098] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:41:18 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:41:18.322796 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42728ab7-94e7-4653-a7f7-d775130069bf admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:18.341448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42728ab7-94e7-4653-a7f7-d775130069bf admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:18.347845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded477bf-77d3-4823-9a63-1033375e91cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:18.348955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded477bf-77d3-4823-9a63-1033375e91cf admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:18.349464 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded477bf-77d3-4823-9a63-1033375e91cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:18.349985 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded477bf-77d3-4823-9a63-1033375e91cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:18.353528 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded477bf-77d3-4823-9a63-1033375e91cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:18.355792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded477bf-77d3-4823-9a63-1033375e91cf admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:18.370917 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1030/2099] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:41:18.375997 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96867f3-6079-45b6-a297-33377ee31862 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:18.391548 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96867f3-6079-45b6-a297-33377ee31862 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:18.399574 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef055c0-efca-44a2-9798-528ecf642385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:18.400326 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef055c0-efca-44a2-9798-528ecf642385 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:18.400609 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef055c0-efca-44a2-9798-528ecf642385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:18.400886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef055c0-efca-44a2-9798-528ecf642385 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:18.401630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef055c0-efca-44a2-9798-528ecf642385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:18.403361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef055c0-efca-44a2-9798-528ecf642385 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:18.421032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1070/2100] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:41:18.426190 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded477bf-77d3-4823-9a63-1033375e91cf admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:18.442026 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded477bf-77d3-4823-9a63-1033375e91cf admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:18.450264 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd41fa-d346-4e0c-b4f4-33f220ca8f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:18.451220 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd41fa-d346-4e0c-b4f4-33f220ca8f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:18.451500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd41fa-d346-4e0c-b4f4-33f220ca8f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:18.451784 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd41fa-d346-4e0c-b4f4-33f220ca8f9f admin admin] PATH_INFO: `/v3/projects/cd758b9087d5443bb231c88a7828970b/users/7d94844718d84c1aa7e812c0e800390e/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:18.481847 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd41fa-d346-4e0c-b4f4-33f220ca8f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd758b9087d5443bb231c88a7828970b, user_id=7d94844718d84c1aa7e812c0e800390e, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:18.487098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd41fa-d346-4e0c-b4f4-33f220ca8f9f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:18.516298 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1031/2101] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:41:18 2022] PUT /identity/v3/projects/cd758b9087d5443bb231c88a7828970b/users/7d94844718d84c1aa7e812c0e800390e/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:18.528649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510b2d9-a71d-4a01-aa31-6e0749b69f1d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:18.530079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510b2d9-a71d-4a01-aa31-6e0749b69f1d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:18.530715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510b2d9-a71d-4a01-aa31-6e0749b69f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:18.606032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-9510b2d9-a71d-4a01-aa31-6e0749b69f1d None None] MFA Rules not processed for user `7d94844718d84c1aa7e812c0e800390e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:18.607616 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9510b2d9-a71d-4a01-aa31-6e0749b69f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:18.690136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1071/2102] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:18.698131 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd41fa-d346-4e0c-b4f4-33f220ca8f9f admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:18.701066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-25dd41fa-d346-4e0c-b4f4-33f220ca8f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:18.721204 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:18.829007 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd41fa-d346-4e0c-b4f4-33f220ca8f9f admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:18.837976 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660540a-92fc-4cee-b519-4dea720858d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22df4e0d98e34758963d3b1465a3a377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:18.839022 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660540a-92fc-4cee-b519-4dea720858d1 service glance] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:18.839399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660540a-92fc-4cee-b519-4dea720858d1 service glance] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:18.839801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660540a-92fc-4cee-b519-4dea720858d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:18.851264 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660540a-92fc-4cee-b519-4dea720858d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:18.852948 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660540a-92fc-4cee-b519-4dea720858d1 service glance] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:18.866520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1032/2103] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:20.414651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510b2d9-a71d-4a01-aa31-6e0749b69f1d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:20.415638 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9510b2d9-a71d-4a01-aa31-6e0749b69f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:20.513776 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:20.531576 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510b2d9-a71d-4a01-aa31-6e0749b69f1d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:20.544917 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b9ad9-e394-49b7-b6a0-ce821cc531b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:20.545979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b9ad9-e394-49b7-b6a0-ce821cc531b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:20.546263 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b9ad9-e394-49b7-b6a0-ce821cc531b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:20.546931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b9ad9-e394-49b7-b6a0-ce821cc531b5 admin admin] PATH_INFO: `/v3/users/f82b1ac9dc4b493eadaaa83e847ae6d2` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:20.549184 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b9ad9-e394-49b7-b6a0-ce821cc531b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f82b1ac9dc4b493eadaaa83e847ae6d2)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:20.551314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b9ad9-e394-49b7-b6a0-ce821cc531b5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:20.651958 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6d2b9ad9-e394-49b7-b6a0-ce821cc531b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f82b1ac9dc4b493eadaaa83e847ae6d2'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:20.665356 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6d2b9ad9-e394-49b7-b6a0-ce821cc531b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f82b1ac9dc4b493eadaaa83e847ae6d2'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:20.666073 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6d2b9ad9-e394-49b7-b6a0-ce821cc531b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f82b1ac9dc4b493eadaaa83e847ae6d2'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:20.683682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6d2b9ad9-e394-49b7-b6a0-ce821cc531b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f82b1ac9dc4b493eadaaa83e847ae6d2'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:20.684403 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6d2b9ad9-e394-49b7-b6a0-ce821cc531b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f82b1ac9dc4b493eadaaa83e847ae6d2'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:20.703740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1072/2104] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:41:20 2022] DELETE /identity/v3/users/f82b1ac9dc4b493eadaaa83e847ae6d2 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:20.708408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772698a-15ea-419f-8d1e-57e56b39fc93 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:20.709004 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772698a-15ea-419f-8d1e-57e56b39fc93 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:20.709159 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772698a-15ea-419f-8d1e-57e56b39fc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:20.734041 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-8772698a-15ea-419f-8d1e-57e56b39fc93 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:20.735299 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8772698a-15ea-419f-8d1e-57e56b39fc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:20.933815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1033/2105] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:20.947170 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b9ad9-e394-49b7-b6a0-ce821cc531b5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:20.951102 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6d2b9ad9-e394-49b7-b6a0-ce821cc531b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:21.049058 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b9ad9-e394-49b7-b6a0-ce821cc531b5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:21.053340 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78154123-655c-4a42-87d5-5a0bfe948a89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:21.055188 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78154123-655c-4a42-87d5-5a0bfe948a89 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:21.055543 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78154123-655c-4a42-87d5-5a0bfe948a89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:21.055879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78154123-655c-4a42-87d5-5a0bfe948a89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:21.076941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78154123-655c-4a42-87d5-5a0bfe948a89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:21.080116 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78154123-655c-4a42-87d5-5a0bfe948a89 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:21.101269 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1073/2106] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:21.661877 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772698a-15ea-419f-8d1e-57e56b39fc93 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:21.663732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8772698a-15ea-419f-8d1e-57e56b39fc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:21.678056 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772698a-15ea-419f-8d1e-57e56b39fc93 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:21.684459 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f0db6-90fc-4505-94ab-e408a057a3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:21.685732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f0db6-90fc-4505-94ab-e408a057a3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:21.686423 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f0db6-90fc-4505-94ab-e408a057a3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:21.686952 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f0db6-90fc-4505-94ab-e408a057a3aa admin admin] PATH_INFO: `/v3/projects/b2c534d0183245968349b71b424c02ae` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:21.688456 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f0db6-90fc-4505-94ab-e408a057a3aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2c534d0183245968349b71b424c02ae)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:21.690542 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f0db6-90fc-4505-94ab-e408a057a3aa admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:21.760805 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c42f0db6-90fc-4505-94ab-e408a057a3aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2c534d0183245968349b71b424c02ae', 'request_id': 'req-c42f0db6-90fc-4505-94ab-e408a057a3aa'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:21.769697 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c42f0db6-90fc-4505-94ab-e408a057a3aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2c534d0183245968349b71b424c02ae', 'request_id': 'req-c42f0db6-90fc-4505-94ab-e408a057a3aa'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:21.785970 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c42f0db6-90fc-4505-94ab-e408a057a3aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2c534d0183245968349b71b424c02ae', 'request_id': 'req-c42f0db6-90fc-4505-94ab-e408a057a3aa'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:21.805007 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c42f0db6-90fc-4505-94ab-e408a057a3aa admin admin] The token cache is being invalidate because project b2c534d0183245968349b71b424c02ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:41:21.805295 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c42f0db6-90fc-4505-94ab-e408a057a3aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:21.808013 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c42f0db6-90fc-4505-94ab-e408a057a3aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:21.809621 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1034/2107] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:41:21 2022] DELETE /identity/v3/projects/b2c534d0183245968349b71b424c02ae => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:21.813750 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78154123-655c-4a42-87d5-5a0bfe948a89 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:21.826086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78154123-655c-4a42-87d5-5a0bfe948a89 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:21.906508 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a123ac-0f81-439e-9dfc-4fdf32994982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:21.907504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a123ac-0f81-439e-9dfc-4fdf32994982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:21.907933 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a123ac-0f81-439e-9dfc-4fdf32994982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:21.908214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a123ac-0f81-439e-9dfc-4fdf32994982 admin admin] PATH_INFO: `/v3/users/4a121670847546b9ac5ce0a45ac16f7c` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:21.909491 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a123ac-0f81-439e-9dfc-4fdf32994982 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a121670847546b9ac5ce0a45ac16f7c)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:21.911584 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a123ac-0f81-439e-9dfc-4fdf32994982 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:21.927048 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:21.976079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-19a123ac-0f81-439e-9dfc-4fdf32994982 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a121670847546b9ac5ce0a45ac16f7c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:21.985934 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-19a123ac-0f81-439e-9dfc-4fdf32994982 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a121670847546b9ac5ce0a45ac16f7c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:21.986771 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-19a123ac-0f81-439e-9dfc-4fdf32994982 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a121670847546b9ac5ce0a45ac16f7c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:22.004879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-19a123ac-0f81-439e-9dfc-4fdf32994982 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a121670847546b9ac5ce0a45ac16f7c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:22.006673 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-19a123ac-0f81-439e-9dfc-4fdf32994982 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a121670847546b9ac5ce0a45ac16f7c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:22.020759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1074/2108] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:41:21 2022] DELETE /identity/v3/users/4a121670847546b9ac5ce0a45ac16f7c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:41:22.396650 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f0db6-90fc-4505-94ab-e408a057a3aa admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:22.398522 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c42f0db6-90fc-4505-94ab-e408a057a3aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:22.424706 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f0db6-90fc-4505-94ab-e408a057a3aa admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:22.498406 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:22.506990 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a123ac-0f81-439e-9dfc-4fdf32994982 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:22.509248 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-19a123ac-0f81-439e-9dfc-4fdf32994982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:22.552585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e8dcf-a8e5-40b2-8523-69338b1ecfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:22.553570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e8dcf-a8e5-40b2-8523-69338b1ecfb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:22.553917 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e8dcf-a8e5-40b2-8523-69338b1ecfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:22.554248 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e8dcf-a8e5-40b2-8523-69338b1ecfb1 admin admin] PATH_INFO: `/v3/projects/d829ce56b09a4ccbbef721c21632a560` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:22.559933 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e8dcf-a8e5-40b2-8523-69338b1ecfb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d829ce56b09a4ccbbef721c21632a560)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:22.566737 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e8dcf-a8e5-40b2-8523-69338b1ecfb1 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:22.639995 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a123ac-0f81-439e-9dfc-4fdf32994982 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:22.650615 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3d7e8dcf-a8e5-40b2-8523-69338b1ecfb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd829ce56b09a4ccbbef721c21632a560', 'request_id': 'req-3d7e8dcf-a8e5-40b2-8523-69338b1ecfb1'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:22.657436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3d7e8dcf-a8e5-40b2-8523-69338b1ecfb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd829ce56b09a4ccbbef721c21632a560', 'request_id': 'req-3d7e8dcf-a8e5-40b2-8523-69338b1ecfb1'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:22.666080 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3d7e8dcf-a8e5-40b2-8523-69338b1ecfb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd829ce56b09a4ccbbef721c21632a560', 'request_id': 'req-3d7e8dcf-a8e5-40b2-8523-69338b1ecfb1'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:22.691195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3d7e8dcf-a8e5-40b2-8523-69338b1ecfb1 admin admin] The token cache is being invalidate because project d829ce56b09a4ccbbef721c21632a560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:41:22.691586 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3d7e8dcf-a8e5-40b2-8523-69338b1ecfb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:22.692267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3d7e8dcf-a8e5-40b2-8523-69338b1ecfb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:22.694688 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1035/2109] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:41:22 2022] DELETE /identity/v3/projects/d829ce56b09a4ccbbef721c21632a560 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:22.700712 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711b748-09b8-423c-b253-8de996895feb None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:22.700992 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711b748-09b8-423c-b253-8de996895feb None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:22.701266 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711b748-09b8-423c-b253-8de996895feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:22.720453 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f7355-e6a9-4a7f-9c16-11f230c7856d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:22.721486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f7355-e6a9-4a7f-9c16-11f230c7856d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:22.721893 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f7355-e6a9-4a7f-9c16-11f230c7856d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:22.722239 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f7355-e6a9-4a7f-9c16-11f230c7856d admin admin] PATH_INFO: `/v3/users/461687e1c4d74d78bac372e6b9b64119` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:22.722862 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-a711b748-09b8-423c-b253-8de996895feb None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:22.723853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f7355-e6a9-4a7f-9c16-11f230c7856d admin admin] RBAC: Authorizing `identity:delete_user(user_id=461687e1c4d74d78bac372e6b9b64119)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:22.724075 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a711b748-09b8-423c-b253-8de996895feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:22.726397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f7355-e6a9-4a7f-9c16-11f230c7856d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:22.739923 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1036/2110] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:22.748287 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fad46c-d684-4ec4-825f-12e10da4453a None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:22.748617 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fad46c-d684-4ec4-825f-12e10da4453a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:22.748859 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fad46c-d684-4ec4-825f-12e10da4453a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:22.772485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-a7fad46c-d684-4ec4-825f-12e10da4453a None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:22.774599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a7fad46c-d684-4ec4-825f-12e10da4453a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:22.790643 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1037/2111] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:22.791943 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fad46c-d684-4ec4-825f-12e10da4453a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:22.808242 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fad46c-d684-4ec4-825f-12e10da4453a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:22.813378 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62c445-0edf-4381-a3cc-e9bc5e5f306c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:22.813989 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62c445-0edf-4381-a3cc-e9bc5e5f306c admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:22.814324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62c445-0edf-4381-a3cc-e9bc5e5f306c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:22.814534 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62c445-0edf-4381-a3cc-e9bc5e5f306c admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:22.817257 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62c445-0edf-4381-a3cc-e9bc5e5f306c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:41:22.817573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62c445-0edf-4381-a3cc-e9bc5e5f306c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:22.819470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62c445-0edf-4381-a3cc-e9bc5e5f306c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:22.839444 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1038/2112] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:41:22.841321 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62c445-0edf-4381-a3cc-e9bc5e5f306c admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:22.843186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:22.852244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7e8f7355-e6a9-4a7f-9c16-11f230c7856d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '461687e1c4d74d78bac372e6b9b64119'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:22.854353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62c445-0edf-4381-a3cc-e9bc5e5f306c admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:22.864548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cac439-b34f-4b05-9a89-e48fe67f3bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:22.865341 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7e8f7355-e6a9-4a7f-9c16-11f230c7856d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '461687e1c4d74d78bac372e6b9b64119'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:22.867018 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7e8f7355-e6a9-4a7f-9c16-11f230c7856d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '461687e1c4d74d78bac372e6b9b64119'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:22.868613 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cac439-b34f-4b05-9a89-e48fe67f3bbc admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:22.869985 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cac439-b34f-4b05-9a89-e48fe67f3bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:22.871533 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cac439-b34f-4b05-9a89-e48fe67f3bbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:22.872484 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cac439-b34f-4b05-9a89-e48fe67f3bbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:22.875764 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cac439-b34f-4b05-9a89-e48fe67f3bbc admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:22.895277 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7e8f7355-e6a9-4a7f-9c16-11f230c7856d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '461687e1c4d74d78bac372e6b9b64119'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:22.895960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7e8f7355-e6a9-4a7f-9c16-11f230c7856d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '461687e1c4d74d78bac372e6b9b64119'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:22.923744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1075/2113] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:41:22 2022] DELETE /identity/v3/users/461687e1c4d74d78bac372e6b9b64119 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:41:22.927812 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618de862-09b3-4936-94f1-b07a073c860c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:22.928575 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618de862-09b3-4936-94f1-b07a073c860c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:22.928927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618de862-09b3-4936-94f1-b07a073c860c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:22.933521 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1039/2114] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:41:22 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:41:22.939912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cac439-b34f-4b05-9a89-e48fe67f3bbc admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:22.942102 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a3cac439-b34f-4b05-9a89-e48fe67f3bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:22.970673 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-618de862-09b3-4936-94f1-b07a073c860c None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:22.975255 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-618de862-09b3-4936-94f1-b07a073c860c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:23.044448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cac439-b34f-4b05-9a89-e48fe67f3bbc admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:23.051454 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e299595-f23d-40bf-978c-29075c9e946e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:23.052397 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e299595-f23d-40bf-978c-29075c9e946e admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:23.052840 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e299595-f23d-40bf-978c-29075c9e946e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:23.053284 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e299595-f23d-40bf-978c-29075c9e946e admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:23.053982 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e299595-f23d-40bf-978c-29075c9e946e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:23.055946 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e299595-f23d-40bf-978c-29075c9e946e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:23.080170 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1040/2115] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:41:22 2022] POST /identity/v3/users => generated 287 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:41:23.084351 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e299595-f23d-40bf-978c-29075c9e946e admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:23.091709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:23.092035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1076/2116] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:23.097098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e299595-f23d-40bf-978c-29075c9e946e admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:23.103659 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38418b-c351-4178-aa7c-6fb63b6324f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:23.104149 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38418b-c351-4178-aa7c-6fb63b6324f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:23.104504 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38418b-c351-4178-aa7c-6fb63b6324f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:23.104878 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38418b-c351-4178-aa7c-6fb63b6324f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:23.106061 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618de862-09b3-4936-94f1-b07a073c860c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:23.110084 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-618de862-09b3-4936-94f1-b07a073c860c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:23.111833 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38418b-c351-4178-aa7c-6fb63b6324f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:23.114697 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38418b-c351-4178-aa7c-6fb63b6324f3 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:23.130758 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1041/2117] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:41:23.132514 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38418b-c351-4178-aa7c-6fb63b6324f3 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:23.146645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38418b-c351-4178-aa7c-6fb63b6324f3 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:23.154537 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30936d30-8e14-4090-8326-fc577d9bbeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:23.155980 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30936d30-8e14-4090-8326-fc577d9bbeb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:23.156260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30936d30-8e14-4090-8326-fc577d9bbeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:23.156525 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30936d30-8e14-4090-8326-fc577d9bbeb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:23.157262 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30936d30-8e14-4090-8326-fc577d9bbeb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:23.160661 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30936d30-8e14-4090-8326-fc577d9bbeb5 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:23.174623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1042/2118] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:41:23.178139 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30936d30-8e14-4090-8326-fc577d9bbeb5 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:23.189170 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30936d30-8e14-4090-8326-fc577d9bbeb5 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:23.194296 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b67dc4-d7d1-4274-9912-25d5c8890689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:23.195196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618de862-09b3-4936-94f1-b07a073c860c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:23.195672 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b67dc4-d7d1-4274-9912-25d5c8890689 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:23.195966 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b67dc4-d7d1-4274-9912-25d5c8890689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:23.196238 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b67dc4-d7d1-4274-9912-25d5c8890689 admin admin] PATH_INFO: `/v3/projects/20b68121c9af4336b680ec6ba1000173/users/e97316017ad448a594649f46fc4b9523/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:23.203672 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d815119-7a6f-4428-b674-597bcbbc944c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:23.204359 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d815119-7a6f-4428-b674-597bcbbc944c service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:23.204637 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d815119-7a6f-4428-b674-597bcbbc944c service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:23.204903 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d815119-7a6f-4428-b674-597bcbbc944c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:23.217432 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b67dc4-d7d1-4274-9912-25d5c8890689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b68121c9af4336b680ec6ba1000173, user_id=e97316017ad448a594649f46fc4b9523, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:23.222032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b67dc4-d7d1-4274-9912-25d5c8890689 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:23.222191 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d815119-7a6f-4428-b674-597bcbbc944c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:23.224551 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d815119-7a6f-4428-b674-597bcbbc944c service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:23.235149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1077/2119] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:41:23.254955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1043/2120] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:41:23 2022] PUT /identity/v3/projects/20b68121c9af4336b680ec6ba1000173/users/e97316017ad448a594649f46fc4b9523/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:23.256625 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0422e27-fa96-48b7-855b-68bacbc23b0d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:23.256955 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0422e27-fa96-48b7-855b-68bacbc23b0d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:23.257231 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0422e27-fa96-48b7-855b-68bacbc23b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:23.280484 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b0422e27-fa96-48b7-855b-68bacbc23b0d None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:23.281961 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b0422e27-fa96-48b7-855b-68bacbc23b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:23.395782 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1078/2121] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:23.423364 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b67dc4-d7d1-4274-9912-25d5c8890689 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:23.530086 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b67dc4-d7d1-4274-9912-25d5c8890689 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:23.539075 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac33c59-1fb1-4819-ba4e-885db3d5a3b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:23.539767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac33c59-1fb1-4819-ba4e-885db3d5a3b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:23.540050 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac33c59-1fb1-4819-ba4e-885db3d5a3b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:23.540329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac33c59-1fb1-4819-ba4e-885db3d5a3b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:23.565313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac33c59-1fb1-4819-ba4e-885db3d5a3b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:23.568818 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac33c59-1fb1-4819-ba4e-885db3d5a3b6 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:23.584686 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1044/2122] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:23.591556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0422e27-fa96-48b7-855b-68bacbc23b0d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:23.593220 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b0422e27-fa96-48b7-855b-68bacbc23b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:23.604679 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:23.640673 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0422e27-fa96-48b7-855b-68bacbc23b0d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:23.658476 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04f7c7-8bb3-4821-b2ea-8378c4c882ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:23.659594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04f7c7-8bb3-4821-b2ea-8378c4c882ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:23.659938 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04f7c7-8bb3-4821-b2ea-8378c4c882ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:23.660374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04f7c7-8bb3-4821-b2ea-8378c4c882ed admin admin] PATH_INFO: `/v3/projects/9f9eed21fdfa402389d322d474356f74` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:23.662240 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04f7c7-8bb3-4821-b2ea-8378c4c882ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f9eed21fdfa402389d322d474356f74)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:23.664291 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04f7c7-8bb3-4821-b2ea-8378c4c882ed admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:23.757956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9d04f7c7-8bb3-4821-b2ea-8378c4c882ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f9eed21fdfa402389d322d474356f74', 'request_id': 'req-9d04f7c7-8bb3-4821-b2ea-8378c4c882ed'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:23.767229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9d04f7c7-8bb3-4821-b2ea-8378c4c882ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f9eed21fdfa402389d322d474356f74', 'request_id': 'req-9d04f7c7-8bb3-4821-b2ea-8378c4c882ed'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:23.794736 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9d04f7c7-8bb3-4821-b2ea-8378c4c882ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f9eed21fdfa402389d322d474356f74', 'request_id': 'req-9d04f7c7-8bb3-4821-b2ea-8378c4c882ed'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:23.821480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9d04f7c7-8bb3-4821-b2ea-8378c4c882ed admin admin] The token cache is being invalidate because project 9f9eed21fdfa402389d322d474356f74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:41:23.822649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9d04f7c7-8bb3-4821-b2ea-8378c4c882ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:23.825271 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9d04f7c7-8bb3-4821-b2ea-8378c4c882ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:23.830665 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1079/2123] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:41:23 2022] DELETE /identity/v3/projects/9f9eed21fdfa402389d322d474356f74 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:23.833795 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2882a-0d55-4f6f-b04f-3b6d620776c1 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:23.834263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2882a-0d55-4f6f-b04f-3b6d620776c1 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:23.834351 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2882a-0d55-4f6f-b04f-3b6d620776c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:23.869996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-67c2882a-0d55-4f6f-b04f-3b6d620776c1 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:23.871498 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-67c2882a-0d55-4f6f-b04f-3b6d620776c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:23.975912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1045/2124] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:23.983719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1d5ba-be36-4faf-beef-ebc8ed07b75a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:23.984266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1d5ba-be36-4faf-beef-ebc8ed07b75a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:23.984266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1d5ba-be36-4faf-beef-ebc8ed07b75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:24.060987 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8fb1d5ba-be36-4faf-beef-ebc8ed07b75a None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:24.066831 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8fb1d5ba-be36-4faf-beef-ebc8ed07b75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:24.085160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1080/2125] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:24.088777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2882a-0d55-4f6f-b04f-3b6d620776c1 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:24.122609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2882a-0d55-4f6f-b04f-3b6d620776c1 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:24.127640 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162945dd-f10e-40ef-9fcd-d1222a256a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:24.129309 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162945dd-f10e-40ef-9fcd-d1222a256a36 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:24.129597 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162945dd-f10e-40ef-9fcd-d1222a256a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:24.129876 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162945dd-f10e-40ef-9fcd-d1222a256a36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:24.130650 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162945dd-f10e-40ef-9fcd-d1222a256a36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:41:24.130964 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162945dd-f10e-40ef-9fcd-d1222a256a36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:24.134386 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162945dd-f10e-40ef-9fcd-d1222a256a36 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:24.172852 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1046/2126] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:41:24.178612 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1d5ba-be36-4faf-beef-ebc8ed07b75a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:24.191851 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1d5ba-be36-4faf-beef-ebc8ed07b75a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:24.209039 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2d62c-601e-4ee9-b99c-8c3f9f0c0ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:24.209886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2d62c-601e-4ee9-b99c-8c3f9f0c0ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:24.210391 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2d62c-601e-4ee9-b99c-8c3f9f0c0ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:24.210779 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2d62c-601e-4ee9-b99c-8c3f9f0c0ac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:24.211625 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2d62c-601e-4ee9-b99c-8c3f9f0c0ac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:24.214894 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2d62c-601e-4ee9-b99c-8c3f9f0c0ac3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:24.279119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1081/2127] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:41:24 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:41:24.279330 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162945dd-f10e-40ef-9fcd-d1222a256a36 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:24.302170 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162945dd-f10e-40ef-9fcd-d1222a256a36 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:24.419963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:24.449156 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157e78f-a1a9-4f27-9584-8c942d34355e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:24.450760 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157e78f-a1a9-4f27-9584-8c942d34355e admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:24.451047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157e78f-a1a9-4f27-9584-8c942d34355e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:24.451324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157e78f-a1a9-4f27-9584-8c942d34355e admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:24.452060 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157e78f-a1a9-4f27-9584-8c942d34355e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:24.454777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157e78f-a1a9-4f27-9584-8c942d34355e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:24.506459 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2d62c-601e-4ee9-b99c-8c3f9f0c0ac3 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:24.514428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1047/2128] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:41:24 2022] POST /identity/v3/users => generated 282 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:41:24.520211 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2d62c-601e-4ee9-b99c-8c3f9f0c0ac3 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:24.528309 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113b7cb-64fb-429c-b305-43298e805988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:24.529220 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113b7cb-64fb-429c-b305-43298e805988 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:24.529442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113b7cb-64fb-429c-b305-43298e805988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:24.529715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113b7cb-64fb-429c-b305-43298e805988 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:24.532492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113b7cb-64fb-429c-b305-43298e805988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:24.534356 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113b7cb-64fb-429c-b305-43298e805988 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:24.567413 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1082/2129] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:41:24.571615 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157e78f-a1a9-4f27-9584-8c942d34355e admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:24.588697 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157e78f-a1a9-4f27-9584-8c942d34355e admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:24.602710 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94296c25-4071-4e02-abd2-59c4519c4eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:24.603783 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94296c25-4071-4e02-abd2-59c4519c4eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:24.604398 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94296c25-4071-4e02-abd2-59c4519c4eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:24.604711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94296c25-4071-4e02-abd2-59c4519c4eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:24.605702 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94296c25-4071-4e02-abd2-59c4519c4eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:24.608247 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94296c25-4071-4e02-abd2-59c4519c4eb9 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:24.652309 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113b7cb-64fb-429c-b305-43298e805988 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:24.658677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1048/2130] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:41:24.667018 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113b7cb-64fb-429c-b305-43298e805988 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:24.672816 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed7e24-e142-4b5f-9456-be4032dbe56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:24.674107 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed7e24-e142-4b5f-9456-be4032dbe56d admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:24.674501 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed7e24-e142-4b5f-9456-be4032dbe56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:24.674936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed7e24-e142-4b5f-9456-be4032dbe56d admin admin] PATH_INFO: `/v3/projects/d2631e7bf65f4c928158bc532f34da6b/users/ff8b41bb98ed40faa06ae7cd03268b71/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:24.688242 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671681c-287d-431a-acad-0591829177f4 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:24.688555 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671681c-287d-431a-acad-0591829177f4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:24.688998 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671681c-287d-431a-acad-0591829177f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:24.696109 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed7e24-e142-4b5f-9456-be4032dbe56d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2631e7bf65f4c928158bc532f34da6b, user_id=ff8b41bb98ed40faa06ae7cd03268b71, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:24.700588 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed7e24-e142-4b5f-9456-be4032dbe56d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:24.724645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-1671681c-287d-431a-acad-0591829177f4 None None] MFA Rules not processed for user `e97316017ad448a594649f46fc4b9523`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:24.726115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1671681c-287d-431a-acad-0591829177f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:24.741791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1083/2131] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:41:24 2022] PUT /identity/v3/projects/d2631e7bf65f4c928158bc532f34da6b/users/ff8b41bb98ed40faa06ae7cd03268b71/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:24.764918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79bcf8-a46b-4814-81e3-51fcfdbb04fe None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:24.765241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79bcf8-a46b-4814-81e3-51fcfdbb04fe None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:24.766903 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79bcf8-a46b-4814-81e3-51fcfdbb04fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:24.897708 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1049/2132] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:24.899534 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671681c-287d-431a-acad-0591829177f4 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:24.901002 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-7e79bcf8-a46b-4814-81e3-51fcfdbb04fe None None] MFA Rules not processed for user `ff8b41bb98ed40faa06ae7cd03268b71`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:24.902528 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7e79bcf8-a46b-4814-81e3-51fcfdbb04fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:24.925588 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1671681c-287d-431a-acad-0591829177f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:25.035697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1084/2133] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:24 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:25.048788 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79bcf8-a46b-4814-81e3-51fcfdbb04fe None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:25.050994 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7e79bcf8-a46b-4814-81e3-51fcfdbb04fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:25.068826 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:25.118701 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671681c-287d-431a-acad-0591829177f4 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:25.124122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9933c9-6a69-43d5-801c-23a213858d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:25.124876 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9933c9-6a69-43d5-801c-23a213858d71 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:25.125170 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9933c9-6a69-43d5-801c-23a213858d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:25.125442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9933c9-6a69-43d5-801c-23a213858d71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:25.126146 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9933c9-6a69-43d5-801c-23a213858d71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:25.128235 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9933c9-6a69-43d5-801c-23a213858d71 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:25.144872 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79bcf8-a46b-4814-81e3-51fcfdbb04fe None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:25.154975 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5c4c5-8308-4759-a7b1-0435cf1a753b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:25.156289 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5c4c5-8308-4759-a7b1-0435cf1a753b service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:25.158697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5c4c5-8308-4759-a7b1-0435cf1a753b service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:25.158697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5c4c5-8308-4759-a7b1-0435cf1a753b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:25.164323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1050/2134] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:41:24 2022] POST /identity/v3/projects => generated 367 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:41:25.168280 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9933c9-6a69-43d5-801c-23a213858d71 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:25.178013 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5c4c5-8308-4759-a7b1-0435cf1a753b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:25.181330 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5c4c5-8308-4759-a7b1-0435cf1a753b service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:25.204194 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1085/2135] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:25 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:25.245824 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:25.273388 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9933c9-6a69-43d5-801c-23a213858d71 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:25.279692 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cc2cf-f553-464e-86cd-34be6f1cc541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:25.280458 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cc2cf-f553-464e-86cd-34be6f1cc541 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:25.280809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cc2cf-f553-464e-86cd-34be6f1cc541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:25.281141 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cc2cf-f553-464e-86cd-34be6f1cc541 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:25.282031 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896cc2cf-f553-464e-86cd-34be6f1cc541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:25.284091 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896cc2cf-f553-464e-86cd-34be6f1cc541 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:25.316976 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1051/2136] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:41:25 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:41:25.321551 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5c4c5-8308-4759-a7b1-0435cf1a753b service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:25.338848 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5c4c5-8308-4759-a7b1-0435cf1a753b service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:25.350738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37253076-4fb1-458f-8f9c-a960ea2cb7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:25.351510 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37253076-4fb1-458f-8f9c-a960ea2cb7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:25.351865 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37253076-4fb1-458f-8f9c-a960ea2cb7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:25.352198 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37253076-4fb1-458f-8f9c-a960ea2cb7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:25.353027 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37253076-4fb1-458f-8f9c-a960ea2cb7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:25.357589 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37253076-4fb1-458f-8f9c-a960ea2cb7d0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:25.382102 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1086/2137] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:41:25.385844 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cc2cf-f553-464e-86cd-34be6f1cc541 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:25.407963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cc2cf-f553-464e-86cd-34be6f1cc541 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:25.414076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c6853-d9a2-40c2-9631-35c4b62b5e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:25.415085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c6853-d9a2-40c2-9631-35c4b62b5e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:25.415365 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c6853-d9a2-40c2-9631-35c4b62b5e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:25.415648 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c6853-d9a2-40c2-9631-35c4b62b5e21 admin admin] PATH_INFO: `/v3/projects/7aa6736dbb02426685427d653aac868b/users/c537c199da544e7781a8c5f61949c70a/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:25.434955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c6853-d9a2-40c2-9631-35c4b62b5e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aa6736dbb02426685427d653aac868b, user_id=c537c199da544e7781a8c5f61949c70a, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:25.438518 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c6853-d9a2-40c2-9631-35c4b62b5e21 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:25.457773 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1052/2138] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:41:25 2022] PUT /identity/v3/projects/7aa6736dbb02426685427d653aac868b/users/c537c199da544e7781a8c5f61949c70a/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:25.460709 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37253076-4fb1-458f-8f9c-a960ea2cb7d0 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:25.474761 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37253076-4fb1-458f-8f9c-a960ea2cb7d0 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:25.622458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560ea6f-273c-4b85-80e5-e50ace12139b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:25.624042 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560ea6f-273c-4b85-80e5-e50ace12139b admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:25.624487 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560ea6f-273c-4b85-80e5-e50ace12139b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:25.624596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560ea6f-273c-4b85-80e5-e50ace12139b admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:25.625315 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560ea6f-273c-4b85-80e5-e50ace12139b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:25.627827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560ea6f-273c-4b85-80e5-e50ace12139b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:25.658741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1087/2139] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:41:25.660995 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c6853-d9a2-40c2-9631-35c4b62b5e21 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:25.677566 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c6853-d9a2-40c2-9631-35c4b62b5e21 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:25.682985 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda6c3c-d606-41f2-85d0-34af581e2748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:25.684101 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda6c3c-d606-41f2-85d0-34af581e2748 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:25.684567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda6c3c-d606-41f2-85d0-34af581e2748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:25.685020 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda6c3c-d606-41f2-85d0-34af581e2748 admin admin] PATH_INFO: `/v3/projects/7aa6736dbb02426685427d653aac868b/users/c537c199da544e7781a8c5f61949c70a/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:25.687226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda6c3c-d606-41f2-85d0-34af581e2748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aa6736dbb02426685427d653aac868b, user_id=c537c199da544e7781a8c5f61949c70a, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:25.690044 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda6c3c-d606-41f2-85d0-34af581e2748 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:25.703667 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1053/2140] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:41:25 2022] PUT /identity/v3/projects/7aa6736dbb02426685427d653aac868b/users/c537c199da544e7781a8c5f61949c70a/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:26.975578 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5f623-0067-4604-b9cf-ae7a34932a93 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:26.976152 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5f623-0067-4604-b9cf-ae7a34932a93 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:26.976152 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5f623-0067-4604-b9cf-ae7a34932a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:27.031401 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-cfb5f623-0067-4604-b9cf-ae7a34932a93 None None] MFA Rules not processed for user `c537c199da544e7781a8c5f61949c70a`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:27.032795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cfb5f623-0067-4604-b9cf-ae7a34932a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:27.241278 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1088/2141] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:26 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:27.256967 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ffcf1-36fb-4508-a8ed-3dd3ec5bdc2f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:27.257929 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ffcf1-36fb-4508-a8ed-3dd3ec5bdc2f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:27.258962 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ffcf1-36fb-4508-a8ed-3dd3ec5bdc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:27.285565 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-f37ffcf1-36fb-4508-a8ed-3dd3ec5bdc2f None None] MFA Rules not processed for user `e97316017ad448a594649f46fc4b9523`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:27.294717 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f37ffcf1-36fb-4508-a8ed-3dd3ec5bdc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:27.410634 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1054/2142] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:41:27.422167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5f623-0067-4604-b9cf-ae7a34932a93 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:27.423630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cfb5f623-0067-4604-b9cf-ae7a34932a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:27.470164 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:27.549037 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5f623-0067-4604-b9cf-ae7a34932a93 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:27.558823 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9161f3f-7c4c-4ec0-9a9b-967ec65cc420 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:27.559538 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9161f3f-7c4c-4ec0-9a9b-967ec65cc420 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:27.559821 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9161f3f-7c4c-4ec0-9a9b-967ec65cc420 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:27.560147 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9161f3f-7c4c-4ec0-9a9b-967ec65cc420 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:27.569845 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9161f3f-7c4c-4ec0-9a9b-967ec65cc420 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:27.576884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9161f3f-7c4c-4ec0-9a9b-967ec65cc420 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:27.603386 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1089/2143] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:29.137770 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf06e7d-1060-458b-bd50-861269848be4 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:29.138328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf06e7d-1060-458b-bd50-861269848be4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:29.138328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf06e7d-1060-458b-bd50-861269848be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:29.157860 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-9bf06e7d-1060-458b-bd50-861269848be4 None None] MFA Rules not processed for user `bc022eae29434380af8bfdb9561e238d`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:29.159827 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9bf06e7d-1060-458b-bd50-861269848be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:29.216836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1055/2144] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:41:32.120067 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634eb7b-6b4b-478c-9961-bfe8f1c6fd6a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:32.120683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634eb7b-6b4b-478c-9961-bfe8f1c6fd6a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:32.120802 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634eb7b-6b4b-478c-9961-bfe8f1c6fd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:32.140385 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3634eb7b-6b4b-478c-9961-bfe8f1c6fd6a None None] MFA Rules not processed for user `cbf7d6db675047cbb3a3f16631c59622`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:32.141951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3634eb7b-6b4b-478c-9961-bfe8f1c6fd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:32.208041 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1090/2145] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 13:41:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:32.227212 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf06e7d-1060-458b-bd50-861269848be4 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:32.228738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9bf06e7d-1060-458b-bd50-861269848be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:32.300893 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:32.384833 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf06e7d-1060-458b-bd50-861269848be4 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:32.397988 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28440267-7fc7-409c-a369-ed7f19f3c941 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd0e37b0404419bb5752228bd809be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:32.397988 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28440267-7fc7-409c-a369-ed7f19f3c941 service swift] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:32.397988 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28440267-7fc7-409c-a369-ed7f19f3c941 service swift] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:32.397988 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28440267-7fc7-409c-a369-ed7f19f3c941 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:32.407827 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28440267-7fc7-409c-a369-ed7f19f3c941 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:32.411076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28440267-7fc7-409c-a369-ed7f19f3c941 service swift] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:32.435434 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1056/2146] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 13:41:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:41:41.598697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634eb7b-6b4b-478c-9961-bfe8f1c6fd6a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:41.600616 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3634eb7b-6b4b-478c-9961-bfe8f1c6fd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:41.683993 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634eb7b-6b4b-478c-9961-bfe8f1c6fd6a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:41.688490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df493197-4411-422f-b5a2-916fda03ece2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:41.689404 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df493197-4411-422f-b5a2-916fda03ece2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:41.689824 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df493197-4411-422f-b5a2-916fda03ece2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:41.690089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df493197-4411-422f-b5a2-916fda03ece2 admin admin] PATH_INFO: `/v3/users/7d94844718d84c1aa7e812c0e800390e` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:41.691545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df493197-4411-422f-b5a2-916fda03ece2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d94844718d84c1aa7e812c0e800390e)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:41.693774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df493197-4411-422f-b5a2-916fda03ece2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:41.752041 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-df493197-4411-422f-b5a2-916fda03ece2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d94844718d84c1aa7e812c0e800390e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:41.761730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-df493197-4411-422f-b5a2-916fda03ece2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d94844718d84c1aa7e812c0e800390e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:41.762844 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-df493197-4411-422f-b5a2-916fda03ece2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d94844718d84c1aa7e812c0e800390e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:41.765949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:41.787543 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-df493197-4411-422f-b5a2-916fda03ece2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d94844718d84c1aa7e812c0e800390e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:41.788419 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-df493197-4411-422f-b5a2-916fda03ece2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d94844718d84c1aa7e812c0e800390e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:41.801793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1091/2147] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:41:41 2022] DELETE /identity/v3/users/7d94844718d84c1aa7e812c0e800390e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:41.806806 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85ad19-f3a2-456c-8c29-a9f3e7255d29 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:41.807437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85ad19-f3a2-456c-8c29-a9f3e7255d29 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:41.807437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85ad19-f3a2-456c-8c29-a9f3e7255d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:41.826670 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-0d85ad19-f3a2-456c-8c29-a9f3e7255d29 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:41.827886 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0d85ad19-f3a2-456c-8c29-a9f3e7255d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:41.917535 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1057/2148] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:41.925065 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df493197-4411-422f-b5a2-916fda03ece2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:41.926514 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-df493197-4411-422f-b5a2-916fda03ece2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:41.986884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df493197-4411-422f-b5a2-916fda03ece2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:41.997517 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003f61c-e3b2-4bce-a150-7703e603e0a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:41.998270 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003f61c-e3b2-4bce-a150-7703e603e0a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:42.011058 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003f61c-e3b2-4bce-a150-7703e603e0a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:42.011427 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003f61c-e3b2-4bce-a150-7703e603e0a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:42.030070 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003f61c-e3b2-4bce-a150-7703e603e0a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:42.032015 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003f61c-e3b2-4bce-a150-7703e603e0a6 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:42.056132 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1092/2149] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:42.367352 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85ad19-f3a2-456c-8c29-a9f3e7255d29 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:42.368905 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0d85ad19-f3a2-456c-8c29-a9f3e7255d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:42.381276 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85ad19-f3a2-456c-8c29-a9f3e7255d29 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:42.386408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83d709-05b6-4c5c-b5ae-bce30578fe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:42.387316 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83d709-05b6-4c5c-b5ae-bce30578fe39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:42.387594 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83d709-05b6-4c5c-b5ae-bce30578fe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:42.387864 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83d709-05b6-4c5c-b5ae-bce30578fe39 admin admin] PATH_INFO: `/v3/projects/cd758b9087d5443bb231c88a7828970b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:42.389041 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83d709-05b6-4c5c-b5ae-bce30578fe39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd758b9087d5443bb231c88a7828970b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:42.391079 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83d709-05b6-4c5c-b5ae-bce30578fe39 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:42.447489 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fc83d709-05b6-4c5c-b5ae-bce30578fe39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd758b9087d5443bb231c88a7828970b', 'request_id': 'req-fc83d709-05b6-4c5c-b5ae-bce30578fe39'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:42.453515 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fc83d709-05b6-4c5c-b5ae-bce30578fe39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd758b9087d5443bb231c88a7828970b', 'request_id': 'req-fc83d709-05b6-4c5c-b5ae-bce30578fe39'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:42.459837 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fc83d709-05b6-4c5c-b5ae-bce30578fe39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd758b9087d5443bb231c88a7828970b', 'request_id': 'req-fc83d709-05b6-4c5c-b5ae-bce30578fe39'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:42.477286 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fc83d709-05b6-4c5c-b5ae-bce30578fe39 admin admin] The token cache is being invalidate because project cd758b9087d5443bb231c88a7828970b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:41:42.477792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fc83d709-05b6-4c5c-b5ae-bce30578fe39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:42.478612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fc83d709-05b6-4c5c-b5ae-bce30578fe39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:42.480395 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1058/2150] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:41:42 2022] DELETE /identity/v3/projects/cd758b9087d5443bb231c88a7828970b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:42.490635 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fcdae-6878-4b92-ad10-a8d154475b54 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:42.490635 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fcdae-6878-4b92-ad10-a8d154475b54 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:42.490635 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fcdae-6878-4b92-ad10-a8d154475b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:42.513682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-611fcdae-6878-4b92-ad10-a8d154475b54 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:42.519822 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-611fcdae-6878-4b92-ad10-a8d154475b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:42.588901 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1093/2151] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:42.597883 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58c8b6-46db-41d0-888c-8b76c0596cd7 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:42.598174 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58c8b6-46db-41d0-888c-8b76c0596cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:42.598453 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58c8b6-46db-41d0-888c-8b76c0596cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:42.617731 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-2b58c8b6-46db-41d0-888c-8b76c0596cd7 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:42.618877 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2b58c8b6-46db-41d0-888c-8b76c0596cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:42.628128 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1059/2152] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:42.632827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fcdae-6878-4b92-ad10-a8d154475b54 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:42.645424 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fcdae-6878-4b92-ad10-a8d154475b54 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:42.651735 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d0dc8-b40e-4cde-90e5-dc0ad1e4ed1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:42.652448 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d0dc8-b40e-4cde-90e5-dc0ad1e4ed1c admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:42.652729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d0dc8-b40e-4cde-90e5-dc0ad1e4ed1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:42.653000 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d0dc8-b40e-4cde-90e5-dc0ad1e4ed1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:42.653748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d0dc8-b40e-4cde-90e5-dc0ad1e4ed1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:41:42.654053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d0dc8-b40e-4cde-90e5-dc0ad1e4ed1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:42.655820 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d0dc8-b40e-4cde-90e5-dc0ad1e4ed1c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:42.674966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1094/2153] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:41:42.679954 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58c8b6-46db-41d0-888c-8b76c0596cd7 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:42.690105 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58c8b6-46db-41d0-888c-8b76c0596cd7 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:42.695944 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed483ba3-04db-413c-b4ab-f1455b0df9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:42.696606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed483ba3-04db-413c-b4ab-f1455b0df9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:42.696880 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed483ba3-04db-413c-b4ab-f1455b0df9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:42.697144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed483ba3-04db-413c-b4ab-f1455b0df9b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:42.697834 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed483ba3-04db-413c-b4ab-f1455b0df9b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:42.699762 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed483ba3-04db-413c-b4ab-f1455b0df9b2 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:42.731683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1060/2154] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:41:42 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:41:42.736702 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d0dc8-b40e-4cde-90e5-dc0ad1e4ed1c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:42.748474 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d0dc8-b40e-4cde-90e5-dc0ad1e4ed1c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:42.812884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd5572-fadc-4f44-a415-fd56d127113d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:42.813625 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd5572-fadc-4f44-a415-fd56d127113d admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:42.813994 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd5572-fadc-4f44-a415-fd56d127113d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:42.814355 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd5572-fadc-4f44-a415-fd56d127113d admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:42.815126 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd5572-fadc-4f44-a415-fd56d127113d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:42.817311 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd5572-fadc-4f44-a415-fd56d127113d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:42.827234 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:42.841778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1095/2155] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:41:42 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:41:42.845880 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed483ba3-04db-413c-b4ab-f1455b0df9b2 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:42.856560 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed483ba3-04db-413c-b4ab-f1455b0df9b2 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:42.861852 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0c75d-2649-40e9-b1f2-a68068a9e5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:42.862522 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0c75d-2649-40e9-b1f2-a68068a9e5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:42.862838 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0c75d-2649-40e9-b1f2-a68068a9e5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:42.863109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0c75d-2649-40e9-b1f2-a68068a9e5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:42.863835 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0c75d-2649-40e9-b1f2-a68068a9e5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:42.866156 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0c75d-2649-40e9-b1f2-a68068a9e5c0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:42.879896 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1061/2156] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:41:42.881548 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd5572-fadc-4f44-a415-fd56d127113d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:42.891697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd5572-fadc-4f44-a415-fd56d127113d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:42.897511 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d975123-59fd-406e-b703-60e05007ee0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:42.898176 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d975123-59fd-406e-b703-60e05007ee0c admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:42.898488 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d975123-59fd-406e-b703-60e05007ee0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:42.898788 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d975123-59fd-406e-b703-60e05007ee0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:42.899529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d975123-59fd-406e-b703-60e05007ee0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:42.901244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d975123-59fd-406e-b703-60e05007ee0c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:42.912651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1096/2157] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:41:42.917226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0c75d-2649-40e9-b1f2-a68068a9e5c0 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:42.927761 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0c75d-2649-40e9-b1f2-a68068a9e5c0 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:42.933305 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb364e-e090-401b-a852-51b7d381cbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:42.934193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb364e-e090-401b-a852-51b7d381cbf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:42.934468 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb364e-e090-401b-a852-51b7d381cbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:42.934775 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb364e-e090-401b-a852-51b7d381cbf0 admin admin] PATH_INFO: `/v3/projects/40bd13a4f17a4e37b8939db1f8082858/users/fe0684cc7de64886b05f4b29a0995aaf/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:42.950194 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb364e-e090-401b-a852-51b7d381cbf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40bd13a4f17a4e37b8939db1f8082858, user_id=fe0684cc7de64886b05f4b29a0995aaf, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:42.952861 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb364e-e090-401b-a852-51b7d381cbf0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:42.955013 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:42.968660 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1062/2158] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:41:42 2022] PUT /identity/v3/projects/40bd13a4f17a4e37b8939db1f8082858/users/fe0684cc7de64886b05f4b29a0995aaf/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:42.979765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f952ca7-df14-49a9-a2e0-cbf3da4b683c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:42.980128 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f952ca7-df14-49a9-a2e0-cbf3da4b683c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:42.980404 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f952ca7-df14-49a9-a2e0-cbf3da4b683c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:43.018022 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-5f952ca7-df14-49a9-a2e0-cbf3da4b683c None None] MFA Rules not processed for user `fe0684cc7de64886b05f4b29a0995aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:43.019546 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5f952ca7-df14-49a9-a2e0-cbf3da4b683c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:43.088829 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1097/2159] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:43.100729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb364e-e090-401b-a852-51b7d381cbf0 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:43.102508 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b9bb364e-e090-401b-a852-51b7d381cbf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:43.160554 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb364e-e090-401b-a852-51b7d381cbf0 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:43.164383 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00358883-3f7c-4273-bdb9-6f0fa649a0e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:43.165029 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00358883-3f7c-4273-bdb9-6f0fa649a0e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:43.165306 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00358883-3f7c-4273-bdb9-6f0fa649a0e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:43.165562 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00358883-3f7c-4273-bdb9-6f0fa649a0e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:43.174929 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00358883-3f7c-4273-bdb9-6f0fa649a0e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:43.177474 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00358883-3f7c-4273-bdb9-6f0fa649a0e4 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:43.188719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1063/2160] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:53.083124 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:INSERT=1,keystone:SELECT=39 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:53.184116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:INSERT=1,keystone:SELECT=28 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:53.442964 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f952ca7-df14-49a9-a2e0-cbf3da4b683c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:53.529765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f952ca7-df14-49a9-a2e0-cbf3da4b683c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:53.534282 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c25a4c-916e-4219-8d29-a958d8f4107c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:53.535210 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c25a4c-916e-4219-8d29-a958d8f4107c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:53.535489 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c25a4c-916e-4219-8d29-a958d8f4107c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:53.535763 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c25a4c-916e-4219-8d29-a958d8f4107c admin admin] PATH_INFO: `/v3/users/fe0684cc7de64886b05f4b29a0995aaf` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:53.536961 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c25a4c-916e-4219-8d29-a958d8f4107c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe0684cc7de64886b05f4b29a0995aaf)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:53.539061 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c25a4c-916e-4219-8d29-a958d8f4107c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:53.609357 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-68c25a4c-916e-4219-8d29-a958d8f4107c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe0684cc7de64886b05f4b29a0995aaf'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:53.624015 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-68c25a4c-916e-4219-8d29-a958d8f4107c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe0684cc7de64886b05f4b29a0995aaf'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:53.627913 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-68c25a4c-916e-4219-8d29-a958d8f4107c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe0684cc7de64886b05f4b29a0995aaf'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:53.652264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-68c25a4c-916e-4219-8d29-a958d8f4107c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe0684cc7de64886b05f4b29a0995aaf'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:53.653447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-68c25a4c-916e-4219-8d29-a958d8f4107c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe0684cc7de64886b05f4b29a0995aaf'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:53.678850 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1098/2161] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:41:53 2022] DELETE /identity/v3/users/fe0684cc7de64886b05f4b29a0995aaf => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:53.683631 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89691ab-b873-4127-8a77-54d3900d3558 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:53.683914 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89691ab-b873-4127-8a77-54d3900d3558 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:53.684187 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89691ab-b873-4127-8a77-54d3900d3558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:53.703327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d89691ab-b873-4127-8a77-54d3900d3558 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:53.704538 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d89691ab-b873-4127-8a77-54d3900d3558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:53.776704 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1064/2162] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:41:53.783405 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c25a4c-916e-4219-8d29-a958d8f4107c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:53.785050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-68c25a4c-916e-4219-8d29-a958d8f4107c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:53.852868 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c25a4c-916e-4219-8d29-a958d8f4107c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:53.856811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b66f64-ad22-4216-8e19-d2ec1f9276d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:53.857682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b66f64-ad22-4216-8e19-d2ec1f9276d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:53.858125 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b66f64-ad22-4216-8e19-d2ec1f9276d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:53.858547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b66f64-ad22-4216-8e19-d2ec1f9276d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:53.869245 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b66f64-ad22-4216-8e19-d2ec1f9276d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:53.870870 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b66f64-ad22-4216-8e19-d2ec1f9276d8 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:53.881103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1099/2163] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:54.195112 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89691ab-b873-4127-8a77-54d3900d3558 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:54.196559 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d89691ab-b873-4127-8a77-54d3900d3558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:54.209641 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89691ab-b873-4127-8a77-54d3900d3558 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:54.214354 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afff09f-d2ce-4647-9b05-7c8751488b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:54.215338 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afff09f-d2ce-4647-9b05-7c8751488b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:54.215650 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afff09f-d2ce-4647-9b05-7c8751488b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:54.215938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afff09f-d2ce-4647-9b05-7c8751488b2b admin admin] PATH_INFO: `/v3/projects/40bd13a4f17a4e37b8939db1f8082858` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:54.217105 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afff09f-d2ce-4647-9b05-7c8751488b2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=40bd13a4f17a4e37b8939db1f8082858)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:54.219033 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afff09f-d2ce-4647-9b05-7c8751488b2b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:54.272651 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-7afff09f-d2ce-4647-9b05-7c8751488b2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40bd13a4f17a4e37b8939db1f8082858', 'request_id': 'req-7afff09f-d2ce-4647-9b05-7c8751488b2b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:54.279033 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-7afff09f-d2ce-4647-9b05-7c8751488b2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40bd13a4f17a4e37b8939db1f8082858', 'request_id': 'req-7afff09f-d2ce-4647-9b05-7c8751488b2b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:54.287431 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-7afff09f-d2ce-4647-9b05-7c8751488b2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40bd13a4f17a4e37b8939db1f8082858', 'request_id': 'req-7afff09f-d2ce-4647-9b05-7c8751488b2b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:54.306979 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-7afff09f-d2ce-4647-9b05-7c8751488b2b admin admin] The token cache is being invalidate because project 40bd13a4f17a4e37b8939db1f8082858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:41:54.307269 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-7afff09f-d2ce-4647-9b05-7c8751488b2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:54.308078 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-7afff09f-d2ce-4647-9b05-7c8751488b2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:54.309691 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1065/2164] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:41:54 2022] DELETE /identity/v3/projects/40bd13a4f17a4e37b8939db1f8082858 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:59.318589 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3633c7-90a1-47d6-a72f-c2020f97b479 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:59.319477 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3633c7-90a1-47d6-a72f-c2020f97b479 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:59.319829 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3633c7-90a1-47d6-a72f-c2020f97b479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:59.349437 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2e3633c7-90a1-47d6-a72f-c2020f97b479 None None] MFA Rules not processed for user `f0f9f36f32754886b5a66a88c229f147`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:59.350772 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2e3633c7-90a1-47d6-a72f-c2020f97b479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:59.359098 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:59.411623 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1100/2165] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:41:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:02.736804 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afff09f-d2ce-4647-9b05-7c8751488b2b admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:02.738650 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7afff09f-d2ce-4647-9b05-7c8751488b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:02.912120 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:02.967371 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afff09f-d2ce-4647-9b05-7c8751488b2b admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:02.972305 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961aef3-9366-413b-b5d4-590c11a8aaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:02.973364 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961aef3-9366-413b-b5d4-590c11a8aaf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:02.973772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961aef3-9366-413b-b5d4-590c11a8aaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:02.974032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961aef3-9366-413b-b5d4-590c11a8aaf4 admin admin] PATH_INFO: `/v3/users/ff8b41bb98ed40faa06ae7cd03268b71` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:02.975354 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961aef3-9366-413b-b5d4-590c11a8aaf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff8b41bb98ed40faa06ae7cd03268b71)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:02.977430 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961aef3-9366-413b-b5d4-590c11a8aaf4 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:03.046180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a961aef3-9366-413b-b5d4-590c11a8aaf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff8b41bb98ed40faa06ae7cd03268b71'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:03.058234 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a961aef3-9366-413b-b5d4-590c11a8aaf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff8b41bb98ed40faa06ae7cd03268b71'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:03.060540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a961aef3-9366-413b-b5d4-590c11a8aaf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff8b41bb98ed40faa06ae7cd03268b71'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:03.068447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a961aef3-9366-413b-b5d4-590c11a8aaf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff8b41bb98ed40faa06ae7cd03268b71'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:03.084006 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a961aef3-9366-413b-b5d4-590c11a8aaf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff8b41bb98ed40faa06ae7cd03268b71'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:03.091682 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1066/2166] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:42:02 2022] DELETE /identity/v3/users/ff8b41bb98ed40faa06ae7cd03268b71 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:42:03.096060 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41872b5c-46d4-4bc9-b678-02d6cf725646 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:03.097042 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41872b5c-46d4-4bc9-b678-02d6cf725646 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:03.097500 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41872b5c-46d4-4bc9-b678-02d6cf725646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:03.132214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-41872b5c-46d4-4bc9-b678-02d6cf725646 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:03.134081 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-41872b5c-46d4-4bc9-b678-02d6cf725646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:03.197766 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1101/2167] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:42:03.207864 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961aef3-9366-413b-b5d4-590c11a8aaf4 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:03.209349 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a961aef3-9366-413b-b5d4-590c11a8aaf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:03.312552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961aef3-9366-413b-b5d4-590c11a8aaf4 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:03.317470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead3670-cedb-4dce-80d1-ff5396734616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:03.318349 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead3670-cedb-4dce-80d1-ff5396734616 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:03.318733 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead3670-cedb-4dce-80d1-ff5396734616 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:03.319068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead3670-cedb-4dce-80d1-ff5396734616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:03.329299 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead3670-cedb-4dce-80d1-ff5396734616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:03.330946 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead3670-cedb-4dce-80d1-ff5396734616 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:03.343085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1067/2168] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:03.913657 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41872b5c-46d4-4bc9-b678-02d6cf725646 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:03.915643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-41872b5c-46d4-4bc9-b678-02d6cf725646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:03.975898 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41872b5c-46d4-4bc9-b678-02d6cf725646 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:04.000958 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69594ff4-8c4b-40c4-bed5-4f55ba4fa2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:04.001985 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69594ff4-8c4b-40c4-bed5-4f55ba4fa2db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:04.002134 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69594ff4-8c4b-40c4-bed5-4f55ba4fa2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:04.002405 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69594ff4-8c4b-40c4-bed5-4f55ba4fa2db admin admin] PATH_INFO: `/v3/projects/d2631e7bf65f4c928158bc532f34da6b` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:04.003636 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69594ff4-8c4b-40c4-bed5-4f55ba4fa2db admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2631e7bf65f4c928158bc532f34da6b)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:04.005945 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69594ff4-8c4b-40c4-bed5-4f55ba4fa2db admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:04.068898 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-69594ff4-8c4b-40c4-bed5-4f55ba4fa2db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2631e7bf65f4c928158bc532f34da6b', 'request_id': 'req-69594ff4-8c4b-40c4-bed5-4f55ba4fa2db'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:04.076143 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-69594ff4-8c4b-40c4-bed5-4f55ba4fa2db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2631e7bf65f4c928158bc532f34da6b', 'request_id': 'req-69594ff4-8c4b-40c4-bed5-4f55ba4fa2db'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:04.085873 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-69594ff4-8c4b-40c4-bed5-4f55ba4fa2db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2631e7bf65f4c928158bc532f34da6b', 'request_id': 'req-69594ff4-8c4b-40c4-bed5-4f55ba4fa2db'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:04.106496 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-69594ff4-8c4b-40c4-bed5-4f55ba4fa2db admin admin] The token cache is being invalidate because project d2631e7bf65f4c928158bc532f34da6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:42:04.107193 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-69594ff4-8c4b-40c4-bed5-4f55ba4fa2db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:04.107454 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-69594ff4-8c4b-40c4-bed5-4f55ba4fa2db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:04.109025 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1102/2169] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:42:03 2022] DELETE /identity/v3/projects/d2631e7bf65f4c928158bc532f34da6b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:04.463681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead3670-cedb-4dce-80d1-ff5396734616 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:04.465794 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6ead3670-cedb-4dce-80d1-ff5396734616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:04.489258 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:04.535680 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead3670-cedb-4dce-80d1-ff5396734616 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:04.594716 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b7143-4335-4b7c-8e34-2fe651084b0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:04.595386 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b7143-4335-4b7c-8e34-2fe651084b0e service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:04.595675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b7143-4335-4b7c-8e34-2fe651084b0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:04.595941 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b7143-4335-4b7c-8e34-2fe651084b0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:04.598024 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4c3b7143-4335-4b7c-8e34-2fe651084b0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:04.672158 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b7143-4335-4b7c-8e34-2fe651084b0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:04.673580 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b7143-4335-4b7c-8e34-2fe651084b0e service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:04.684016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1068/2170] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:04 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:05.944553 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69594ff4-8c4b-40c4-bed5-4f55ba4fa2db admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:05.946117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-69594ff4-8c4b-40c4-bed5-4f55ba4fa2db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:05.986658 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:06.005276 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69594ff4-8c4b-40c4-bed5-4f55ba4fa2db admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:06.009312 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3617816-c63f-4f43-a3ac-85efb88eb4e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:06.009962 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3617816-c63f-4f43-a3ac-85efb88eb4e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:06.010237 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3617816-c63f-4f43-a3ac-85efb88eb4e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:06.010510 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3617816-c63f-4f43-a3ac-85efb88eb4e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:06.012342 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c3617816-c63f-4f43-a3ac-85efb88eb4e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:06.075854 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3617816-c63f-4f43-a3ac-85efb88eb4e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:06.077292 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3617816-c63f-4f43-a3ac-85efb88eb4e4 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:06.087354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1103/2171] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:13.280300 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a627b-8057-451b-aefb-69dcfd43c8bd None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:13.280886 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a627b-8057-451b-aefb-69dcfd43c8bd None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:13.281172 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a627b-8057-451b-aefb-69dcfd43c8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:13.300431 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-c38a627b-8057-451b-aefb-69dcfd43c8bd None None] MFA Rules not processed for user `bb90d2315ce54db8820d4943b1a8c53c`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:13.301656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c38a627b-8057-451b-aefb-69dcfd43c8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:13.364070 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1069/2172] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:42:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:15.228591 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff05ac-f2da-4538-a24e-2f070c277d86 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:15.229103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff05ac-f2da-4538-a24e-2f070c277d86 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:15.229202 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff05ac-f2da-4538-a24e-2f070c277d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:15.259475 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0bff05ac-f2da-4538-a24e-2f070c277d86 None None] MFA Rules not processed for user `cbf7d6db675047cbb3a3f16631c59622`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:15.260693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0bff05ac-f2da-4538-a24e-2f070c277d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:15.329233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1104/2173] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 13:42:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:15.343289 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a627b-8057-451b-aefb-69dcfd43c8bd None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:15.345095 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c38a627b-8057-451b-aefb-69dcfd43c8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:15.379802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:15.423829 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a627b-8057-451b-aefb-69dcfd43c8bd None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:15.429328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6065fb-d5ac-4b11-bdf7-f5d56410843c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd0e37b0404419bb5752228bd809be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:15.430305 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6065fb-d5ac-4b11-bdf7-f5d56410843c service swift] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:15.430598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6065fb-d5ac-4b11-bdf7-f5d56410843c service swift] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:15.430895 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6065fb-d5ac-4b11-bdf7-f5d56410843c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:15.439603 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6065fb-d5ac-4b11-bdf7-f5d56410843c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:15.441244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6065fb-d5ac-4b11-bdf7-f5d56410843c service swift] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:15.452199 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1070/2174] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 13:42:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 13:42:25.321839 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=63 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:25.448076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=19 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:28.110487 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc37b3a-313d-4c01-87df-13ba0bad0417 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:28.110487 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc37b3a-313d-4c01-87df-13ba0bad0417 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:28.111234 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc37b3a-313d-4c01-87df-13ba0bad0417 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:28.112802 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1105/2175] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 13:42:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:42:28.122633 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c38402-a7fc-4485-8374-5db9009742dc None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:28.123260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c38402-a7fc-4485-8374-5db9009742dc None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:28.123855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c38402-a7fc-4485-8374-5db9009742dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:28.205557 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-e8c38402-a7fc-4485-8374-5db9009742dc None None] MFA Rules not processed for user `2f7ea9741a5d409d87b8ebb4390a74ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:28.207150 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e8c38402-a7fc-4485-8374-5db9009742dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:28.295686 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1071/2176] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 13:42:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:28.311003 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc37b3a-313d-4c01-87df-13ba0bad0417 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:28.313242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-acc37b3a-313d-4c01-87df-13ba0bad0417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:28.336535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc37b3a-313d-4c01-87df-13ba0bad0417 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:28.344586 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66dc4f5-2d6e-41c3-bc89-23c019e98128 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f7ea9741a5d409d87b8ebb4390a74ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:28.346088 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dc4f5-2d6e-41c3-bc89-23c019e98128 service placement] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:28.346375 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dc4f5-2d6e-41c3-bc89-23c019e98128 service placement] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:28.347302 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dc4f5-2d6e-41c3-bc89-23c019e98128 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:28.357372 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66dc4f5-2d6e-41c3-bc89-23c019e98128 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:28.359029 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66dc4f5-2d6e-41c3-bc89-23c019e98128 service placement] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:28.369807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1106/2177] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:28.779231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c38402-a7fc-4485-8374-5db9009742dc None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:28.781018 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e8c38402-a7fc-4485-8374-5db9009742dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:28.858662 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c38402-a7fc-4485-8374-5db9009742dc None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:28.863413 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9a0b3-c404-42fb-9c5f-dda92e1573e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:28.864312 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9a0b3-c404-42fb-9c5f-dda92e1573e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:28.864587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9a0b3-c404-42fb-9c5f-dda92e1573e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:28.864858 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9a0b3-c404-42fb-9c5f-dda92e1573e7 admin admin] PATH_INFO: `/v3/users/e97316017ad448a594649f46fc4b9523` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:28.866136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9a0b3-c404-42fb-9c5f-dda92e1573e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e97316017ad448a594649f46fc4b9523)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:28.868695 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9a0b3-c404-42fb-9c5f-dda92e1573e7 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:28.917019 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-dbe9a0b3-c404-42fb-9c5f-dda92e1573e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e97316017ad448a594649f46fc4b9523'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:28.925069 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-dbe9a0b3-c404-42fb-9c5f-dda92e1573e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e97316017ad448a594649f46fc4b9523'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:28.925681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-dbe9a0b3-c404-42fb-9c5f-dda92e1573e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e97316017ad448a594649f46fc4b9523'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:28.927808 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:28.934283 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-dbe9a0b3-c404-42fb-9c5f-dda92e1573e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e97316017ad448a594649f46fc4b9523'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:28.949018 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-dbe9a0b3-c404-42fb-9c5f-dda92e1573e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e97316017ad448a594649f46fc4b9523'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:28.955471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1072/2178] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:42:28 2022] DELETE /identity/v3/users/e97316017ad448a594649f46fc4b9523 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:29.132811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66dc4f5-2d6e-41c3-bc89-23c019e98128 service placement] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:29.158261 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66dc4f5-2d6e-41c3-bc89-23c019e98128 service placement] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:29.222507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6067cc-a312-4391-864b-909f823f441e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:29.223396 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6067cc-a312-4391-864b-909f823f441e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:29.223709 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6067cc-a312-4391-864b-909f823f441e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:29.223977 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6067cc-a312-4391-864b-909f823f441e admin admin] PATH_INFO: `/v3/projects/20b68121c9af4336b680ec6ba1000173` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:29.226189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6067cc-a312-4391-864b-909f823f441e admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b68121c9af4336b680ec6ba1000173)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:29.228323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6067cc-a312-4391-864b-909f823f441e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:29.282943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-aa6067cc-a312-4391-864b-909f823f441e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b68121c9af4336b680ec6ba1000173', 'request_id': 'req-aa6067cc-a312-4391-864b-909f823f441e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:29.288239 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-aa6067cc-a312-4391-864b-909f823f441e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b68121c9af4336b680ec6ba1000173', 'request_id': 'req-aa6067cc-a312-4391-864b-909f823f441e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:29.294847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-aa6067cc-a312-4391-864b-909f823f441e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b68121c9af4336b680ec6ba1000173', 'request_id': 'req-aa6067cc-a312-4391-864b-909f823f441e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:29.309303 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-aa6067cc-a312-4391-864b-909f823f441e admin admin] The token cache is being invalidate because project 20b68121c9af4336b680ec6ba1000173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:42:29.309582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-aa6067cc-a312-4391-864b-909f823f441e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:29.310229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-aa6067cc-a312-4391-864b-909f823f441e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:29.311814 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1107/2179] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:42:29 2022] DELETE /identity/v3/projects/20b68121c9af4336b680ec6ba1000173 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:29.316006 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9a0b3-c404-42fb-9c5f-dda92e1573e7 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:29.317531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-dbe9a0b3-c404-42fb-9c5f-dda92e1573e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:29.331988 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9a0b3-c404-42fb-9c5f-dda92e1573e7 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:29.393609 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5a39a-420f-42f5-ba9b-87dec6ad4c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:29.394506 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5a39a-420f-42f5-ba9b-87dec6ad4c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:29.394844 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5a39a-420f-42f5-ba9b-87dec6ad4c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:29.395115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5a39a-420f-42f5-ba9b-87dec6ad4c0d admin admin] PATH_INFO: `/v3/users/c537c199da544e7781a8c5f61949c70a` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:29.396313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5a39a-420f-42f5-ba9b-87dec6ad4c0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c537c199da544e7781a8c5f61949c70a)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:29.398249 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5a39a-420f-42f5-ba9b-87dec6ad4c0d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:29.452690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-16e5a39a-420f-42f5-ba9b-87dec6ad4c0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c537c199da544e7781a8c5f61949c70a'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:29.460003 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-16e5a39a-420f-42f5-ba9b-87dec6ad4c0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c537c199da544e7781a8c5f61949c70a'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:29.460622 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-16e5a39a-420f-42f5-ba9b-87dec6ad4c0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c537c199da544e7781a8c5f61949c70a'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:29.468308 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-16e5a39a-420f-42f5-ba9b-87dec6ad4c0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c537c199da544e7781a8c5f61949c70a'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:29.482191 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-16e5a39a-420f-42f5-ba9b-87dec6ad4c0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c537c199da544e7781a8c5f61949c70a'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:29.488957 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1073/2180] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:42:29 2022] DELETE /identity/v3/users/c537c199da544e7781a8c5f61949c70a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:29.683261 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6067cc-a312-4391-864b-909f823f441e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:29.684740 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-aa6067cc-a312-4391-864b-909f823f441e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:29.701339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6067cc-a312-4391-864b-909f823f441e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:29.763954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e4b4a-fade-48a6-9018-61cf8fea4495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:29.764908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e4b4a-fade-48a6-9018-61cf8fea4495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:29.765182 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e4b4a-fade-48a6-9018-61cf8fea4495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:29.765456 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e4b4a-fade-48a6-9018-61cf8fea4495 admin admin] PATH_INFO: `/v3/projects/7aa6736dbb02426685427d653aac868b` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:29.767291 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e4b4a-fade-48a6-9018-61cf8fea4495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aa6736dbb02426685427d653aac868b)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:29.769497 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e4b4a-fade-48a6-9018-61cf8fea4495 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:29.800957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:29.837090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6c3e4b4a-fade-48a6-9018-61cf8fea4495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aa6736dbb02426685427d653aac868b', 'request_id': 'req-6c3e4b4a-fade-48a6-9018-61cf8fea4495'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:29.844374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6c3e4b4a-fade-48a6-9018-61cf8fea4495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aa6736dbb02426685427d653aac868b', 'request_id': 'req-6c3e4b4a-fade-48a6-9018-61cf8fea4495'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:29.852088 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6c3e4b4a-fade-48a6-9018-61cf8fea4495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aa6736dbb02426685427d653aac868b', 'request_id': 'req-6c3e4b4a-fade-48a6-9018-61cf8fea4495'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:29.870316 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6c3e4b4a-fade-48a6-9018-61cf8fea4495 admin admin] The token cache is being invalidate because project 7aa6736dbb02426685427d653aac868b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:42:29.871152 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6c3e4b4a-fade-48a6-9018-61cf8fea4495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:29.871725 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6c3e4b4a-fade-48a6-9018-61cf8fea4495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:29.873711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1108/2181] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:42:29 2022] DELETE /identity/v3/projects/7aa6736dbb02426685427d653aac868b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:29.878478 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f80dce-15bd-4075-91ab-cdd023f4140e None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:29.878828 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f80dce-15bd-4075-91ab-cdd023f4140e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:29.879129 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f80dce-15bd-4075-91ab-cdd023f4140e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:29.918588 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-15f80dce-15bd-4075-91ab-cdd023f4140e None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:29.919779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-15f80dce-15bd-4075-91ab-cdd023f4140e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:29.958295 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:29.986335 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1074/2182] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:29.994657 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641651f-ec84-4ab6-8b14-2e53a86d525c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:29.994946 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641651f-ec84-4ab6-8b14-2e53a86d525c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:29.995217 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641651f-ec84-4ab6-8b14-2e53a86d525c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:30.013798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2641651f-ec84-4ab6-8b14-2e53a86d525c None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:30.014917 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2641651f-ec84-4ab6-8b14-2e53a86d525c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:30.023286 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1109/2183] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:30.027833 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f80dce-15bd-4075-91ab-cdd023f4140e None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:30.037646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f80dce-15bd-4075-91ab-cdd023f4140e None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:30.042441 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c35162-3b2c-4171-8453-ae115f92f43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:30.043418 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c35162-3b2c-4171-8453-ae115f92f43c admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:30.043694 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c35162-3b2c-4171-8453-ae115f92f43c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:30.043958 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c35162-3b2c-4171-8453-ae115f92f43c admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:30.044680 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c35162-3b2c-4171-8453-ae115f92f43c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:42:30.044979 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c35162-3b2c-4171-8453-ae115f92f43c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:30.046602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c35162-3b2c-4171-8453-ae115f92f43c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:30.059020 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1075/2184] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:42:30.063507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641651f-ec84-4ab6-8b14-2e53a86d525c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:30.073226 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641651f-ec84-4ab6-8b14-2e53a86d525c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:30.078497 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89f843-f32a-4b9d-a26a-c29adcbf3a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:30.079201 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89f843-f32a-4b9d-a26a-c29adcbf3a1e admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:30.079481 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89f843-f32a-4b9d-a26a-c29adcbf3a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:30.079749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89f843-f32a-4b9d-a26a-c29adcbf3a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:30.080441 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89f843-f32a-4b9d-a26a-c29adcbf3a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:30.082434 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89f843-f32a-4b9d-a26a-c29adcbf3a1e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:30.110854 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1110/2185] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:42:30 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:42:30.115227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c35162-3b2c-4171-8453-ae115f92f43c admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:30.125918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c35162-3b2c-4171-8453-ae115f92f43c admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:30.187391 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fbd64-f355-405e-8fc1-bf3cdfc7f547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:30.188073 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fbd64-f355-405e-8fc1-bf3cdfc7f547 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:30.188350 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fbd64-f355-405e-8fc1-bf3cdfc7f547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:30.188621 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fbd64-f355-405e-8fc1-bf3cdfc7f547 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:30.189343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fbd64-f355-405e-8fc1-bf3cdfc7f547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:30.191294 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fbd64-f355-405e-8fc1-bf3cdfc7f547 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:30.214771 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1076/2186] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:42:30 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:42:30.218983 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89f843-f32a-4b9d-a26a-c29adcbf3a1e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:30.229948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89f843-f32a-4b9d-a26a-c29adcbf3a1e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:30.237552 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2104ea-b639-409a-b244-2df71aae7154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:30.238226 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2104ea-b639-409a-b244-2df71aae7154 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:30.238498 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2104ea-b639-409a-b244-2df71aae7154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:30.238792 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2104ea-b639-409a-b244-2df71aae7154 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:30.239548 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2104ea-b639-409a-b244-2df71aae7154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:30.241263 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2104ea-b639-409a-b244-2df71aae7154 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:30.253413 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1111/2187] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:42:30.257592 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fbd64-f355-405e-8fc1-bf3cdfc7f547 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:30.268183 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fbd64-f355-405e-8fc1-bf3cdfc7f547 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:30.272997 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df34a4-e8d0-4f0b-adc5-baf38e13a74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:30.273769 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df34a4-e8d0-4f0b-adc5-baf38e13a74b admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:30.274045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df34a4-e8d0-4f0b-adc5-baf38e13a74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:30.274342 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df34a4-e8d0-4f0b-adc5-baf38e13a74b admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:30.275104 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df34a4-e8d0-4f0b-adc5-baf38e13a74b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:30.276686 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df34a4-e8d0-4f0b-adc5-baf38e13a74b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:30.287219 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1077/2188] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:42:30.291271 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2104ea-b639-409a-b244-2df71aae7154 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:30.301133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2104ea-b639-409a-b244-2df71aae7154 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:30.305793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169232b7-a582-4ce1-aca3-c6c490be3297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:30.306703 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169232b7-a582-4ce1-aca3-c6c490be3297 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:30.306980 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169232b7-a582-4ce1-aca3-c6c490be3297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:30.307251 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169232b7-a582-4ce1-aca3-c6c490be3297 admin admin] PATH_INFO: `/v3/projects/31d0766f5bfe4760bc5e1ef217049330/users/f57e9f67b3b748a78bf0284bed4c9dc6/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:30.322309 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169232b7-a582-4ce1-aca3-c6c490be3297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d0766f5bfe4760bc5e1ef217049330, user_id=f57e9f67b3b748a78bf0284bed4c9dc6, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:30.324994 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169232b7-a582-4ce1-aca3-c6c490be3297 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:30.340458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1112/2189] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:42:30 2022] PUT /identity/v3/projects/31d0766f5bfe4760bc5e1ef217049330/users/f57e9f67b3b748a78bf0284bed4c9dc6/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:42:30.351176 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f4585-27e9-459e-b16a-30081ef8473c None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:30.351810 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f4585-27e9-459e-b16a-30081ef8473c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:30.352060 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f4585-27e9-459e-b16a-30081ef8473c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:30.379391 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-e66f4585-27e9-459e-b16a-30081ef8473c None None] MFA Rules not processed for user `f57e9f67b3b748a78bf0284bed4c9dc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:30.380607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e66f4585-27e9-459e-b16a-30081ef8473c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:30.452791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1078/2190] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:42:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:30.457289 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169232b7-a582-4ce1-aca3-c6c490be3297 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:30.519706 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169232b7-a582-4ce1-aca3-c6c490be3297 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:30.525498 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943d7fc-30b3-4b94-bc48-cf3fb4be8656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:30.526165 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943d7fc-30b3-4b94-bc48-cf3fb4be8656 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:30.526442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943d7fc-30b3-4b94-bc48-cf3fb4be8656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:30.527411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943d7fc-30b3-4b94-bc48-cf3fb4be8656 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:30.527564 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943d7fc-30b3-4b94-bc48-cf3fb4be8656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:30.529599 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943d7fc-30b3-4b94-bc48-cf3fb4be8656 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:30.558218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1113/2191] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:42:30 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:42:30.562366 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f4585-27e9-459e-b16a-30081ef8473c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:30.574219 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f4585-27e9-459e-b16a-30081ef8473c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:30.611848 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:30.640996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded519a4-710c-4b40-866c-dbf6e7cbaae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:30.642047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded519a4-710c-4b40-866c-dbf6e7cbaae0 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:30.642323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded519a4-710c-4b40-866c-dbf6e7cbaae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:30.642620 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded519a4-710c-4b40-866c-dbf6e7cbaae0 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:30.643399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded519a4-710c-4b40-866c-dbf6e7cbaae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:30.645733 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded519a4-710c-4b40-866c-dbf6e7cbaae0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:30.669638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1079/2192] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:42:30 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:42:30.670935 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943d7fc-30b3-4b94-bc48-cf3fb4be8656 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:30.681715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943d7fc-30b3-4b94-bc48-cf3fb4be8656 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:30.686338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d314a2a-143a-4151-a54f-17fb2d08eb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:30.687049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d314a2a-143a-4151-a54f-17fb2d08eb45 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:30.687326 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d314a2a-143a-4151-a54f-17fb2d08eb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:30.687593 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d314a2a-143a-4151-a54f-17fb2d08eb45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:30.688322 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d314a2a-143a-4151-a54f-17fb2d08eb45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:30.689972 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d314a2a-143a-4151-a54f-17fb2d08eb45 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:30.701422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1114/2193] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:42:30.705663 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded519a4-710c-4b40-866c-dbf6e7cbaae0 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:30.715989 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded519a4-710c-4b40-866c-dbf6e7cbaae0 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:30.720480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394d242-a623-4e54-be36-16b847e817bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:30.721427 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394d242-a623-4e54-be36-16b847e817bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:30.721707 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394d242-a623-4e54-be36-16b847e817bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:30.721977 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394d242-a623-4e54-be36-16b847e817bb admin admin] PATH_INFO: `/v3/projects/8e3829224eb04064b95d077188943a00/users/d8abbab7301d4f2e9f07afdbc8527a63/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:30.738102 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394d242-a623-4e54-be36-16b847e817bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e3829224eb04064b95d077188943a00, user_id=d8abbab7301d4f2e9f07afdbc8527a63, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:30.740869 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394d242-a623-4e54-be36-16b847e817bb admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:30.755488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1080/2194] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:42:30 2022] PUT /identity/v3/projects/8e3829224eb04064b95d077188943a00/users/d8abbab7301d4f2e9f07afdbc8527a63/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:42:30.759504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d314a2a-143a-4151-a54f-17fb2d08eb45 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:30.771983 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d314a2a-143a-4151-a54f-17fb2d08eb45 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:30.788565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:30.834515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590eeb50-925a-4446-9555-0ecf6aa99e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:30.835226 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590eeb50-925a-4446-9555-0ecf6aa99e01 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:30.835508 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590eeb50-925a-4446-9555-0ecf6aa99e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:30.835871 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590eeb50-925a-4446-9555-0ecf6aa99e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:30.836630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590eeb50-925a-4446-9555-0ecf6aa99e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:30.838226 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590eeb50-925a-4446-9555-0ecf6aa99e01 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:30.848975 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1115/2195] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:42:30.853346 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394d242-a623-4e54-be36-16b847e817bb admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:30.863241 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394d242-a623-4e54-be36-16b847e817bb admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:30.868371 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c98d3-3f4d-4680-993a-f23f79b5d152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:30.869269 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c98d3-3f4d-4680-993a-f23f79b5d152 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:30.869523 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c98d3-3f4d-4680-993a-f23f79b5d152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:30.869797 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c98d3-3f4d-4680-993a-f23f79b5d152 admin admin] PATH_INFO: `/v3/projects/8e3829224eb04064b95d077188943a00/users/d8abbab7301d4f2e9f07afdbc8527a63/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:30.871921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c98d3-3f4d-4680-993a-f23f79b5d152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e3829224eb04064b95d077188943a00, user_id=d8abbab7301d4f2e9f07afdbc8527a63, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:30.874697 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c98d3-3f4d-4680-993a-f23f79b5d152 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:30.904863 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1081/2196] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:42:30 2022] PUT /identity/v3/projects/8e3829224eb04064b95d077188943a00/users/d8abbab7301d4f2e9f07afdbc8527a63/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:30.907482 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54047ee4-448f-4c67-8ac1-3170f86483d9 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:30.910767 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54047ee4-448f-4c67-8ac1-3170f86483d9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:30.911084 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54047ee4-448f-4c67-8ac1-3170f86483d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:30.940470 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-54047ee4-448f-4c67-8ac1-3170f86483d9 None None] MFA Rules not processed for user `d8abbab7301d4f2e9f07afdbc8527a63`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:30.941697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-54047ee4-448f-4c67-8ac1-3170f86483d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:31.012579 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1116/2197] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:42:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:42:31.024374 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c98d3-3f4d-4680-993a-f23f79b5d152 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:31.026105 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-115c98d3-3f4d-4680-993a-f23f79b5d152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:31.084788 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c98d3-3f4d-4680-993a-f23f79b5d152 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:31.089358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f482e-ee3e-4a5c-a1bd-974ff0bdc4b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:31.090018 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f482e-ee3e-4a5c-a1bd-974ff0bdc4b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:31.090292 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f482e-ee3e-4a5c-a1bd-974ff0bdc4b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:31.090558 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f482e-ee3e-4a5c-a1bd-974ff0bdc4b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:31.147452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f482e-ee3e-4a5c-a1bd-974ff0bdc4b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:31.148899 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f482e-ee3e-4a5c-a1bd-974ff0bdc4b9 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:31.158457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1082/2198] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:32.877755 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c24fe-59ac-42c6-af28-f5167745d040 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:32.878729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c24fe-59ac-42c6-af28-f5167745d040 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:32.879634 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c24fe-59ac-42c6-af28-f5167745d040 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:32.881689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1117/2199] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 13:42:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:42:32.889111 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095607a-fa99-46e6-a414-6fc80af1d664 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:32.890181 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095607a-fa99-46e6-a414-6fc80af1d664 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:32.890760 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095607a-fa99-46e6-a414-6fc80af1d664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:32.975679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-8095607a-fa99-46e6-a414-6fc80af1d664 None None] MFA Rules not processed for user `5a0061e2927843cf86769d2beab18743`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:32.977112 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8095607a-fa99-46e6-a414-6fc80af1d664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:32.990390 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:33.074503 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1083/2200] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 13:42:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:33.086490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c24fe-59ac-42c6-af28-f5167745d040 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:33.088223 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fc0c24fe-59ac-42c6-af28-f5167745d040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:33.146239 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c24fe-59ac-42c6-af28-f5167745d040 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:33.150021 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92968c2f-2c97-48be-b455-5ba6521a4c7a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22df4e0d98e34758963d3b1465a3a377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:33.150715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92968c2f-2c97-48be-b455-5ba6521a4c7a service glance] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:33.150989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92968c2f-2c97-48be-b455-5ba6521a4c7a service glance] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:33.151257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92968c2f-2c97-48be-b455-5ba6521a4c7a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:33.162305 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92968c2f-2c97-48be-b455-5ba6521a4c7a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:33.163814 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92968c2f-2c97-48be-b455-5ba6521a4c7a service glance] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:33.175040 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1118/2201] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:33.250035 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5f171-c4a4-4b98-830c-26aa20e99b4f None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:33.250390 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5f171-c4a4-4b98-830c-26aa20e99b4f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:33.250767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5f171-c4a4-4b98-830c-26aa20e99b4f None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:33.252591 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1084/2202] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 13:42:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:42:33.259230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81478c3-9521-43f1-b99b-bc9547012d96 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:33.259532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81478c3-9521-43f1-b99b-bc9547012d96 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:33.259778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81478c3-9521-43f1-b99b-bc9547012d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:33.279336 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e81478c3-9521-43f1-b99b-bc9547012d96 None None] MFA Rules not processed for user `a072e8e01bc64c9b92579bb8f1d513a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:33.280525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e81478c3-9521-43f1-b99b-bc9547012d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:33.322205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:33.338230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1119/2203] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 13:42:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:42:33.350113 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5f171-c4a4-4b98-830c-26aa20e99b4f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:33.352161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6db5f171-c4a4-4b98-830c-26aa20e99b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:33.365286 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5f171-c4a4-4b98-830c-26aa20e99b4f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:33.368989 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfa2ba-6139-47db-993b-f50d043a2b8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:33.369621 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfa2ba-6139-47db-993b-f50d043a2b8f service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:33.369896 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfa2ba-6139-47db-993b-f50d043a2b8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:33.370159 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfa2ba-6139-47db-993b-f50d043a2b8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:33.377575 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfa2ba-6139-47db-993b-f50d043a2b8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:33.379083 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfa2ba-6139-47db-993b-f50d043a2b8f service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:33.387152 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1085/2204] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:33.486537 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc268ea-8f86-411e-a1fe-37b8c783e91e None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:33.486957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc268ea-8f86-411e-a1fe-37b8c783e91e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:33.487375 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc268ea-8f86-411e-a1fe-37b8c783e91e None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:33.489008 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1120/2205] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 13:42:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:42:33.494932 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9886a5-0f62-4bf5-ac51-e9a1ef14a3b3 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:33.495222 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9886a5-0f62-4bf5-ac51-e9a1ef14a3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:33.495498 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9886a5-0f62-4bf5-ac51-e9a1ef14a3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:33.515071 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-4b9886a5-0f62-4bf5-ac51-e9a1ef14a3b3 None None] MFA Rules not processed for user `5a0061e2927843cf86769d2beab18743`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:33.516265 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4b9886a5-0f62-4bf5-ac51-e9a1ef14a3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:33.526731 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1086/2206] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 13:42:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:33.537721 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc268ea-8f86-411e-a1fe-37b8c783e91e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:33.539656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2cc268ea-8f86-411e-a1fe-37b8c783e91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:33.556213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc268ea-8f86-411e-a1fe-37b8c783e91e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:33.560689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fb684-7bd7-4c16-bd84-065a74efae75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:33.561363 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fb684-7bd7-4c16-bd84-065a74efae75 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:33.561656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fb684-7bd7-4c16-bd84-065a74efae75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:33.561923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fb684-7bd7-4c16-bd84-065a74efae75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:33.573391 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fb684-7bd7-4c16-bd84-065a74efae75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:33.574931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fb684-7bd7-4c16-bd84-065a74efae75 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:33.587843 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1121/2207] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:35.475250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9886a5-0f62-4bf5-ac51-e9a1ef14a3b3 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:35.495634 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9886a5-0f62-4bf5-ac51-e9a1ef14a3b3 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:35.499631 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53ab87-7ba7-43bc-96d9-c1ce61e3180c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:35.500351 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53ab87-7ba7-43bc-96d9-c1ce61e3180c service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:35.500693 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53ab87-7ba7-43bc-96d9-c1ce61e3180c service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:35.501047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53ab87-7ba7-43bc-96d9-c1ce61e3180c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:35.510747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53ab87-7ba7-43bc-96d9-c1ce61e3180c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:35.512223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53ab87-7ba7-43bc-96d9-c1ce61e3180c service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:35.522623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1087/2208] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:36.426753 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb88c4-7d93-4106-8cae-7d648ac1099b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:36.427218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb88c4-7d93-4106-8cae-7d648ac1099b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:36.427485 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb88c4-7d93-4106-8cae-7d648ac1099b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:36.447034 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-aefb88c4-7d93-4106-8cae-7d648ac1099b None None] MFA Rules not processed for user `cbf7d6db675047cbb3a3f16631c59622`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:36.448224 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-aefb88c4-7d93-4106-8cae-7d648ac1099b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:36.510276 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1122/2209] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 13:42:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:36.522684 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53ab87-7ba7-43bc-96d9-c1ce61e3180c service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:36.524589 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4a53ab87-7ba7-43bc-96d9-c1ce61e3180c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:36.599110 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53ab87-7ba7-43bc-96d9-c1ce61e3180c service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:36.604824 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69344b28-a72e-411b-b888-43cb8b143cf4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd0e37b0404419bb5752228bd809be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:36.605486 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69344b28-a72e-411b-b888-43cb8b143cf4 service swift] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:36.605763 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69344b28-a72e-411b-b888-43cb8b143cf4 service swift] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:36.606035 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69344b28-a72e-411b-b888-43cb8b143cf4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:36.614818 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69344b28-a72e-411b-b888-43cb8b143cf4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:36.616505 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69344b28-a72e-411b-b888-43cb8b143cf4 service swift] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:36.625911 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1088/2210] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 13:42:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:42:40.481092 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb88c4-7d93-4106-8cae-7d648ac1099b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:40.559297 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb88c4-7d93-4106-8cae-7d648ac1099b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:40.564000 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747007d-76ce-4143-9762-cf77e4e7f022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:40.564956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747007d-76ce-4143-9762-cf77e4e7f022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:40.565257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747007d-76ce-4143-9762-cf77e4e7f022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:40.565527 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747007d-76ce-4143-9762-cf77e4e7f022 admin admin] PATH_INFO: `/v3/users/f57e9f67b3b748a78bf0284bed4c9dc6` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:40.566794 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747007d-76ce-4143-9762-cf77e4e7f022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f57e9f67b3b748a78bf0284bed4c9dc6)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:40.568735 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747007d-76ce-4143-9762-cf77e4e7f022 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:40.616482 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f747007d-76ce-4143-9762-cf77e4e7f022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f57e9f67b3b748a78bf0284bed4c9dc6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:40.625051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f747007d-76ce-4143-9762-cf77e4e7f022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f57e9f67b3b748a78bf0284bed4c9dc6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:40.629461 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f747007d-76ce-4143-9762-cf77e4e7f022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f57e9f67b3b748a78bf0284bed4c9dc6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:40.645728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f747007d-76ce-4143-9762-cf77e4e7f022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f57e9f67b3b748a78bf0284bed4c9dc6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:40.646488 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f747007d-76ce-4143-9762-cf77e4e7f022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f57e9f67b3b748a78bf0284bed4c9dc6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:40.659739 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1123/2211] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:42:40 2022] DELETE /identity/v3/users/f57e9f67b3b748a78bf0284bed4c9dc6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:40.664646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288cd15-a814-4393-97c0-b0a1b611822e None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:40.665842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288cd15-a814-4393-97c0-b0a1b611822e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:40.665842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288cd15-a814-4393-97c0-b0a1b611822e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:40.687929 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-5288cd15-a814-4393-97c0-b0a1b611822e None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:40.689154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5288cd15-a814-4393-97c0-b0a1b611822e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:40.727027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:40.753256 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1089/2212] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:40.763210 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747007d-76ce-4143-9762-cf77e4e7f022 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:40.764857 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f747007d-76ce-4143-9762-cf77e4e7f022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:40.771240 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:40.828999 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747007d-76ce-4143-9762-cf77e4e7f022 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:40.833432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40d34b-e90e-46b9-816f-6fbcad8e9194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:40.834083 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40d34b-e90e-46b9-816f-6fbcad8e9194 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:40.834358 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40d34b-e90e-46b9-816f-6fbcad8e9194 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:40.834645 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40d34b-e90e-46b9-816f-6fbcad8e9194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:40.844523 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40d34b-e90e-46b9-816f-6fbcad8e9194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:40.846085 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40d34b-e90e-46b9-816f-6fbcad8e9194 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:40.858369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1124/2213] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:42:41.161962 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288cd15-a814-4393-97c0-b0a1b611822e None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:41.163876 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5288cd15-a814-4393-97c0-b0a1b611822e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:41.176948 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288cd15-a814-4393-97c0-b0a1b611822e None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:41.181900 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde761f-e971-4590-a49a-01fbeaa0fe01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:41.182870 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde761f-e971-4590-a49a-01fbeaa0fe01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:41.183183 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde761f-e971-4590-a49a-01fbeaa0fe01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:41.183461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde761f-e971-4590-a49a-01fbeaa0fe01 admin admin] PATH_INFO: `/v3/projects/31d0766f5bfe4760bc5e1ef217049330` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:41.184817 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde761f-e971-4590-a49a-01fbeaa0fe01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31d0766f5bfe4760bc5e1ef217049330)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:41.187819 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde761f-e971-4590-a49a-01fbeaa0fe01 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:41.250405 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ffde761f-e971-4590-a49a-01fbeaa0fe01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31d0766f5bfe4760bc5e1ef217049330', 'request_id': 'req-ffde761f-e971-4590-a49a-01fbeaa0fe01'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:41.256116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ffde761f-e971-4590-a49a-01fbeaa0fe01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31d0766f5bfe4760bc5e1ef217049330', 'request_id': 'req-ffde761f-e971-4590-a49a-01fbeaa0fe01'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:41.268194 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ffde761f-e971-4590-a49a-01fbeaa0fe01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31d0766f5bfe4760bc5e1ef217049330', 'request_id': 'req-ffde761f-e971-4590-a49a-01fbeaa0fe01'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:41.289561 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ffde761f-e971-4590-a49a-01fbeaa0fe01 admin admin] The token cache is being invalidate because project 31d0766f5bfe4760bc5e1ef217049330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:42:41.289849 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ffde761f-e971-4590-a49a-01fbeaa0fe01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:41.290666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ffde761f-e971-4590-a49a-01fbeaa0fe01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:41.292935 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1090/2214] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:42:41 2022] DELETE /identity/v3/projects/31d0766f5bfe4760bc5e1ef217049330 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:42:41.296662 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40d34b-e90e-46b9-816f-6fbcad8e9194 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:41.311471 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40d34b-e90e-46b9-816f-6fbcad8e9194 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:41.395414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415cb253-da87-4306-927b-1d2f5180a069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:41.397339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cb253-da87-4306-927b-1d2f5180a069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:41.397733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cb253-da87-4306-927b-1d2f5180a069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:41.398156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cb253-da87-4306-927b-1d2f5180a069 admin admin] PATH_INFO: `/v3/users/d8abbab7301d4f2e9f07afdbc8527a63` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:41.402980 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415cb253-da87-4306-927b-1d2f5180a069 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8abbab7301d4f2e9f07afdbc8527a63)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:41.404906 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415cb253-da87-4306-927b-1d2f5180a069 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:41.479335 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-415cb253-da87-4306-927b-1d2f5180a069 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8abbab7301d4f2e9f07afdbc8527a63'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:41.489553 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-415cb253-da87-4306-927b-1d2f5180a069 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8abbab7301d4f2e9f07afdbc8527a63'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:41.490802 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-415cb253-da87-4306-927b-1d2f5180a069 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8abbab7301d4f2e9f07afdbc8527a63'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:41.503383 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-415cb253-da87-4306-927b-1d2f5180a069 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8abbab7301d4f2e9f07afdbc8527a63'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:41.504102 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-415cb253-da87-4306-927b-1d2f5180a069 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8abbab7301d4f2e9f07afdbc8527a63'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:41.516935 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1125/2215] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:42:41 2022] DELETE /identity/v3/users/d8abbab7301d4f2e9f07afdbc8527a63 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:41.831338 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde761f-e971-4590-a49a-01fbeaa0fe01 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:41.832845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ffde761f-e971-4590-a49a-01fbeaa0fe01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:41.848579 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde761f-e971-4590-a49a-01fbeaa0fe01 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:41.930856 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd11ef0-46f7-4738-a38d-c7bdfff29ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:41.931781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd11ef0-46f7-4738-a38d-c7bdfff29ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:41.932111 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd11ef0-46f7-4738-a38d-c7bdfff29ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:41.932328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd11ef0-46f7-4738-a38d-c7bdfff29ced admin admin] PATH_INFO: `/v3/projects/8e3829224eb04064b95d077188943a00` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:41.933926 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd11ef0-46f7-4738-a38d-c7bdfff29ced admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e3829224eb04064b95d077188943a00)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:41.935932 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd11ef0-46f7-4738-a38d-c7bdfff29ced admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:41.985204 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1bd11ef0-46f7-4738-a38d-c7bdfff29ced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e3829224eb04064b95d077188943a00', 'request_id': 'req-1bd11ef0-46f7-4738-a38d-c7bdfff29ced'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:41.990947 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1bd11ef0-46f7-4738-a38d-c7bdfff29ced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e3829224eb04064b95d077188943a00', 'request_id': 'req-1bd11ef0-46f7-4738-a38d-c7bdfff29ced'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:41.997858 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1bd11ef0-46f7-4738-a38d-c7bdfff29ced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e3829224eb04064b95d077188943a00', 'request_id': 'req-1bd11ef0-46f7-4738-a38d-c7bdfff29ced'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:42.000456 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:42.015069 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1bd11ef0-46f7-4738-a38d-c7bdfff29ced admin admin] The token cache is being invalidate because project 8e3829224eb04064b95d077188943a00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:42:42.015509 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1bd11ef0-46f7-4738-a38d-c7bdfff29ced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:42.016776 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1bd11ef0-46f7-4738-a38d-c7bdfff29ced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:42.019411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1091/2216] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:42:41 2022] DELETE /identity/v3/projects/8e3829224eb04064b95d077188943a00 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:42.027894 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561ff98-73ef-475a-9c18-1f92a89d3fc1 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:42.028250 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561ff98-73ef-475a-9c18-1f92a89d3fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:42.028649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561ff98-73ef-475a-9c18-1f92a89d3fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:42.052939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f561ff98-73ef-475a-9c18-1f92a89d3fc1 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:42.054168 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f561ff98-73ef-475a-9c18-1f92a89d3fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:42.076232 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:42.144469 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1126/2217] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:42.154717 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c89f9f-44fb-4332-8468-76956150f7f7 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:42.154717 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c89f9f-44fb-4332-8468-76956150f7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:42.154717 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c89f9f-44fb-4332-8468-76956150f7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:42.213390 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-55c89f9f-44fb-4332-8468-76956150f7f7 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:42.214869 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-55c89f9f-44fb-4332-8468-76956150f7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:42.224941 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1092/2218] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:42:42.231438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561ff98-73ef-475a-9c18-1f92a89d3fc1 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:42.242053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561ff98-73ef-475a-9c18-1f92a89d3fc1 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:42.247060 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0f67a-0c3c-424f-87f9-c4a429bdb609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:42.247721 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0f67a-0c3c-424f-87f9-c4a429bdb609 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:42.248004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0f67a-0c3c-424f-87f9-c4a429bdb609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:42.248278 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0f67a-0c3c-424f-87f9-c4a429bdb609 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:42.249006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0f67a-0c3c-424f-87f9-c4a429bdb609 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:42:42.249312 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0f67a-0c3c-424f-87f9-c4a429bdb609 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:42.250973 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0f67a-0c3c-424f-87f9-c4a429bdb609 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:42.263829 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1127/2219] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:42:42.268989 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c89f9f-44fb-4332-8468-76956150f7f7 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:42.280027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c89f9f-44fb-4332-8468-76956150f7f7 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:42.285692 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11edff9-3f85-4fe0-9d45-48f0a33381a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:42.286377 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11edff9-3f85-4fe0-9d45-48f0a33381a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:42.286686 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11edff9-3f85-4fe0-9d45-48f0a33381a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:42.286950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11edff9-3f85-4fe0-9d45-48f0a33381a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:42.287650 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11edff9-3f85-4fe0-9d45-48f0a33381a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:42.289574 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11edff9-3f85-4fe0-9d45-48f0a33381a2 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:42.321076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1093/2220] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:42:42 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:42:42.325515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0f67a-0c3c-424f-87f9-c4a429bdb609 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:42.336199 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0f67a-0c3c-424f-87f9-c4a429bdb609 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:42.394806 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362cbd6-606d-48ec-9641-a91152902197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:42.395627 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362cbd6-606d-48ec-9641-a91152902197 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:42.395854 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362cbd6-606d-48ec-9641-a91152902197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:42.396127 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362cbd6-606d-48ec-9641-a91152902197 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:42.396888 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362cbd6-606d-48ec-9641-a91152902197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:42.398849 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362cbd6-606d-48ec-9641-a91152902197 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:42.421638 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1128/2221] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:42:42 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:42:42.426266 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11edff9-3f85-4fe0-9d45-48f0a33381a2 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:42.437330 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11edff9-3f85-4fe0-9d45-48f0a33381a2 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:42.442881 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f57f1-5c8a-48de-ad7c-a6063166357f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:42.443561 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f57f1-5c8a-48de-ad7c-a6063166357f admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:42.443844 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f57f1-5c8a-48de-ad7c-a6063166357f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:42.444116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f57f1-5c8a-48de-ad7c-a6063166357f admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:42.444855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f57f1-5c8a-48de-ad7c-a6063166357f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:42.446454 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f57f1-5c8a-48de-ad7c-a6063166357f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:42.457542 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1094/2222] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:42:42.461820 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362cbd6-606d-48ec-9641-a91152902197 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:42.473763 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362cbd6-606d-48ec-9641-a91152902197 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:42.479240 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1750e5d-1e27-4b9e-8295-9e753ab0e902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:42.479965 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1750e5d-1e27-4b9e-8295-9e753ab0e902 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:42.480470 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1750e5d-1e27-4b9e-8295-9e753ab0e902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:42.480759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1750e5d-1e27-4b9e-8295-9e753ab0e902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:42.481569 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1750e5d-1e27-4b9e-8295-9e753ab0e902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:42.483205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1750e5d-1e27-4b9e-8295-9e753ab0e902 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:42.494149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1129/2223] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:42:42.498491 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f57f1-5c8a-48de-ad7c-a6063166357f admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:42.508576 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f57f1-5c8a-48de-ad7c-a6063166357f admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:42.513462 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d564b-405a-4eba-848d-b2a8e24a26cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:42.514439 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d564b-405a-4eba-848d-b2a8e24a26cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:42.514757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d564b-405a-4eba-848d-b2a8e24a26cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:42.515054 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d564b-405a-4eba-848d-b2a8e24a26cc admin admin] PATH_INFO: `/v3/projects/9d3e08a64d8c4e6599dde55da8954639/users/3f0c196a7114427eaf60f13ca5c3c334/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:42.535696 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d564b-405a-4eba-848d-b2a8e24a26cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d3e08a64d8c4e6599dde55da8954639, user_id=3f0c196a7114427eaf60f13ca5c3c334, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:42.538769 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d564b-405a-4eba-848d-b2a8e24a26cc admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:42.561851 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1095/2224] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:42:42 2022] PUT /identity/v3/projects/9d3e08a64d8c4e6599dde55da8954639/users/3f0c196a7114427eaf60f13ca5c3c334/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:42.573279 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585bd05-3387-4422-895e-bced817e6c4b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:42.573660 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585bd05-3387-4422-895e-bced817e6c4b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:42.574155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585bd05-3387-4422-895e-bced817e6c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:42.605424 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-1585bd05-3387-4422-895e-bced817e6c4b None None] MFA Rules not processed for user `3f0c196a7114427eaf60f13ca5c3c334`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:42.606869 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1585bd05-3387-4422-895e-bced817e6c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:42.671905 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1130/2225] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:42:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:42:42.683726 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d564b-405a-4eba-848d-b2a8e24a26cc admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:42.685470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1c6d564b-405a-4eba-848d-b2a8e24a26cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:42.756316 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d564b-405a-4eba-848d-b2a8e24a26cc admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:42.760497 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346568f-3d4d-4f2e-96c9-b1c1b6836e6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:42.761269 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346568f-3d4d-4f2e-96c9-b1c1b6836e6b service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:42.761544 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346568f-3d4d-4f2e-96c9-b1c1b6836e6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:42.761868 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346568f-3d4d-4f2e-96c9-b1c1b6836e6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:42.772875 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346568f-3d4d-4f2e-96c9-b1c1b6836e6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:42.774382 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346568f-3d4d-4f2e-96c9-b1c1b6836e6b service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:42.785988 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1096/2226] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:42.812241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585bd05-3387-4422-895e-bced817e6c4b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:42.835181 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:42.882163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585bd05-3387-4422-895e-bced817e6c4b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:42.887549 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7f56e-be6d-47d2-83d1-935dcbb1b7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:42.888438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7f56e-be6d-47d2-83d1-935dcbb1b7c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:42.888717 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7f56e-be6d-47d2-83d1-935dcbb1b7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:42.888985 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7f56e-be6d-47d2-83d1-935dcbb1b7c7 admin admin] PATH_INFO: `/v3/users/3f0c196a7114427eaf60f13ca5c3c334` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:42.890318 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7f56e-be6d-47d2-83d1-935dcbb1b7c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f0c196a7114427eaf60f13ca5c3c334)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:42.892677 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7f56e-be6d-47d2-83d1-935dcbb1b7c7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:42.943861 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8fe7f56e-be6d-47d2-83d1-935dcbb1b7c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f0c196a7114427eaf60f13ca5c3c334'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:42.953838 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8fe7f56e-be6d-47d2-83d1-935dcbb1b7c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f0c196a7114427eaf60f13ca5c3c334'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:42.954657 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8fe7f56e-be6d-47d2-83d1-935dcbb1b7c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f0c196a7114427eaf60f13ca5c3c334'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:42.975087 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8fe7f56e-be6d-47d2-83d1-935dcbb1b7c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f0c196a7114427eaf60f13ca5c3c334'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:42.975838 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8fe7f56e-be6d-47d2-83d1-935dcbb1b7c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f0c196a7114427eaf60f13ca5c3c334'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:42.989000 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1131/2227] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:42:42 2022] DELETE /identity/v3/users/3f0c196a7114427eaf60f13ca5c3c334 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:42.993706 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b85357-f757-4c63-85a4-779b268d591e None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:42.994211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b85357-f757-4c63-85a4-779b268d591e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:42.994319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b85357-f757-4c63-85a4-779b268d591e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:43.011542 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-95b85357-f757-4c63-85a4-779b268d591e None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:43.012735 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-95b85357-f757-4c63-85a4-779b268d591e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:43.084963 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1097/2228] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:43.095066 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7f56e-be6d-47d2-83d1-935dcbb1b7c7 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:43.096631 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8fe7f56e-be6d-47d2-83d1-935dcbb1b7c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:43.158059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7f56e-be6d-47d2-83d1-935dcbb1b7c7 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:43.162849 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4bf66-563d-41a6-a8c7-24336690ce79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:43.163597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4bf66-563d-41a6-a8c7-24336690ce79 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:43.163960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4bf66-563d-41a6-a8c7-24336690ce79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:43.164314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4bf66-563d-41a6-a8c7-24336690ce79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:43.176309 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4bf66-563d-41a6-a8c7-24336690ce79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:43.177804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4bf66-563d-41a6-a8c7-24336690ce79 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:43.202468 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1132/2229] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:43.486075 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b85357-f757-4c63-85a4-779b268d591e None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:43.487495 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-95b85357-f757-4c63-85a4-779b268d591e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:43.500315 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b85357-f757-4c63-85a4-779b268d591e None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:43.506829 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f90f4e-f7b5-4688-b691-7ae4ccdb024d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:43.507707 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f90f4e-f7b5-4688-b691-7ae4ccdb024d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:43.507980 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f90f4e-f7b5-4688-b691-7ae4ccdb024d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:43.508264 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f90f4e-f7b5-4688-b691-7ae4ccdb024d admin admin] PATH_INFO: `/v3/projects/9d3e08a64d8c4e6599dde55da8954639` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:43.510693 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f90f4e-f7b5-4688-b691-7ae4ccdb024d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d3e08a64d8c4e6599dde55da8954639)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:43.513146 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f90f4e-f7b5-4688-b691-7ae4ccdb024d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:43.533880 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:43.565505 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-54f90f4e-f7b5-4688-b691-7ae4ccdb024d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d3e08a64d8c4e6599dde55da8954639', 'request_id': 'req-54f90f4e-f7b5-4688-b691-7ae4ccdb024d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:43.570998 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-54f90f4e-f7b5-4688-b691-7ae4ccdb024d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d3e08a64d8c4e6599dde55da8954639', 'request_id': 'req-54f90f4e-f7b5-4688-b691-7ae4ccdb024d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:43.577253 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-54f90f4e-f7b5-4688-b691-7ae4ccdb024d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d3e08a64d8c4e6599dde55da8954639', 'request_id': 'req-54f90f4e-f7b5-4688-b691-7ae4ccdb024d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:43.593056 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-54f90f4e-f7b5-4688-b691-7ae4ccdb024d admin admin] The token cache is being invalidate because project 9d3e08a64d8c4e6599dde55da8954639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:42:43.593260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-54f90f4e-f7b5-4688-b691-7ae4ccdb024d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:43.593915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-54f90f4e-f7b5-4688-b691-7ae4ccdb024d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:43.595529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1098/2230] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:42:43 2022] DELETE /identity/v3/projects/9d3e08a64d8c4e6599dde55da8954639 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:43.600611 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c9943-f81c-4ea2-855e-3d7ae211ed5c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:43.601136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c9943-f81c-4ea2-855e-3d7ae211ed5c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:43.601136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c9943-f81c-4ea2-855e-3d7ae211ed5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:43.619330 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d05c9943-f81c-4ea2-855e-3d7ae211ed5c None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:43.620718 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d05c9943-f81c-4ea2-855e-3d7ae211ed5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:43.669717 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:43.695814 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1133/2231] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:43.705644 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e94d46-3d3b-44bc-83ab-05b5e0c7e213 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:43.705952 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e94d46-3d3b-44bc-83ab-05b5e0c7e213 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:43.706196 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e94d46-3d3b-44bc-83ab-05b5e0c7e213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:43.729605 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-47e94d46-3d3b-44bc-83ab-05b5e0c7e213 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:43.731067 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-47e94d46-3d3b-44bc-83ab-05b5e0c7e213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:43.740643 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1099/2232] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:43.744768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c9943-f81c-4ea2-855e-3d7ae211ed5c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:43.755868 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c9943-f81c-4ea2-855e-3d7ae211ed5c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:43.760017 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50511223-56da-48d8-a040-1b51347addd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:43.760797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50511223-56da-48d8-a040-1b51347addd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:43.761077 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50511223-56da-48d8-a040-1b51347addd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:43.761461 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50511223-56da-48d8-a040-1b51347addd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:43.762316 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50511223-56da-48d8-a040-1b51347addd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:42:43.762531 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50511223-56da-48d8-a040-1b51347addd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:43.764172 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50511223-56da-48d8-a040-1b51347addd5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:43.778632 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1134/2233] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:42:43.781729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e94d46-3d3b-44bc-83ab-05b5e0c7e213 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:43.798440 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e94d46-3d3b-44bc-83ab-05b5e0c7e213 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:43.804448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b50d4-664b-4367-895c-9dac5c51888b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:43.805459 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b50d4-664b-4367-895c-9dac5c51888b admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:43.805839 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b50d4-664b-4367-895c-9dac5c51888b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:43.806229 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b50d4-664b-4367-895c-9dac5c51888b admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:43.807108 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b50d4-664b-4367-895c-9dac5c51888b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:43.809299 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b50d4-664b-4367-895c-9dac5c51888b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:43.837320 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1100/2234] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:42:43 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:42:43.841831 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50511223-56da-48d8-a040-1b51347addd5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:43.852530 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50511223-56da-48d8-a040-1b51347addd5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:43.913432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47472872-4b6a-4d01-9193-98f84cd845cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:43.914246 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47472872-4b6a-4d01-9193-98f84cd845cf admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:43.914523 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47472872-4b6a-4d01-9193-98f84cd845cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:43.914829 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47472872-4b6a-4d01-9193-98f84cd845cf admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:43.915628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47472872-4b6a-4d01-9193-98f84cd845cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:43.918032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47472872-4b6a-4d01-9193-98f84cd845cf admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:43.953825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1135/2235] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:42:43 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:42:43.958004 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b50d4-664b-4367-895c-9dac5c51888b admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:43.969167 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b50d4-664b-4367-895c-9dac5c51888b admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:43.973876 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d4047-376d-4511-88e7-11d69afcc1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:43.974700 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d4047-376d-4511-88e7-11d69afcc1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:43.974979 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d4047-376d-4511-88e7-11d69afcc1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:43.975248 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d4047-376d-4511-88e7-11d69afcc1f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:43.975982 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d4047-376d-4511-88e7-11d69afcc1f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:43.977584 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d4047-376d-4511-88e7-11d69afcc1f1 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:43.988916 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1101/2236] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:42:43.993099 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47472872-4b6a-4d01-9193-98f84cd845cf admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:44.003107 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47472872-4b6a-4d01-9193-98f84cd845cf admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:44.007666 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328fa01-f8d1-44af-8f80-56f7cb4eec73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:44.008316 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328fa01-f8d1-44af-8f80-56f7cb4eec73 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:44.008598 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328fa01-f8d1-44af-8f80-56f7cb4eec73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:44.008873 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328fa01-f8d1-44af-8f80-56f7cb4eec73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:44.009600 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328fa01-f8d1-44af-8f80-56f7cb4eec73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:44.011257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328fa01-f8d1-44af-8f80-56f7cb4eec73 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:44.021438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1136/2237] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:42:44.025757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d4047-376d-4511-88e7-11d69afcc1f1 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:44.036213 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d4047-376d-4511-88e7-11d69afcc1f1 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:44.041766 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108292b2-8709-4a97-b6dd-27671e350895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:44.042786 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108292b2-8709-4a97-b6dd-27671e350895 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:44.043094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108292b2-8709-4a97-b6dd-27671e350895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:44.043363 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108292b2-8709-4a97-b6dd-27671e350895 admin admin] PATH_INFO: `/v3/projects/d9ae28d1e2a242d1a401f6b50357e78c/users/96ca9d5b8582469a92158f8adceba561/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:44.060648 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108292b2-8709-4a97-b6dd-27671e350895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9ae28d1e2a242d1a401f6b50357e78c, user_id=96ca9d5b8582469a92158f8adceba561, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:44.063328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108292b2-8709-4a97-b6dd-27671e350895 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:44.084632 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1102/2238] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:42:44 2022] PUT /identity/v3/projects/d9ae28d1e2a242d1a401f6b50357e78c/users/96ca9d5b8582469a92158f8adceba561/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:42:44.098357 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b166d30-65e2-4dbf-b18a-9584e434f78c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:44.098734 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b166d30-65e2-4dbf-b18a-9584e434f78c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:44.098939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b166d30-65e2-4dbf-b18a-9584e434f78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:44.134340 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6b166d30-65e2-4dbf-b18a-9584e434f78c None None] MFA Rules not processed for user `96ca9d5b8582469a92158f8adceba561`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:44.135788 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6b166d30-65e2-4dbf-b18a-9584e434f78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:44.203841 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1137/2239] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:42:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:44.208501 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108292b2-8709-4a97-b6dd-27671e350895 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:44.285154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108292b2-8709-4a97-b6dd-27671e350895 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:44.298934 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd135e9-8d74-4b15-834d-5f033a134e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:44.299720 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd135e9-8d74-4b15-834d-5f033a134e96 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:44.299994 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd135e9-8d74-4b15-834d-5f033a134e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:44.300259 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd135e9-8d74-4b15-834d-5f033a134e96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:44.300976 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd135e9-8d74-4b15-834d-5f033a134e96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:44.303105 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd135e9-8d74-4b15-834d-5f033a134e96 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:44.331710 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1103/2240] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:42:44 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:42:44.335793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b166d30-65e2-4dbf-b18a-9584e434f78c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:44.352850 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b166d30-65e2-4dbf-b18a-9584e434f78c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:44.386117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:44.413734 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c47bcb-5ec7-4a9a-8b3e-6ee7391f9bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:44.414443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c47bcb-5ec7-4a9a-8b3e-6ee7391f9bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:44.414752 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c47bcb-5ec7-4a9a-8b3e-6ee7391f9bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:44.415044 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c47bcb-5ec7-4a9a-8b3e-6ee7391f9bc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:44.415744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c47bcb-5ec7-4a9a-8b3e-6ee7391f9bc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:44.417760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c47bcb-5ec7-4a9a-8b3e-6ee7391f9bc5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:44.438928 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1138/2241] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:42:44 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:42:44.443152 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd135e9-8d74-4b15-834d-5f033a134e96 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:44.455540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd135e9-8d74-4b15-834d-5f033a134e96 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:44.462355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402aa5dc-568d-4c4f-99e9-a57d7f98fbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:44.463497 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402aa5dc-568d-4c4f-99e9-a57d7f98fbfe admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:44.463828 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402aa5dc-568d-4c4f-99e9-a57d7f98fbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:44.464103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402aa5dc-568d-4c4f-99e9-a57d7f98fbfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:44.465428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402aa5dc-568d-4c4f-99e9-a57d7f98fbfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:44.466855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402aa5dc-568d-4c4f-99e9-a57d7f98fbfe admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:44.481937 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1104/2242] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:42:44.488899 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c47bcb-5ec7-4a9a-8b3e-6ee7391f9bc5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:44.502819 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c47bcb-5ec7-4a9a-8b3e-6ee7391f9bc5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:44.508664 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a561cc-29fe-4418-b1c2-ca96868b8283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:44.509659 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a561cc-29fe-4418-b1c2-ca96868b8283 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:44.510005 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a561cc-29fe-4418-b1c2-ca96868b8283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:44.510278 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a561cc-29fe-4418-b1c2-ca96868b8283 admin admin] PATH_INFO: `/v3/projects/b619cbca4a7940f39635eef67cd6fa69/users/36c5099eac08426abcb0f3c63d38e99c/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:44.527400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a561cc-29fe-4418-b1c2-ca96868b8283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b619cbca4a7940f39635eef67cd6fa69, user_id=36c5099eac08426abcb0f3c63d38e99c, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:44.530452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a561cc-29fe-4418-b1c2-ca96868b8283 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:44.546130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1139/2243] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:42:44 2022] PUT /identity/v3/projects/b619cbca4a7940f39635eef67cd6fa69/users/36c5099eac08426abcb0f3c63d38e99c/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:44.550127 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402aa5dc-568d-4c4f-99e9-a57d7f98fbfe admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:44.560043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402aa5dc-568d-4c4f-99e9-a57d7f98fbfe admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:44.573241 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:44.634360 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4ff9d-2fbd-4dad-b6c1-7ce8dcb7a3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:44.635302 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4ff9d-2fbd-4dad-b6c1-7ce8dcb7a3db admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:44.635579 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4ff9d-2fbd-4dad-b6c1-7ce8dcb7a3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:44.635849 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4ff9d-2fbd-4dad-b6c1-7ce8dcb7a3db admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:44.636804 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4ff9d-2fbd-4dad-b6c1-7ce8dcb7a3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:44.638335 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4ff9d-2fbd-4dad-b6c1-7ce8dcb7a3db admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:44.649123 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1105/2244] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:42:44.653682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a561cc-29fe-4418-b1c2-ca96868b8283 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:44.664969 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a561cc-29fe-4418-b1c2-ca96868b8283 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:44.670910 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78089b-69c8-4298-8672-d25d652e9c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:44.671790 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78089b-69c8-4298-8672-d25d652e9c47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:44.672054 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78089b-69c8-4298-8672-d25d652e9c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:44.672325 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78089b-69c8-4298-8672-d25d652e9c47 admin admin] PATH_INFO: `/v3/projects/b619cbca4a7940f39635eef67cd6fa69/users/36c5099eac08426abcb0f3c63d38e99c/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:44.674481 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78089b-69c8-4298-8672-d25d652e9c47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b619cbca4a7940f39635eef67cd6fa69, user_id=36c5099eac08426abcb0f3c63d38e99c, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:44.677193 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78089b-69c8-4298-8672-d25d652e9c47 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:44.690054 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1140/2245] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:42:44 2022] PUT /identity/v3/projects/b619cbca4a7940f39635eef67cd6fa69/users/36c5099eac08426abcb0f3c63d38e99c/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:44.701032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e263ce-25b8-4a10-b6a8-331a46ebbdd4 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:44.701324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e263ce-25b8-4a10-b6a8-331a46ebbdd4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:44.701604 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e263ce-25b8-4a10-b6a8-331a46ebbdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:44.740709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-e7e263ce-25b8-4a10-b6a8-331a46ebbdd4 None None] MFA Rules not processed for user `36c5099eac08426abcb0f3c63d38e99c`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:44.742253 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e7e263ce-25b8-4a10-b6a8-331a46ebbdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:44.816022 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1106/2246] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:42:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:44.823914 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78089b-69c8-4298-8672-d25d652e9c47 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:44.826205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ec78089b-69c8-4298-8672-d25d652e9c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:44.895188 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78089b-69c8-4298-8672-d25d652e9c47 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:44.903131 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18024fe8-9d0c-4ccd-9a79-3528dedb30da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:44.903813 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18024fe8-9d0c-4ccd-9a79-3528dedb30da service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:44.904149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18024fe8-9d0c-4ccd-9a79-3528dedb30da service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:44.904422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18024fe8-9d0c-4ccd-9a79-3528dedb30da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:44.971479 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18024fe8-9d0c-4ccd-9a79-3528dedb30da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:44.972922 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18024fe8-9d0c-4ccd-9a79-3528dedb30da service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:44.982029 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1141/2247] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:47.555305 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e263ce-25b8-4a10-b6a8-331a46ebbdd4 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:47.628960 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e263ce-25b8-4a10-b6a8-331a46ebbdd4 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:47.637642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d628c5-4fad-4d2e-b00e-e57ae6f5c6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:47.638873 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d628c5-4fad-4d2e-b00e-e57ae6f5c6a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:47.639323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d628c5-4fad-4d2e-b00e-e57ae6f5c6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:47.639796 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d628c5-4fad-4d2e-b00e-e57ae6f5c6a0 admin admin] PATH_INFO: `/v3/users/96ca9d5b8582469a92158f8adceba561` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:47.641044 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d628c5-4fad-4d2e-b00e-e57ae6f5c6a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96ca9d5b8582469a92158f8adceba561)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:47.643372 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d628c5-4fad-4d2e-b00e-e57ae6f5c6a0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:47.688088 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:47.694860 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b5d628c5-4fad-4d2e-b00e-e57ae6f5c6a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96ca9d5b8582469a92158f8adceba561'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:47.704323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b5d628c5-4fad-4d2e-b00e-e57ae6f5c6a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96ca9d5b8582469a92158f8adceba561'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:47.705313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b5d628c5-4fad-4d2e-b00e-e57ae6f5c6a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96ca9d5b8582469a92158f8adceba561'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:47.719964 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b5d628c5-4fad-4d2e-b00e-e57ae6f5c6a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96ca9d5b8582469a92158f8adceba561'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:47.735068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b5d628c5-4fad-4d2e-b00e-e57ae6f5c6a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96ca9d5b8582469a92158f8adceba561'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:47.742461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1107/2248] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:42:47 2022] DELETE /identity/v3/users/96ca9d5b8582469a92158f8adceba561 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:47.747184 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294dbc02-b3de-4852-93fa-54739b6fd789 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:47.748338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294dbc02-b3de-4852-93fa-54739b6fd789 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:47.748985 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294dbc02-b3de-4852-93fa-54739b6fd789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:47.769199 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-294dbc02-b3de-4852-93fa-54739b6fd789 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:47.770421 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-294dbc02-b3de-4852-93fa-54739b6fd789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:47.816361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:47.842997 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1142/2249] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:47.849510 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d628c5-4fad-4d2e-b00e-e57ae6f5c6a0 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:47.851097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b5d628c5-4fad-4d2e-b00e-e57ae6f5c6a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:47.922167 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d628c5-4fad-4d2e-b00e-e57ae6f5c6a0 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:47.926538 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d42ab8-5a93-4918-9eb1-de1fdf0fe4c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:47.927235 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d42ab8-5a93-4918-9eb1-de1fdf0fe4c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:47.927513 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d42ab8-5a93-4918-9eb1-de1fdf0fe4c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:47.927822 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d42ab8-5a93-4918-9eb1-de1fdf0fe4c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:47.938754 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d42ab8-5a93-4918-9eb1-de1fdf0fe4c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:47.940242 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d42ab8-5a93-4918-9eb1-de1fdf0fe4c1 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:47.951195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1108/2250] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:48.244652 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294dbc02-b3de-4852-93fa-54739b6fd789 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:48.246325 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-294dbc02-b3de-4852-93fa-54739b6fd789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:48.291806 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294dbc02-b3de-4852-93fa-54739b6fd789 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:48.298774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31b245-0a83-4429-ac0e-6711a85add3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:48.299912 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31b245-0a83-4429-ac0e-6711a85add3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:48.300189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31b245-0a83-4429-ac0e-6711a85add3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:48.300458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31b245-0a83-4429-ac0e-6711a85add3f admin admin] PATH_INFO: `/v3/projects/d9ae28d1e2a242d1a401f6b50357e78c` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:48.301661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31b245-0a83-4429-ac0e-6711a85add3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9ae28d1e2a242d1a401f6b50357e78c)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:48.303624 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31b245-0a83-4429-ac0e-6711a85add3f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:48.351904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-df31b245-0a83-4429-ac0e-6711a85add3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9ae28d1e2a242d1a401f6b50357e78c', 'request_id': 'req-df31b245-0a83-4429-ac0e-6711a85add3f'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:48.357786 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-df31b245-0a83-4429-ac0e-6711a85add3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9ae28d1e2a242d1a401f6b50357e78c', 'request_id': 'req-df31b245-0a83-4429-ac0e-6711a85add3f'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:48.366403 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-df31b245-0a83-4429-ac0e-6711a85add3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9ae28d1e2a242d1a401f6b50357e78c', 'request_id': 'req-df31b245-0a83-4429-ac0e-6711a85add3f'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:48.385228 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-df31b245-0a83-4429-ac0e-6711a85add3f admin admin] The token cache is being invalidate because project d9ae28d1e2a242d1a401f6b50357e78c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:42:48.385656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-df31b245-0a83-4429-ac0e-6711a85add3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:48.386399 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-df31b245-0a83-4429-ac0e-6711a85add3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:48.388339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1143/2251] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:42:48 2022] DELETE /identity/v3/projects/d9ae28d1e2a242d1a401f6b50357e78c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:48.393174 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d42ab8-5a93-4918-9eb1-de1fdf0fe4c1 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:48.403891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d42ab8-5a93-4918-9eb1-de1fdf0fe4c1 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:48.469005 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fa635-a416-415a-b58a-1fae3db803a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:48.470349 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fa635-a416-415a-b58a-1fae3db803a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:48.470726 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fa635-a416-415a-b58a-1fae3db803a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:48.471008 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fa635-a416-415a-b58a-1fae3db803a1 admin admin] PATH_INFO: `/v3/users/36c5099eac08426abcb0f3c63d38e99c` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:48.472611 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fa635-a416-415a-b58a-1fae3db803a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c5099eac08426abcb0f3c63d38e99c)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:48.474608 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fa635-a416-415a-b58a-1fae3db803a1 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:48.548893 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1f3fa635-a416-415a-b58a-1fae3db803a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c5099eac08426abcb0f3c63d38e99c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:48.558137 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1f3fa635-a416-415a-b58a-1fae3db803a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c5099eac08426abcb0f3c63d38e99c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:48.558944 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1f3fa635-a416-415a-b58a-1fae3db803a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c5099eac08426abcb0f3c63d38e99c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:48.565013 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:48.567181 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1f3fa635-a416-415a-b58a-1fae3db803a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c5099eac08426abcb0f3c63d38e99c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:48.583057 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1f3fa635-a416-415a-b58a-1fae3db803a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c5099eac08426abcb0f3c63d38e99c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:48.589913 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1109/2252] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:42:48 2022] DELETE /identity/v3/users/36c5099eac08426abcb0f3c63d38e99c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:48.918831 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31b245-0a83-4429-ac0e-6711a85add3f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:48.920871 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-df31b245-0a83-4429-ac0e-6711a85add3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:48.937304 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31b245-0a83-4429-ac0e-6711a85add3f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:48.999911 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96672fd4-449f-4514-8770-66455bb3cd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:49.000683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96672fd4-449f-4514-8770-66455bb3cd06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:49.000953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96672fd4-449f-4514-8770-66455bb3cd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:49.001216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96672fd4-449f-4514-8770-66455bb3cd06 admin admin] PATH_INFO: `/v3/projects/b619cbca4a7940f39635eef67cd6fa69` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:49.002399 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96672fd4-449f-4514-8770-66455bb3cd06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b619cbca4a7940f39635eef67cd6fa69)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:49.004392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96672fd4-449f-4514-8770-66455bb3cd06 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:49.064105 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-96672fd4-449f-4514-8770-66455bb3cd06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b619cbca4a7940f39635eef67cd6fa69', 'request_id': 'req-96672fd4-449f-4514-8770-66455bb3cd06'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:49.069557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-96672fd4-449f-4514-8770-66455bb3cd06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b619cbca4a7940f39635eef67cd6fa69', 'request_id': 'req-96672fd4-449f-4514-8770-66455bb3cd06'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:49.076802 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-96672fd4-449f-4514-8770-66455bb3cd06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b619cbca4a7940f39635eef67cd6fa69', 'request_id': 'req-96672fd4-449f-4514-8770-66455bb3cd06'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:49.088514 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:49.093161 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-96672fd4-449f-4514-8770-66455bb3cd06 admin admin] The token cache is being invalidate because project b619cbca4a7940f39635eef67cd6fa69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:42:49.093460 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-96672fd4-449f-4514-8770-66455bb3cd06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:49.094802 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-96672fd4-449f-4514-8770-66455bb3cd06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:49.096660 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1144/2253] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:42:48 2022] DELETE /identity/v3/projects/b619cbca4a7940f39635eef67cd6fa69 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:49.101708 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f418b40-75f8-4e2e-9fad-670fbaa818fe None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:49.101998 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f418b40-75f8-4e2e-9fad-670fbaa818fe None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:49.102310 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f418b40-75f8-4e2e-9fad-670fbaa818fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:49.120530 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-4f418b40-75f8-4e2e-9fad-670fbaa818fe None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:49.121732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4f418b40-75f8-4e2e-9fad-670fbaa818fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:49.181350 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1110/2254] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:42:49.191698 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749bad6-1ccf-474d-b97a-d0f9ad729f0b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:49.192027 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749bad6-1ccf-474d-b97a-d0f9ad729f0b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:49.192348 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749bad6-1ccf-474d-b97a-d0f9ad729f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:49.213330 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-7749bad6-1ccf-474d-b97a-d0f9ad729f0b None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:49.214586 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7749bad6-1ccf-474d-b97a-d0f9ad729f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:49.223363 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1145/2255] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:49.288922 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f418b40-75f8-4e2e-9fad-670fbaa818fe None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:49.305834 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f418b40-75f8-4e2e-9fad-670fbaa818fe None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:49.315449 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3b488-ebd3-4c4a-b326-b0c90d1e16b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:49.316685 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3b488-ebd3-4c4a-b326-b0c90d1e16b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:49.316685 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3b488-ebd3-4c4a-b326-b0c90d1e16b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:49.316685 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3b488-ebd3-4c4a-b326-b0c90d1e16b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:49.318463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3b488-ebd3-4c4a-b326-b0c90d1e16b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:42:49.318463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3b488-ebd3-4c4a-b326-b0c90d1e16b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:49.319621 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3b488-ebd3-4c4a-b326-b0c90d1e16b8 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:49.335170 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1111/2256] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:42:49.340098 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749bad6-1ccf-474d-b97a-d0f9ad729f0b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:49.350807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749bad6-1ccf-474d-b97a-d0f9ad729f0b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:49.355948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd5cc3-4e6c-4c09-8989-2b06abedd531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:49.356618 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd5cc3-4e6c-4c09-8989-2b06abedd531 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:49.356894 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd5cc3-4e6c-4c09-8989-2b06abedd531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:49.357164 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd5cc3-4e6c-4c09-8989-2b06abedd531 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:49.358488 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd5cc3-4e6c-4c09-8989-2b06abedd531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:49.360458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd5cc3-4e6c-4c09-8989-2b06abedd531 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:49.388670 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1146/2257] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:42:49 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:42:49.393631 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3b488-ebd3-4c4a-b326-b0c90d1e16b8 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:49.404398 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3b488-ebd3-4c4a-b326-b0c90d1e16b8 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:49.468123 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cc313-592b-4e9b-83f8-a8638884875a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:49.468825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cc313-592b-4e9b-83f8-a8638884875a admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:49.469097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cc313-592b-4e9b-83f8-a8638884875a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:49.469363 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cc313-592b-4e9b-83f8-a8638884875a admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:49.470071 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cc313-592b-4e9b-83f8-a8638884875a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:49.472062 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cc313-592b-4e9b-83f8-a8638884875a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:49.494904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1112/2258] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:42:49 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:42:49.501143 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd5cc3-4e6c-4c09-8989-2b06abedd531 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:49.512050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd5cc3-4e6c-4c09-8989-2b06abedd531 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:49.518707 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76244ee8-db4a-460f-b4aa-9891666f609f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:49.519376 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76244ee8-db4a-460f-b4aa-9891666f609f admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:49.519652 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76244ee8-db4a-460f-b4aa-9891666f609f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:49.519921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76244ee8-db4a-460f-b4aa-9891666f609f admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:49.520654 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76244ee8-db4a-460f-b4aa-9891666f609f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:49.522248 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76244ee8-db4a-460f-b4aa-9891666f609f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:49.533958 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1147/2259] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:42:49.538360 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cc313-592b-4e9b-83f8-a8638884875a admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:49.548604 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cc313-592b-4e9b-83f8-a8638884875a admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:49.553709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91426a0-7266-4ca2-95ec-4db3ca2cf25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:49.554349 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91426a0-7266-4ca2-95ec-4db3ca2cf25b admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:49.554651 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91426a0-7266-4ca2-95ec-4db3ca2cf25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:49.554914 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91426a0-7266-4ca2-95ec-4db3ca2cf25b admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:49.555627 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91426a0-7266-4ca2-95ec-4db3ca2cf25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:49.557192 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91426a0-7266-4ca2-95ec-4db3ca2cf25b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:49.568185 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1113/2260] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:42:49.574312 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76244ee8-db4a-460f-b4aa-9891666f609f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:49.591777 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76244ee8-db4a-460f-b4aa-9891666f609f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:49.598157 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16c5b5-fa1b-4893-9bf2-d48886d63ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:49.599130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16c5b5-fa1b-4893-9bf2-d48886d63ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:49.599401 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16c5b5-fa1b-4893-9bf2-d48886d63ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:49.599717 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16c5b5-fa1b-4893-9bf2-d48886d63ec7 admin admin] PATH_INFO: `/v3/projects/d80cc5adb96c4bac87fa83a335327781/users/455a2648683543769918197e6798ae8a/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:49.620531 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16c5b5-fa1b-4893-9bf2-d48886d63ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d80cc5adb96c4bac87fa83a335327781, user_id=455a2648683543769918197e6798ae8a, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:49.624796 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16c5b5-fa1b-4893-9bf2-d48886d63ec7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:49.640537 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1148/2261] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:42:49 2022] PUT /identity/v3/projects/d80cc5adb96c4bac87fa83a335327781/users/455a2648683543769918197e6798ae8a/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:49.646168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cd6c4-41b7-4a61-aff0-ee758f2ee056 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:49.646456 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cd6c4-41b7-4a61-aff0-ee758f2ee056 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:49.646776 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cd6c4-41b7-4a61-aff0-ee758f2ee056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:49.665383 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-279cd6c4-41b7-4a61-aff0-ee758f2ee056 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:49.666600 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-279cd6c4-41b7-4a61-aff0-ee758f2ee056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:49.707430 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:49.729894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1114/2262] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:49.739633 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16c5b5-fa1b-4893-9bf2-d48886d63ec7 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:49.741487 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2f16c5b5-fa1b-4893-9bf2-d48886d63ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:49.804986 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16c5b5-fa1b-4893-9bf2-d48886d63ec7 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:49.808684 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efc22a-7538-4384-a9df-0ec57e17ee8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:49.809339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efc22a-7538-4384-a9df-0ec57e17ee8e service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:49.809620 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efc22a-7538-4384-a9df-0ec57e17ee8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:49.809892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efc22a-7538-4384-a9df-0ec57e17ee8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:49.823577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efc22a-7538-4384-a9df-0ec57e17ee8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:49.825643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efc22a-7538-4384-a9df-0ec57e17ee8e service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:49.836449 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1149/2263] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:50.725860 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb7636-a90e-4b7c-ae14-d892951ef88a None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:50.726399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb7636-a90e-4b7c-ae14-d892951ef88a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:50.726399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb7636-a90e-4b7c-ae14-d892951ef88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:50.755204 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-43cb7636-a90e-4b7c-ae14-d892951ef88a None None] MFA Rules not processed for user `455a2648683543769918197e6798ae8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:50.756712 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-43cb7636-a90e-4b7c-ae14-d892951ef88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:50.824462 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1115/2264] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:42:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:50.835469 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efc22a-7538-4384-a9df-0ec57e17ee8e service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:50.836864 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-91efc22a-7538-4384-a9df-0ec57e17ee8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:50.907344 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efc22a-7538-4384-a9df-0ec57e17ee8e service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:50.910830 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3751c-34ca-44a0-9fae-0cfd9f07c397 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:50.911694 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3751c-34ca-44a0-9fae-0cfd9f07c397 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:50.911894 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3751c-34ca-44a0-9fae-0cfd9f07c397 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:50.912163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3751c-34ca-44a0-9fae-0cfd9f07c397 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:50.921706 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3751c-34ca-44a0-9fae-0cfd9f07c397 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:50.923153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3751c-34ca-44a0-9fae-0cfd9f07c397 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:50.932278 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1150/2265] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:52.295231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16586d54-e693-4076-ad48-da4e4d254123 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:52.295779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16586d54-e693-4076-ad48-da4e4d254123 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:52.295779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16586d54-e693-4076-ad48-da4e4d254123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:52.316221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-16586d54-e693-4076-ad48-da4e4d254123 None None] MFA Rules not processed for user `455a2648683543769918197e6798ae8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:52.317426 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-16586d54-e693-4076-ad48-da4e4d254123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:52.325654 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1116/2266] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:42:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:57.096962 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed75fc3-089e-4836-846c-2ea564af0807 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:57.097414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed75fc3-089e-4836-846c-2ea564af0807 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:57.097503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed75fc3-089e-4836-846c-2ea564af0807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:57.155542 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4ed75fc3-089e-4836-846c-2ea564af0807 None None] MFA Rules not processed for user `cbf7d6db675047cbb3a3f16631c59622`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:57.156788 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4ed75fc3-089e-4836-846c-2ea564af0807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:57.167324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:57.231064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1151/2267] 10.222.0.18 () {58 vars in 967 bytes} [Thu Jun 2 13:42:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:57.243696 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16586d54-e693-4076-ad48-da4e4d254123 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:57.245143 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-16586d54-e693-4076-ad48-da4e4d254123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:57.345455 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16586d54-e693-4076-ad48-da4e4d254123 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:57.351349 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03730bb-6335-42f9-9279-bad6850f6ea8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd0e37b0404419bb5752228bd809be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:57.352008 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03730bb-6335-42f9-9279-bad6850f6ea8 service swift] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:57.352269 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03730bb-6335-42f9-9279-bad6850f6ea8 service swift] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:57.352534 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03730bb-6335-42f9-9279-bad6850f6ea8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:57.361253 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03730bb-6335-42f9-9279-bad6850f6ea8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:57.362858 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03730bb-6335-42f9-9279-bad6850f6ea8 service swift] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:57.370920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1117/2268] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 13:42:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:43:07.228243 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=22 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:07.367689 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=83 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:21.158506 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed75fc3-089e-4836-846c-2ea564af0807 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:21.160876 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4ed75fc3-089e-4836-846c-2ea564af0807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:21.240080 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed75fc3-089e-4836-846c-2ea564af0807 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:21.245609 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850bb9ad-b008-4dd2-b273-87abc3b5bd0d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f7ea9741a5d409d87b8ebb4390a74ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:21.246297 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bb9ad-b008-4dd2-b273-87abc3b5bd0d service placement] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:21.246600 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bb9ad-b008-4dd2-b273-87abc3b5bd0d service placement] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:21.246904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bb9ad-b008-4dd2-b273-87abc3b5bd0d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:21.248908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-850bb9ad-b008-4dd2-b273-87abc3b5bd0d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:21.289226 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850bb9ad-b008-4dd2-b273-87abc3b5bd0d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:21.290979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850bb9ad-b008-4dd2-b273-87abc3b5bd0d service placement] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:21.305333 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1152/2269] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:43:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:43:27.677593 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94890f71-7b28-4093-991a-6dcdee8ffe73 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:27.678143 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94890f71-7b28-4093-991a-6dcdee8ffe73 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:27.678143 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94890f71-7b28-4093-991a-6dcdee8ffe73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:27.697804 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-94890f71-7b28-4093-991a-6dcdee8ffe73 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:43:27.699926 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-94890f71-7b28-4093-991a-6dcdee8ffe73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:27.710369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1118/2270] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jun 2 13:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:43:27.748699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850bb9ad-b008-4dd2-b273-87abc3b5bd0d service placement] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:27.750329 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-850bb9ad-b008-4dd2-b273-87abc3b5bd0d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:27.832338 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850bb9ad-b008-4dd2-b273-87abc3b5bd0d service placement] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:27.838266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340f4cc-0545-4fbd-a7b3-91728ac2a33b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:27.838883 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340f4cc-0545-4fbd-a7b3-91728ac2a33b service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:27.839162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340f4cc-0545-4fbd-a7b3-91728ac2a33b service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:27.839438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340f4cc-0545-4fbd-a7b3-91728ac2a33b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:27.848261 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9340f4cc-0545-4fbd-a7b3-91728ac2a33b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:27.849847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9340f4cc-0545-4fbd-a7b3-91728ac2a33b service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:27.859508 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1153/2271] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:43:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:43:31.756917 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edfbf9-4148-4516-927b-01a8577e6b1b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:31.757476 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edfbf9-4148-4516-927b-01a8577e6b1b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:31.757476 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edfbf9-4148-4516-927b-01a8577e6b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:31.778042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-26edfbf9-4148-4516-927b-01a8577e6b1b None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:43:31.779295 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-26edfbf9-4148-4516-927b-01a8577e6b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:31.789078 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1119/2272] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jun 2 13:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:43:31.812387 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340f4cc-0545-4fbd-a7b3-91728ac2a33b service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:31.813955 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9340f4cc-0545-4fbd-a7b3-91728ac2a33b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:31.836274 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340f4cc-0545-4fbd-a7b3-91728ac2a33b service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:31.842377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612562e-c1cc-431b-b941-539c3a6a414f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:31.843213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612562e-c1cc-431b-b941-539c3a6a414f service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:31.843557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612562e-c1cc-431b-b941-539c3a6a414f service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:31.843891 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612562e-c1cc-431b-b941-539c3a6a414f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:31.853232 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612562e-c1cc-431b-b941-539c3a6a414f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:31.855043 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612562e-c1cc-431b-b941-539c3a6a414f service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:31.865545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1154/2273] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:43:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:43:35.001569 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07aeaa-8410-4e76-8145-d6f7972c4a9e None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:35.002150 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07aeaa-8410-4e76-8145-d6f7972c4a9e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:35.002150 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07aeaa-8410-4e76-8145-d6f7972c4a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:35.021729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-ab07aeaa-8410-4e76-8145-d6f7972c4a9e None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:43:35.022993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ab07aeaa-8410-4e76-8145-d6f7972c4a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:35.031050 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1120/2274] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jun 2 13:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:43:35.060150 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612562e-c1cc-431b-b941-539c3a6a414f service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:35.071542 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612562e-c1cc-431b-b941-539c3a6a414f service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:35.078498 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d70269-52a8-4701-b9cf-5c88b0232786 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:35.079281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d70269-52a8-4701-b9cf-5c88b0232786 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:35.079580 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d70269-52a8-4701-b9cf-5c88b0232786 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:35.079833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d70269-52a8-4701-b9cf-5c88b0232786 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:35.089410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d70269-52a8-4701-b9cf-5c88b0232786 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:35.091275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d70269-52a8-4701-b9cf-5c88b0232786 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:35.101587 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1155/2275] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:43:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:43:36.681251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e607506-3902-49c5-9501-498f42e4aef6 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:36.681752 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e607506-3902-49c5-9501-498f42e4aef6 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:36.681897 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e607506-3902-49c5-9501-498f42e4aef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:36.699865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-0e607506-3902-49c5-9501-498f42e4aef6 None None] MFA Rules not processed for user `bb90d2315ce54db8820d4943b1a8c53c`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:43:36.701028 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0e607506-3902-49c5-9501-498f42e4aef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:36.759404 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1121/2276] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:43:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:43:39.095958 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb2d3d-6ae1-4ca4-92ad-0920bc9f8ed7 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:39.096458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb2d3d-6ae1-4ca4-92ad-0920bc9f8ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:39.096458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb2d3d-6ae1-4ca4-92ad-0920bc9f8ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:39.117998 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-97eb2d3d-6ae1-4ca4-92ad-0920bc9f8ed7 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:43:39.119238 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-97eb2d3d-6ae1-4ca4-92ad-0920bc9f8ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:39.128701 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1156/2277] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jun 2 13:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:43:39.153014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e607506-3902-49c5-9501-498f42e4aef6 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:39.171307 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e607506-3902-49c5-9501-498f42e4aef6 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:39.181659 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601711d-380a-4ff3-a3fe-a7806674be33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:39.182549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601711d-380a-4ff3-a3fe-a7806674be33 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:39.182938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601711d-380a-4ff3-a3fe-a7806674be33 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:39.183209 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601711d-380a-4ff3-a3fe-a7806674be33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:39.192282 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601711d-380a-4ff3-a3fe-a7806674be33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:39.193869 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601711d-380a-4ff3-a3fe-a7806674be33 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:39.203950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1122/2278] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:43:41.758613 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db3117-9f2e-409d-88cc-a4ce9f2c880a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:41.759169 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db3117-9f2e-409d-88cc-a4ce9f2c880a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:41.759169 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db3117-9f2e-409d-88cc-a4ce9f2c880a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:41.779577 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e3db3117-9f2e-409d-88cc-a4ce9f2c880a None None] MFA Rules not processed for user `f0f9f36f32754886b5a66a88c229f147`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:43:41.780919 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e3db3117-9f2e-409d-88cc-a4ce9f2c880a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:41.824282 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:41.845605 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1157/2279] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:43:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:43:44.366638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7da1e-3c7e-4d32-8430-9073f91e8fa3 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:44.367231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7da1e-3c7e-4d32-8430-9073f91e8fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:44.367231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7da1e-3c7e-4d32-8430-9073f91e8fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:44.395392 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-97f7da1e-3c7e-4d32-8430-9073f91e8fa3 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:43:44.396642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-97f7da1e-3c7e-4d32-8430-9073f91e8fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:44.405732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1123/2280] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jun 2 13:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:43:44.431053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db3117-9f2e-409d-88cc-a4ce9f2c880a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:44.445017 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db3117-9f2e-409d-88cc-a4ce9f2c880a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:44.451419 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07410a4b-aa90-45b8-a42e-ba06998c5ecc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:44.452094 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07410a4b-aa90-45b8-a42e-ba06998c5ecc service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:44.452374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07410a4b-aa90-45b8-a42e-ba06998c5ecc service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:44.452645 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07410a4b-aa90-45b8-a42e-ba06998c5ecc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:44.461904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07410a4b-aa90-45b8-a42e-ba06998c5ecc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:44.463541 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07410a4b-aa90-45b8-a42e-ba06998c5ecc service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:44.474621 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1158/2281] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:43:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:43:49.602361 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fe46d-2720-4abc-943b-e28a1292e70b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:49.602940 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fe46d-2720-4abc-943b-e28a1292e70b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:49.602940 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fe46d-2720-4abc-943b-e28a1292e70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:49.622510 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d61fe46d-2720-4abc-943b-e28a1292e70b None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:43:49.623724 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d61fe46d-2720-4abc-943b-e28a1292e70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:49.632704 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1124/2282] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jun 2 13:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:43:49.658339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07410a4b-aa90-45b8-a42e-ba06998c5ecc service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:49.670147 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07410a4b-aa90-45b8-a42e-ba06998c5ecc service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:49.677219 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1f6ee-43c1-4e0d-a831-1f4f1405f27b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:49.677887 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1f6ee-43c1-4e0d-a831-1f4f1405f27b service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:49.678159 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1f6ee-43c1-4e0d-a831-1f4f1405f27b service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:49.678426 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1f6ee-43c1-4e0d-a831-1f4f1405f27b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:49.687806 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1f6ee-43c1-4e0d-a831-1f4f1405f27b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:49.689393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1f6ee-43c1-4e0d-a831-1f4f1405f27b service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:49.699631 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1159/2283] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:43:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:43:59.617015 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=46 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:59.695144 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=18 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:01.594626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656b51f-ee74-4ff3-9760-db2a9e6e0d6b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:01.595150 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656b51f-ee74-4ff3-9760-db2a9e6e0d6b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:01.595252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656b51f-ee74-4ff3-9760-db2a9e6e0d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:01.614760 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-8656b51f-ee74-4ff3-9760-db2a9e6e0d6b None None] MFA Rules not processed for user `78290c0b02cd4cf2844decf6e7569535`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:01.615940 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8656b51f-ee74-4ff3-9760-db2a9e6e0d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:01.688283 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1125/2284] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:44:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:11.680897 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=25 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:11.952928 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6e311-a75b-4851-88a5-b412b597bb1e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:11.953480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6e311-a75b-4851-88a5-b412b597bb1e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:11.953480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6e311-a75b-4851-88a5-b412b597bb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:11.973175 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-91a6e311-a75b-4851-88a5-b412b597bb1e None None] MFA Rules not processed for user `455a2648683543769918197e6798ae8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:11.974366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-91a6e311-a75b-4851-88a5-b412b597bb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:11.982561 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1160/2285] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:44:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:19.557766 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658de547-0079-482d-9955-f2e46ccb654e None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:19.558280 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658de547-0079-482d-9955-f2e46ccb654e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:19.558280 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658de547-0079-482d-9955-f2e46ccb654e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:19.578249 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-658de547-0079-482d-9955-f2e46ccb654e None None] MFA Rules not processed for user `cbf7d6db675047cbb3a3f16631c59622`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:19.579524 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-658de547-0079-482d-9955-f2e46ccb654e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:19.587180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1126/2286] 10.222.0.18 () {58 vars in 967 bytes} [Thu Jun 2 13:44:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:19.642350 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6e311-a75b-4851-88a5-b412b597bb1e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:19.654091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6e311-a75b-4851-88a5-b412b597bb1e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:19.659567 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff803f-0277-40f8-90fa-6ecbf55ce1f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd0e37b0404419bb5752228bd809be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:19.660279 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff803f-0277-40f8-90fa-6ecbf55ce1f8 service swift] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:19.660557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff803f-0277-40f8-90fa-6ecbf55ce1f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:19.660931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff803f-0277-40f8-90fa-6ecbf55ce1f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:19.669535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff803f-0277-40f8-90fa-6ecbf55ce1f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:19.672034 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff803f-0277-40f8-90fa-6ecbf55ce1f8 service swift] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:19.680704 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1161/2287] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 13:44:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:44:27.293449 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658de547-0079-482d-9955-f2e46ccb654e None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:27.295264 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-658de547-0079-482d-9955-f2e46ccb654e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:27.316418 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658de547-0079-482d-9955-f2e46ccb654e None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:27.320980 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072ccfa-4833-4e38-ab09-caf49f9d3817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:27.321904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072ccfa-4833-4e38-ab09-caf49f9d3817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:27.322185 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072ccfa-4833-4e38-ab09-caf49f9d3817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:27.322457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072ccfa-4833-4e38-ab09-caf49f9d3817 admin admin] PATH_INFO: `/v3/users/bc022eae29434380af8bfdb9561e238d` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:27.323719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072ccfa-4833-4e38-ab09-caf49f9d3817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc022eae29434380af8bfdb9561e238d)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:27.325640 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072ccfa-4833-4e38-ab09-caf49f9d3817 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:27.382120 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f072ccfa-4833-4e38-ab09-caf49f9d3817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc022eae29434380af8bfdb9561e238d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:27.392123 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f072ccfa-4833-4e38-ab09-caf49f9d3817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc022eae29434380af8bfdb9561e238d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:27.393340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f072ccfa-4833-4e38-ab09-caf49f9d3817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc022eae29434380af8bfdb9561e238d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:27.404298 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f072ccfa-4833-4e38-ab09-caf49f9d3817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc022eae29434380af8bfdb9561e238d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:27.420103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f072ccfa-4833-4e38-ab09-caf49f9d3817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc022eae29434380af8bfdb9561e238d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:27.426130 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1127/2288] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:44:27 2022] DELETE /identity/v3/users/bc022eae29434380af8bfdb9561e238d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:27.616568 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff803f-0277-40f8-90fa-6ecbf55ce1f8 service swift] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:27.629406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff803f-0277-40f8-90fa-6ecbf55ce1f8 service swift] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:27.703591 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691cfaa-fb96-47a7-89fa-43196f0b0918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:27.704584 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691cfaa-fb96-47a7-89fa-43196f0b0918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:27.704879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691cfaa-fb96-47a7-89fa-43196f0b0918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:27.705150 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691cfaa-fb96-47a7-89fa-43196f0b0918 admin admin] PATH_INFO: `/v3/projects/ce8a4689c5744b8e9b0cfdf40c5e4e8e` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:27.706381 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691cfaa-fb96-47a7-89fa-43196f0b0918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce8a4689c5744b8e9b0cfdf40c5e4e8e)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:27.708369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691cfaa-fb96-47a7-89fa-43196f0b0918 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:27.756487 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1691cfaa-fb96-47a7-89fa-43196f0b0918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce8a4689c5744b8e9b0cfdf40c5e4e8e', 'request_id': 'req-1691cfaa-fb96-47a7-89fa-43196f0b0918'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:27.761738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1691cfaa-fb96-47a7-89fa-43196f0b0918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce8a4689c5744b8e9b0cfdf40c5e4e8e', 'request_id': 'req-1691cfaa-fb96-47a7-89fa-43196f0b0918'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:27.768591 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1691cfaa-fb96-47a7-89fa-43196f0b0918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce8a4689c5744b8e9b0cfdf40c5e4e8e', 'request_id': 'req-1691cfaa-fb96-47a7-89fa-43196f0b0918'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:27.783427 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1691cfaa-fb96-47a7-89fa-43196f0b0918 admin admin] The token cache is being invalidate because project ce8a4689c5744b8e9b0cfdf40c5e4e8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:44:27.783648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1691cfaa-fb96-47a7-89fa-43196f0b0918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:27.784310 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1691cfaa-fb96-47a7-89fa-43196f0b0918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:27.785896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1162/2289] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:44:27 2022] DELETE /identity/v3/projects/ce8a4689c5744b8e9b0cfdf40c5e4e8e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:27.790017 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072ccfa-4833-4e38-ab09-caf49f9d3817 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:27.791498 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f072ccfa-4833-4e38-ab09-caf49f9d3817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:27.805164 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072ccfa-4833-4e38-ab09-caf49f9d3817 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:27.862844 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f0bde-8529-4121-8429-5ee3e49e28e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:27.863720 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f0bde-8529-4121-8429-5ee3e49e28e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:27.864039 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f0bde-8529-4121-8429-5ee3e49e28e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:27.864307 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f0bde-8529-4121-8429-5ee3e49e28e4 admin admin] PATH_INFO: `/v3/users/5e7ef880080b482fad46596bbd6e32d1` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:27.865549 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f0bde-8529-4121-8429-5ee3e49e28e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e7ef880080b482fad46596bbd6e32d1)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:27.867495 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f0bde-8529-4121-8429-5ee3e49e28e4 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:27.921427 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ee0f0bde-8529-4121-8429-5ee3e49e28e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e7ef880080b482fad46596bbd6e32d1'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:27.929210 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ee0f0bde-8529-4121-8429-5ee3e49e28e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e7ef880080b482fad46596bbd6e32d1'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:27.929914 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ee0f0bde-8529-4121-8429-5ee3e49e28e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e7ef880080b482fad46596bbd6e32d1'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:27.936665 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ee0f0bde-8529-4121-8429-5ee3e49e28e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e7ef880080b482fad46596bbd6e32d1'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:27.941044 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:27.949867 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ee0f0bde-8529-4121-8429-5ee3e49e28e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e7ef880080b482fad46596bbd6e32d1'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:27.956571 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1128/2290] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:44:27 2022] DELETE /identity/v3/users/5e7ef880080b482fad46596bbd6e32d1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:28.146097 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691cfaa-fb96-47a7-89fa-43196f0b0918 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:28.147680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1691cfaa-fb96-47a7-89fa-43196f0b0918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:28.163496 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691cfaa-fb96-47a7-89fa-43196f0b0918 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:28.221701 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73dcd0c-0a9f-48df-ade7-8bf93240971e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:28.222589 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dcd0c-0a9f-48df-ade7-8bf93240971e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:28.222891 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dcd0c-0a9f-48df-ade7-8bf93240971e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:28.223161 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dcd0c-0a9f-48df-ade7-8bf93240971e admin admin] PATH_INFO: `/v3/projects/2d06e6c44bb74cf6aa6751de574647bf` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:28.224379 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73dcd0c-0a9f-48df-ade7-8bf93240971e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d06e6c44bb74cf6aa6751de574647bf)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:28.226278 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73dcd0c-0a9f-48df-ade7-8bf93240971e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:28.238324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:28.279645 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c73dcd0c-0a9f-48df-ade7-8bf93240971e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d06e6c44bb74cf6aa6751de574647bf', 'request_id': 'req-c73dcd0c-0a9f-48df-ade7-8bf93240971e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:28.285168 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c73dcd0c-0a9f-48df-ade7-8bf93240971e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d06e6c44bb74cf6aa6751de574647bf', 'request_id': 'req-c73dcd0c-0a9f-48df-ade7-8bf93240971e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:28.291243 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c73dcd0c-0a9f-48df-ade7-8bf93240971e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d06e6c44bb74cf6aa6751de574647bf', 'request_id': 'req-c73dcd0c-0a9f-48df-ade7-8bf93240971e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:28.305968 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c73dcd0c-0a9f-48df-ade7-8bf93240971e admin admin] The token cache is being invalidate because project 2d06e6c44bb74cf6aa6751de574647bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:44:28.306252 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c73dcd0c-0a9f-48df-ade7-8bf93240971e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:28.306917 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c73dcd0c-0a9f-48df-ade7-8bf93240971e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:28.308490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1163/2291] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:44:28 2022] DELETE /identity/v3/projects/2d06e6c44bb74cf6aa6751de574647bf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:28.313904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e254b-e567-4391-833c-356e2a77738c None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:28.314407 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e254b-e567-4391-833c-356e2a77738c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:28.314407 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e254b-e567-4391-833c-356e2a77738c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:28.333295 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-3e7e254b-e567-4391-833c-356e2a77738c None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:28.334468 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3e7e254b-e567-4391-833c-356e2a77738c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:28.395494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1129/2292] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:28.406486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deba483-f6d0-479e-b757-e59a83cab605 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:28.406799 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deba483-f6d0-479e-b757-e59a83cab605 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:28.407121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deba483-f6d0-479e-b757-e59a83cab605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:28.426112 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-5deba483-f6d0-479e-b757-e59a83cab605 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:28.427343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5deba483-f6d0-479e-b757-e59a83cab605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:28.436158 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1164/2293] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:28.441346 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e254b-e567-4391-833c-356e2a77738c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:28.456888 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e254b-e567-4391-833c-356e2a77738c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:28.463740 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce373d-40b5-41db-b2a9-baf3b2acdbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:28.464440 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce373d-40b5-41db-b2a9-baf3b2acdbec admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:28.464722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce373d-40b5-41db-b2a9-baf3b2acdbec admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:28.465000 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce373d-40b5-41db-b2a9-baf3b2acdbec admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:28.465732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce373d-40b5-41db-b2a9-baf3b2acdbec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:44:28.466037 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce373d-40b5-41db-b2a9-baf3b2acdbec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:28.468105 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce373d-40b5-41db-b2a9-baf3b2acdbec admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:28.485016 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1130/2294] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:44:28.486213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deba483-f6d0-479e-b757-e59a83cab605 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:28.496185 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deba483-f6d0-479e-b757-e59a83cab605 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:28.501255 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e67090-31f0-47ed-8da6-a62b6c7dbb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:28.501885 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e67090-31f0-47ed-8da6-a62b6c7dbb61 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:28.502167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e67090-31f0-47ed-8da6-a62b6c7dbb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:28.502426 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e67090-31f0-47ed-8da6-a62b6c7dbb61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:28.503160 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e67090-31f0-47ed-8da6-a62b6c7dbb61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:28.505036 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e67090-31f0-47ed-8da6-a62b6c7dbb61 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:28.532565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1165/2295] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:28 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:28.536949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce373d-40b5-41db-b2a9-baf3b2acdbec admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:28.547972 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce373d-40b5-41db-b2a9-baf3b2acdbec admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:28.609953 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77dd4e-1bcf-42d1-814c-b307197b8d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:28.610667 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77dd4e-1bcf-42d1-814c-b307197b8d7a admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:28.610936 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77dd4e-1bcf-42d1-814c-b307197b8d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:28.611202 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77dd4e-1bcf-42d1-814c-b307197b8d7a admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:28.611887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77dd4e-1bcf-42d1-814c-b307197b8d7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:28.613801 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77dd4e-1bcf-42d1-814c-b307197b8d7a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:28.637619 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1131/2296] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:28 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:44:28.642663 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e67090-31f0-47ed-8da6-a62b6c7dbb61 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:28.653324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e67090-31f0-47ed-8da6-a62b6c7dbb61 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:28.659247 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31292c50-845b-46c3-b351-36bb6e0b2164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:28.659910 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31292c50-845b-46c3-b351-36bb6e0b2164 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:28.660202 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31292c50-845b-46c3-b351-36bb6e0b2164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:28.660469 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31292c50-845b-46c3-b351-36bb6e0b2164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:28.661197 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31292c50-845b-46c3-b351-36bb6e0b2164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:28.662814 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31292c50-845b-46c3-b351-36bb6e0b2164 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:28.674187 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1166/2297] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:28.679617 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77dd4e-1bcf-42d1-814c-b307197b8d7a admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:28.696109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77dd4e-1bcf-42d1-814c-b307197b8d7a admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:28.704631 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72497a-cee9-4552-a672-d0d7e7341c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:28.705338 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72497a-cee9-4552-a672-d0d7e7341c01 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:28.705638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72497a-cee9-4552-a672-d0d7e7341c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:28.705987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72497a-cee9-4552-a672-d0d7e7341c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:28.706682 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72497a-cee9-4552-a672-d0d7e7341c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:28.708622 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72497a-cee9-4552-a672-d0d7e7341c01 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:28.720447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1132/2298] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:28.725381 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31292c50-845b-46c3-b351-36bb6e0b2164 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:28.737106 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31292c50-845b-46c3-b351-36bb6e0b2164 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:28.742862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb37e6a-d095-4fb0-b667-1dd4ed745484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:28.744407 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb37e6a-d095-4fb0-b667-1dd4ed745484 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:28.744682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb37e6a-d095-4fb0-b667-1dd4ed745484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:28.745380 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb37e6a-d095-4fb0-b667-1dd4ed745484 admin admin] PATH_INFO: `/v3/projects/830099cdefd6444f9593af1ba8462470/users/cd9388ebdfa4425a834fd73d9fadcc33/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:28.765197 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb37e6a-d095-4fb0-b667-1dd4ed745484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=830099cdefd6444f9593af1ba8462470, user_id=cd9388ebdfa4425a834fd73d9fadcc33, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:28.768019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb37e6a-d095-4fb0-b667-1dd4ed745484 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:28.783188 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1167/2299] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:28 2022] PUT /identity/v3/projects/830099cdefd6444f9593af1ba8462470/users/cd9388ebdfa4425a834fd73d9fadcc33/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:28.788559 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d06c9-a713-4824-bfc1-283da1e21c35 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:28.788845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d06c9-a713-4824-bfc1-283da1e21c35 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:28.789113 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d06c9-a713-4824-bfc1-283da1e21c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:28.808087 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-084d06c9-a713-4824-bfc1-283da1e21c35 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:28.809484 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-084d06c9-a713-4824-bfc1-283da1e21c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:28.855220 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:28.877815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1133/2300] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:28.881900 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb37e6a-d095-4fb0-b667-1dd4ed745484 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:28.883622 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-edb37e6a-d095-4fb0-b667-1dd4ed745484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:28.942483 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb37e6a-d095-4fb0-b667-1dd4ed745484 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:28.946240 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef55b96-5e6a-4f53-9f2f-aca0e2ccaf4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:28.946934 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef55b96-5e6a-4f53-9f2f-aca0e2ccaf4d service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:28.947214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef55b96-5e6a-4f53-9f2f-aca0e2ccaf4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:28.947485 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef55b96-5e6a-4f53-9f2f-aca0e2ccaf4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:28.958936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef55b96-5e6a-4f53-9f2f-aca0e2ccaf4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:28.960395 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef55b96-5e6a-4f53-9f2f-aca0e2ccaf4d service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:28.970922 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1168/2301] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:31.760278 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf4fed-bf7a-44b6-b4e9-34c33ba28eb1 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:31.762043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf4fed-bf7a-44b6-b4e9-34c33ba28eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:31.762327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf4fed-bf7a-44b6-b4e9-34c33ba28eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:31.797433 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-09cf4fed-bf7a-44b6-b4e9-34c33ba28eb1 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:31.800866 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-09cf4fed-bf7a-44b6-b4e9-34c33ba28eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:31.818358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1134/2302] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jun 2 13:44:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:31.848916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef55b96-5e6a-4f53-9f2f-aca0e2ccaf4d service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:31.850918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-aef55b96-5e6a-4f53-9f2f-aca0e2ccaf4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:31.908669 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:31.976185 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef55b96-5e6a-4f53-9f2f-aca0e2ccaf4d service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:31.985086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49e272-d2a0-4c77-b94a-02c9192c0e29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:31.986767 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49e272-d2a0-4c77-b94a-02c9192c0e29 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:31.987342 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49e272-d2a0-4c77-b94a-02c9192c0e29 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:31.989415 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49e272-d2a0-4c77-b94a-02c9192c0e29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:32.000299 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49e272-d2a0-4c77-b94a-02c9192c0e29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:32.004169 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49e272-d2a0-4c77-b94a-02c9192c0e29 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:32.039479 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1169/2303] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:33.335731 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32be988-22b0-4012-8a44-3fa1601c401f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:33.336213 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32be988-22b0-4012-8a44-3fa1601c401f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:33.336332 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32be988-22b0-4012-8a44-3fa1601c401f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:33.366369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d32be988-22b0-4012-8a44-3fa1601c401f None None] MFA Rules not processed for user `cd9388ebdfa4425a834fd73d9fadcc33`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:33.367643 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d32be988-22b0-4012-8a44-3fa1601c401f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:33.512100 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1135/2304] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:44:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:33.517972 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49e272-d2a0-4c77-b94a-02c9192c0e29 service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:33.528659 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49e272-d2a0-4c77-b94a-02c9192c0e29 service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:33.534325 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b2fdc-1389-4eca-b101-4d7ea4ce3c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:33.535237 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b2fdc-1389-4eca-b101-4d7ea4ce3c1d admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:33.535518 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b2fdc-1389-4eca-b101-4d7ea4ce3c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:33.535792 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b2fdc-1389-4eca-b101-4d7ea4ce3c1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:33.536502 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b2fdc-1389-4eca-b101-4d7ea4ce3c1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:33.538399 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b2fdc-1389-4eca-b101-4d7ea4ce3c1d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:33.569007 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1170/2305] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:33 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:33.574870 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32be988-22b0-4012-8a44-3fa1601c401f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:33.586767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32be988-22b0-4012-8a44-3fa1601c401f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:33.667803 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdc5b4-6b6d-4167-b385-28593b72e74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:33.668504 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdc5b4-6b6d-4167-b385-28593b72e74a admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:33.668813 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdc5b4-6b6d-4167-b385-28593b72e74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:33.669089 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdc5b4-6b6d-4167-b385-28593b72e74a admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:33.670190 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cdc5b4-6b6d-4167-b385-28593b72e74a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:33.672175 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cdc5b4-6b6d-4167-b385-28593b72e74a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:33.698616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1136/2306] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:33 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:44:33.700392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b2fdc-1389-4eca-b101-4d7ea4ce3c1d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:33.711953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b2fdc-1389-4eca-b101-4d7ea4ce3c1d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:33.718729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f08405-3535-4dc8-bbb4-93acd03d43a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:33.719550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f08405-3535-4dc8-bbb4-93acd03d43a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:33.719835 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f08405-3535-4dc8-bbb4-93acd03d43a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:33.720109 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f08405-3535-4dc8-bbb4-93acd03d43a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:33.721015 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f08405-3535-4dc8-bbb4-93acd03d43a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:33.722797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f08405-3535-4dc8-bbb4-93acd03d43a6 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:33.734191 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1171/2307] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:33.738894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdc5b4-6b6d-4167-b385-28593b72e74a admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:33.749730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdc5b4-6b6d-4167-b385-28593b72e74a admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:33.754950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b61a47-08da-48ff-b88d-ede64a74c4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:33.755886 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b61a47-08da-48ff-b88d-ede64a74c4e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:33.756163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b61a47-08da-48ff-b88d-ede64a74c4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:33.756433 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b61a47-08da-48ff-b88d-ede64a74c4e4 admin admin] PATH_INFO: `/v3/projects/c5ea2facadb44ec99af635bf1899debf/users/1ac3a81103f549538c0e34909eacbdd8/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:33.773198 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b61a47-08da-48ff-b88d-ede64a74c4e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ea2facadb44ec99af635bf1899debf, user_id=1ac3a81103f549538c0e34909eacbdd8, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:33.775945 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b61a47-08da-48ff-b88d-ede64a74c4e4 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:33.793918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1137/2308] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:33 2022] PUT /identity/v3/projects/c5ea2facadb44ec99af635bf1899debf/users/1ac3a81103f549538c0e34909eacbdd8/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:33.797998 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f08405-3535-4dc8-bbb4-93acd03d43a6 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:33.808561 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f08405-3535-4dc8-bbb4-93acd03d43a6 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:33.871671 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b965a5f-5c94-461d-86c9-52dc9e636434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:33.872199 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b965a5f-5c94-461d-86c9-52dc9e636434 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:33.872499 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b965a5f-5c94-461d-86c9-52dc9e636434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:33.872811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b965a5f-5c94-461d-86c9-52dc9e636434 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:33.873668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b965a5f-5c94-461d-86c9-52dc9e636434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:33.875238 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b965a5f-5c94-461d-86c9-52dc9e636434 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:33.886179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1172/2309] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:33.891151 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b61a47-08da-48ff-b88d-ede64a74c4e4 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:33.902481 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b61a47-08da-48ff-b88d-ede64a74c4e4 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:33.909301 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727fa28-2862-4387-ad96-d7d5eb85c38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:33.910213 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727fa28-2862-4387-ad96-d7d5eb85c38f admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:33.910493 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727fa28-2862-4387-ad96-d7d5eb85c38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:33.910791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727fa28-2862-4387-ad96-d7d5eb85c38f admin admin] PATH_INFO: `/v3/projects/c5ea2facadb44ec99af635bf1899debf/users/1ac3a81103f549538c0e34909eacbdd8/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:33.918875 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727fa28-2862-4387-ad96-d7d5eb85c38f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ea2facadb44ec99af635bf1899debf, user_id=1ac3a81103f549538c0e34909eacbdd8, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:33.926826 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727fa28-2862-4387-ad96-d7d5eb85c38f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:33.943439 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1138/2310] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:33 2022] PUT /identity/v3/projects/c5ea2facadb44ec99af635bf1899debf/users/1ac3a81103f549538c0e34909eacbdd8/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:39.320976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26fb0c-ab4c-4042-9d82-bdc345de38ea None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:39.321596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26fb0c-ab4c-4042-9d82-bdc345de38ea None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:39.321596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26fb0c-ab4c-4042-9d82-bdc345de38ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:39.343976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-bb26fb0c-ab4c-4042-9d82-bdc345de38ea None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:39.345498 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-bb26fb0c-ab4c-4042-9d82-bdc345de38ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:39.411951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1173/2311] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jun 2 13:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:39.442377 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727fa28-2862-4387-ad96-d7d5eb85c38f admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:39.499176 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:39.709190 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727fa28-2862-4387-ad96-d7d5eb85c38f admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:39.730357 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f5e35-959f-4ab8-92c3-5eed07d9feb5 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:39.730753 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f5e35-959f-4ab8-92c3-5eed07d9feb5 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:39.731006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f5e35-959f-4ab8-92c3-5eed07d9feb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:39.756025 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e9b59-12b1-4d9e-9e03-413ea1c369c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:39.757325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e9b59-12b1-4d9e-9e03-413ea1c369c8 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:39.757618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e9b59-12b1-4d9e-9e03-413ea1c369c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:39.758196 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e9b59-12b1-4d9e-9e03-413ea1c369c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:39.771531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e9b59-12b1-4d9e-9e03-413ea1c369c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:39.773437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e9b59-12b1-4d9e-9e03-413ea1c369c8 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:39.781517 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ea8f5e35-959f-4ab8-92c3-5eed07d9feb5 None None] MFA Rules not processed for user `1ac3a81103f549538c0e34909eacbdd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:39.782238 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ea8f5e35-959f-4ab8-92c3-5eed07d9feb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:39.805176 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:39.818120 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1139/2312] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:39.910126 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1174/2313] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:44:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:39.926900 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e9b59-12b1-4d9e-9e03-413ea1c369c8 service nova] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:39.930553 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-963e9b59-12b1-4d9e-9e03-413ea1c369c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:39.949067 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e9b59-12b1-4d9e-9e03-413ea1c369c8 service nova] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:39.971308 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b2e0a-9fc5-47a6-a988-e085ac4a56b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:39.972082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b2e0a-9fc5-47a6-a988-e085ac4a56b3 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:39.972430 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b2e0a-9fc5-47a6-a988-e085ac4a56b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:39.972775 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b2e0a-9fc5-47a6-a988-e085ac4a56b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:40.066129 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b2e0a-9fc5-47a6-a988-e085ac4a56b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:40.068194 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b2e0a-9fc5-47a6-a988-e085ac4a56b3 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:40.078485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1140/2314] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:39 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:41.401917 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c6141-6ee4-4c99-8f92-5593defcbaea None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:41.402488 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c6141-6ee4-4c99-8f92-5593defcbaea None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:41.402488 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c6141-6ee4-4c99-8f92-5593defcbaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:41.422407 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-1a5c6141-6ee4-4c99-8f92-5593defcbaea None None] MFA Rules not processed for user `cd9388ebdfa4425a834fd73d9fadcc33`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:41.423813 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1a5c6141-6ee4-4c99-8f92-5593defcbaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:41.431895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1175/2315] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:44:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:46.612725 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b600e7-73fb-49a8-aa67-c35c029d946b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:46.613294 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b600e7-73fb-49a8-aa67-c35c029d946b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:46.613294 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b600e7-73fb-49a8-aa67-c35c029d946b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:46.680265 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-a4b600e7-73fb-49a8-aa67-c35c029d946b None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:46.688435 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a4b600e7-73fb-49a8-aa67-c35c029d946b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:46.704355 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1141/2316] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jun 2 13:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:46.754535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c6141-6ee4-4c99-8f92-5593defcbaea None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:46.773640 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c6141-6ee4-4c99-8f92-5593defcbaea None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:46.779795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce66b3e-8cd5-40c8-a94e-c5ba9ac948c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:46.780557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce66b3e-8cd5-40c8-a94e-c5ba9ac948c2 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:46.781027 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce66b3e-8cd5-40c8-a94e-c5ba9ac948c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:46.781731 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce66b3e-8cd5-40c8-a94e-c5ba9ac948c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:46.793605 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce66b3e-8cd5-40c8-a94e-c5ba9ac948c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:46.796022 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce66b3e-8cd5-40c8-a94e-c5ba9ac948c2 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:46.811591 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1176/2317] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:48.727648 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cdb50-636d-4439-a92c-50c3d6f54eab None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:48.728625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cdb50-636d-4439-a92c-50c3d6f54eab None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:48.728908 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cdb50-636d-4439-a92c-50c3d6f54eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:48.746374 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-217cdb50-636d-4439-a92c-50c3d6f54eab None None] MFA Rules not processed for user `e1cd9b4bda834e90b366d83445c85810`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:48.747922 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-217cdb50-636d-4439-a92c-50c3d6f54eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:48.806907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1142/2318] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:44:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:52.983489 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed0d5b-3a62-4eee-b70d-4db01adaeb4e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:52.984022 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed0d5b-3a62-4eee-b70d-4db01adaeb4e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:52.984134 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed0d5b-3a62-4eee-b70d-4db01adaeb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:53.002783 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-baed0d5b-3a62-4eee-b70d-4db01adaeb4e None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:53.004072 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-baed0d5b-3a62-4eee-b70d-4db01adaeb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:53.012277 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1177/2319] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jun 2 13:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:53.035347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cdb50-636d-4439-a92c-50c3d6f54eab None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:53.051526 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cdb50-636d-4439-a92c-50c3d6f54eab None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:53.056217 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e6104-5bc4-4931-873f-0c212713b8b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:53.056924 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e6104-5bc4-4931-873f-0c212713b8b0 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:53.057199 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e6104-5bc4-4931-873f-0c212713b8b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:53.057474 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e6104-5bc4-4931-873f-0c212713b8b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:53.066787 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e6104-5bc4-4931-873f-0c212713b8b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:53.068364 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e6104-5bc4-4931-873f-0c212713b8b0 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:53.078348 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1143/2320] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:54.019062 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed0d5b-3a62-4eee-b70d-4db01adaeb4e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:54.020775 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-baed0d5b-3a62-4eee-b70d-4db01adaeb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:54.097824 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed0d5b-3a62-4eee-b70d-4db01adaeb4e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:54.101775 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f4c46-5232-4b82-afa3-710768f4d8a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:54.102432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f4c46-5232-4b82-afa3-710768f4d8a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:54.102777 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f4c46-5232-4b82-afa3-710768f4d8a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:54.103052 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f4c46-5232-4b82-afa3-710768f4d8a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:54.104896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7b2f4c46-5232-4b82-afa3-710768f4d8a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:54.118778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f4c46-5232-4b82-afa3-710768f4d8a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:54.120218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f4c46-5232-4b82-afa3-710768f4d8a1 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:54.132481 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1178/2321] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:55.556663 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e6104-5bc4-4931-873f-0c212713b8b0 service nova] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:55.567364 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e6104-5bc4-4931-873f-0c212713b8b0 service nova] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:55.571087 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b89e6-afb7-4108-8cee-9143580abc6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:55.571732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b89e6-afb7-4108-8cee-9143580abc6e service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:55.571999 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b89e6-afb7-4108-8cee-9143580abc6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:55.572276 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b89e6-afb7-4108-8cee-9143580abc6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:55.574075 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b66b89e6-afb7-4108-8cee-9143580abc6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:55.588922 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b89e6-afb7-4108-8cee-9143580abc6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:55.590510 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b89e6-afb7-4108-8cee-9143580abc6e service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:55.603051 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1144/2322] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:44:59.273357 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42817d21-6daf-478e-b74f-fed4d06b0a7a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:59.273856 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42817d21-6daf-478e-b74f-fed4d06b0a7a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:59.273856 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42817d21-6daf-478e-b74f-fed4d06b0a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:59.292739 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-42817d21-6daf-478e-b74f-fed4d06b0a7a None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:59.293921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-42817d21-6daf-478e-b74f-fed4d06b0a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:59.302868 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1179/2323] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jun 2 13:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:59.354493 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b89e6-afb7-4108-8cee-9143580abc6e service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:59.366392 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b89e6-afb7-4108-8cee-9143580abc6e service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:59.372898 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3647bc1-7c46-4d27-be05-e066da81b404 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:59.373558 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3647bc1-7c46-4d27-be05-e066da81b404 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:59.373835 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3647bc1-7c46-4d27-be05-e066da81b404 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:59.374105 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3647bc1-7c46-4d27-be05-e066da81b404 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:59.382879 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3647bc1-7c46-4d27-be05-e066da81b404 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:59.384451 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3647bc1-7c46-4d27-be05-e066da81b404 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:59.394523 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1145/2324] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:04.163727 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42817d21-6daf-478e-b74f-fed4d06b0a7a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:04.178905 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42817d21-6daf-478e-b74f-fed4d06b0a7a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:04.184994 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e0744-edb6-4159-bd15-d2e8ca96443e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:04.185801 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e0744-edb6-4159-bd15-d2e8ca96443e service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:04.186391 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e0744-edb6-4159-bd15-d2e8ca96443e service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:04.186834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e0744-edb6-4159-bd15-d2e8ca96443e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:04.189247 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-610e0744-edb6-4159-bd15-d2e8ca96443e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:04.211121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e0744-edb6-4159-bd15-d2e8ca96443e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:04.212582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e0744-edb6-4159-bd15-d2e8ca96443e service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:04.225102 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1180/2325] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:08.772595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3647bc1-7c46-4d27-be05-e066da81b404 service nova] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:08.774202 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a3647bc1-7c46-4d27-be05-e066da81b404 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:08.799187 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3647bc1-7c46-4d27-be05-e066da81b404 service nova] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:08.804802 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e01b1-a84e-49e2-9862-830d57ef7399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:08.805939 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e01b1-a84e-49e2-9862-830d57ef7399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:08.806409 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e01b1-a84e-49e2-9862-830d57ef7399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:08.806884 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e01b1-a84e-49e2-9862-830d57ef7399 admin admin] PATH_INFO: `/v3/users/f0f9f36f32754886b5a66a88c229f147` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:08.809323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e01b1-a84e-49e2-9862-830d57ef7399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0f9f36f32754886b5a66a88c229f147)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:08.811062 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e01b1-a84e-49e2-9862-830d57ef7399 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:08.815780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:08.867577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-850e01b1-a84e-49e2-9862-830d57ef7399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0f9f36f32754886b5a66a88c229f147'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:08.881568 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-850e01b1-a84e-49e2-9862-830d57ef7399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0f9f36f32754886b5a66a88c229f147'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:08.882299 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-850e01b1-a84e-49e2-9862-830d57ef7399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0f9f36f32754886b5a66a88c229f147'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:08.890203 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-850e01b1-a84e-49e2-9862-830d57ef7399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0f9f36f32754886b5a66a88c229f147'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:08.903190 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-850e01b1-a84e-49e2-9862-830d57ef7399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0f9f36f32754886b5a66a88c229f147'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:08.910432 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1146/2326] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:45:08 2022] DELETE /identity/v3/users/f0f9f36f32754886b5a66a88c229f147 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:09.114401 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e0744-edb6-4159-bd15-d2e8ca96443e service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:09.126717 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e0744-edb6-4159-bd15-d2e8ca96443e service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:09.209745 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6951caa-f1f5-4ae5-b0f5-2869a9a740d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:09.210790 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6951caa-f1f5-4ae5-b0f5-2869a9a740d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:09.211082 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6951caa-f1f5-4ae5-b0f5-2869a9a740d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:09.211349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6951caa-f1f5-4ae5-b0f5-2869a9a740d4 admin admin] PATH_INFO: `/v3/projects/5ec953e62d1042de93e1e56b91ab083d` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:09.212561 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6951caa-f1f5-4ae5-b0f5-2869a9a740d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ec953e62d1042de93e1e56b91ab083d)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:09.215294 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6951caa-f1f5-4ae5-b0f5-2869a9a740d4 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:09.238387 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:09.288399 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c6951caa-f1f5-4ae5-b0f5-2869a9a740d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ec953e62d1042de93e1e56b91ab083d', 'request_id': 'req-c6951caa-f1f5-4ae5-b0f5-2869a9a740d4'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:09.295931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c6951caa-f1f5-4ae5-b0f5-2869a9a740d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ec953e62d1042de93e1e56b91ab083d', 'request_id': 'req-c6951caa-f1f5-4ae5-b0f5-2869a9a740d4'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:09.304978 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c6951caa-f1f5-4ae5-b0f5-2869a9a740d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ec953e62d1042de93e1e56b91ab083d', 'request_id': 'req-c6951caa-f1f5-4ae5-b0f5-2869a9a740d4'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:09.322892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c6951caa-f1f5-4ae5-b0f5-2869a9a740d4 admin admin] The token cache is being invalidate because project 5ec953e62d1042de93e1e56b91ab083d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:45:09.323089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c6951caa-f1f5-4ae5-b0f5-2869a9a740d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:09.323880 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c6951caa-f1f5-4ae5-b0f5-2869a9a740d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:09.329300 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1181/2327] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:45:09 2022] DELETE /identity/v3/projects/5ec953e62d1042de93e1e56b91ab083d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:09.332988 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d134eb5-e024-442d-a3dd-db7e0145f76f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:09.333303 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d134eb5-e024-442d-a3dd-db7e0145f76f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:09.335311 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d134eb5-e024-442d-a3dd-db7e0145f76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:09.359399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-9d134eb5-e024-442d-a3dd-db7e0145f76f None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:09.361871 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9d134eb5-e024-442d-a3dd-db7e0145f76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:09.448385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1147/2328] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:09.467043 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bb638-a65e-438e-888c-5f3a5508f983 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:09.467361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bb638-a65e-438e-888c-5f3a5508f983 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:09.467656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bb638-a65e-438e-888c-5f3a5508f983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:09.492709 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-715bb638-a65e-438e-888c-5f3a5508f983 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:09.494923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-715bb638-a65e-438e-888c-5f3a5508f983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:09.514594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1182/2329] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:09.516251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d134eb5-e024-442d-a3dd-db7e0145f76f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:09.528516 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d134eb5-e024-442d-a3dd-db7e0145f76f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:09.534160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8619bd-af97-4e37-adae-6c9653477f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:09.534904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8619bd-af97-4e37-adae-6c9653477f04 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:09.535191 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8619bd-af97-4e37-adae-6c9653477f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:09.535487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8619bd-af97-4e37-adae-6c9653477f04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:09.536252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8619bd-af97-4e37-adae-6c9653477f04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:45:09.536603 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8619bd-af97-4e37-adae-6c9653477f04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:09.538230 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8619bd-af97-4e37-adae-6c9653477f04 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:09.556319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1148/2330] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:45:09.557516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bb638-a65e-438e-888c-5f3a5508f983 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:09.568632 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bb638-a65e-438e-888c-5f3a5508f983 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:09.574059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b615c-d080-41a0-ab44-cfc8adf9a91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:09.575168 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b615c-d080-41a0-ab44-cfc8adf9a91b admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:09.575168 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b615c-d080-41a0-ab44-cfc8adf9a91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:09.575417 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b615c-d080-41a0-ab44-cfc8adf9a91b admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:09.575983 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b615c-d080-41a0-ab44-cfc8adf9a91b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:09.578069 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b615c-d080-41a0-ab44-cfc8adf9a91b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:09.611291 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1183/2331] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:45:09 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:09.612520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8619bd-af97-4e37-adae-6c9653477f04 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:09.625111 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8619bd-af97-4e37-adae-6c9653477f04 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:09.693654 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69202bcc-48f4-4dfd-83b1-3a7becfa3cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:09.694371 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69202bcc-48f4-4dfd-83b1-3a7becfa3cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:09.694671 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69202bcc-48f4-4dfd-83b1-3a7becfa3cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:09.694947 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69202bcc-48f4-4dfd-83b1-3a7becfa3cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:09.695772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69202bcc-48f4-4dfd-83b1-3a7becfa3cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:09.697682 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69202bcc-48f4-4dfd-83b1-3a7becfa3cb6 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:09.716698 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:09.731724 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1149/2332] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:45:09 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:09.733032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b615c-d080-41a0-ab44-cfc8adf9a91b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:09.745462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b615c-d080-41a0-ab44-cfc8adf9a91b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:09.750276 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe8b6b-e856-401f-8255-c79bf419be63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:09.751119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe8b6b-e856-401f-8255-c79bf419be63 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:09.751493 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe8b6b-e856-401f-8255-c79bf419be63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:09.751790 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe8b6b-e856-401f-8255-c79bf419be63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:09.752551 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe8b6b-e856-401f-8255-c79bf419be63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:09.754543 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe8b6b-e856-401f-8255-c79bf419be63 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:09.756110 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7611473-47b0-4c19-becd-18c75597044b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:09.756476 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7611473-47b0-4c19-becd-18c75597044b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:09.756810 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7611473-47b0-4c19-becd-18c75597044b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:09.766411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1184/2333] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:09.771388 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe8b6b-e856-401f-8255-c79bf419be63 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:09.775940 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-e7611473-47b0-4c19-becd-18c75597044b None None] MFA Rules not processed for user `bb90d2315ce54db8820d4943b1a8c53c`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:09.777367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e7611473-47b0-4c19-becd-18c75597044b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:09.783081 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe8b6b-e856-401f-8255-c79bf419be63 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:09.788700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9ee9a-d8c0-4ba6-b763-a8c2316cc131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:09.789442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9ee9a-d8c0-4ba6-b763-a8c2316cc131 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:09.791215 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9ee9a-d8c0-4ba6-b763-a8c2316cc131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:09.791215 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9ee9a-d8c0-4ba6-b763-a8c2316cc131 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:09.791215 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9ee9a-d8c0-4ba6-b763-a8c2316cc131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:09.792901 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9ee9a-d8c0-4ba6-b763-a8c2316cc131 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:09.804731 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1185/2334] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:09.808787 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9ee9a-d8c0-4ba6-b763-a8c2316cc131 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:09.819074 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9ee9a-d8c0-4ba6-b763-a8c2316cc131 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:09.824255 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b06228-f791-40f9-a02c-5878fca5ad42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:09.825088 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b06228-f791-40f9-a02c-5878fca5ad42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:09.825371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b06228-f791-40f9-a02c-5878fca5ad42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:09.825672 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b06228-f791-40f9-a02c-5878fca5ad42 admin admin] PATH_INFO: `/v3/projects/10345b5ebceb40d098ae50fdef4d7f3d/users/0c778e9fd5a54d9a9ff7fba042a795be/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:09.839955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1150/2335] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:45:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:45:09.848551 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b06228-f791-40f9-a02c-5878fca5ad42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10345b5ebceb40d098ae50fdef4d7f3d, user_id=0c778e9fd5a54d9a9ff7fba042a795be, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:09.851440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b06228-f791-40f9-a02c-5878fca5ad42 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:09.874689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1186/2336] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:45:09 2022] PUT /identity/v3/projects/10345b5ebceb40d098ae50fdef4d7f3d/users/0c778e9fd5a54d9a9ff7fba042a795be/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:45:09.880151 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d3446-7bfc-445b-8edc-06ef6e554e7f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:09.880444 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d3446-7bfc-445b-8edc-06ef6e554e7f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:09.880750 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d3446-7bfc-445b-8edc-06ef6e554e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:09.919324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-051d3446-7bfc-445b-8edc-06ef6e554e7f None None] MFA Rules not processed for user `0c778e9fd5a54d9a9ff7fba042a795be`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:09.920717 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-051d3446-7bfc-445b-8edc-06ef6e554e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:10.004285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1151/2337] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:45:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:10.217645 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b06228-f791-40f9-a02c-5878fca5ad42 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:10.219953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a7b06228-f791-40f9-a02c-5878fca5ad42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:10.271076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d3446-7bfc-445b-8edc-06ef6e554e7f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:10.272739 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-051d3446-7bfc-445b-8edc-06ef6e554e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:10.302753 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b06228-f791-40f9-a02c-5878fca5ad42 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:10.308434 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3982a8b-34a0-45fe-b05b-b0adaa8af4e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:10.309092 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3982a8b-34a0-45fe-b05b-b0adaa8af4e9 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:10.309373 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3982a8b-34a0-45fe-b05b-b0adaa8af4e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:10.309651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3982a8b-34a0-45fe-b05b-b0adaa8af4e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:10.317729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3982a8b-34a0-45fe-b05b-b0adaa8af4e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:10.319350 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3982a8b-34a0-45fe-b05b-b0adaa8af4e9 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:10.328364 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1187/2338] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:10.331913 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d3446-7bfc-445b-8edc-06ef6e554e7f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:10.335828 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03990be-56c4-4f3c-a545-5acef0b45a1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:10.336488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03990be-56c4-4f3c-a545-5acef0b45a1c service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:10.336767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03990be-56c4-4f3c-a545-5acef0b45a1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:10.337037 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03990be-56c4-4f3c-a545-5acef0b45a1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:10.339044 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f03990be-56c4-4f3c-a545-5acef0b45a1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:10.352120 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03990be-56c4-4f3c-a545-5acef0b45a1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:10.352923 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03990be-56c4-4f3c-a545-5acef0b45a1c service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:10.361769 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1152/2339] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:10.625823 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3982a8b-34a0-45fe-b05b-b0adaa8af4e9 service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:10.638879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3982a8b-34a0-45fe-b05b-b0adaa8af4e9 service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:10.643569 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f6e95-f5d8-4048-b142-5411625c4f90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:10.644176 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f6e95-f5d8-4048-b142-5411625c4f90 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:10.644466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f6e95-f5d8-4048-b142-5411625c4f90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:10.644736 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f6e95-f5d8-4048-b142-5411625c4f90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:10.646921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-063f6e95-f5d8-4048-b142-5411625c4f90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:10.659885 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f6e95-f5d8-4048-b142-5411625c4f90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:10.661373 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f6e95-f5d8-4048-b142-5411625c4f90 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:10.664844 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:10.671349 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1188/2340] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:10.791377 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03990be-56c4-4f3c-a545-5acef0b45a1c service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:10.792847 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f03990be-56c4-4f3c-a545-5acef0b45a1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:10.851908 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:10.885760 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03990be-56c4-4f3c-a545-5acef0b45a1c service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:10.918319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c43173-329c-4f7f-b9e9-1a7c6b6f8835 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f7ea9741a5d409d87b8ebb4390a74ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:10.922181 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c43173-329c-4f7f-b9e9-1a7c6b6f8835 service placement] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:10.923266 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c43173-329c-4f7f-b9e9-1a7c6b6f8835 service placement] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:10.923964 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c43173-329c-4f7f-b9e9-1a7c6b6f8835 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:10.926328 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-13c43173-329c-4f7f-b9e9-1a7c6b6f8835 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:10.954539 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c43173-329c-4f7f-b9e9-1a7c6b6f8835 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:10.957219 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c43173-329c-4f7f-b9e9-1a7c6b6f8835 service placement] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:10.973022 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1153/2341] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:11.114631 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f6e95-f5d8-4048-b142-5411625c4f90 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:11.210659 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f6e95-f5d8-4048-b142-5411625c4f90 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:11.218233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b00c9-a54e-42c6-b4fc-e16798aa100e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:11.219372 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b00c9-a54e-42c6-b4fc-e16798aa100e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:11.220028 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b00c9-a54e-42c6-b4fc-e16798aa100e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:11.221699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b00c9-a54e-42c6-b4fc-e16798aa100e admin admin] PATH_INFO: `/v3/users/0c778e9fd5a54d9a9ff7fba042a795be` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:11.223251 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b00c9-a54e-42c6-b4fc-e16798aa100e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c778e9fd5a54d9a9ff7fba042a795be)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:11.226066 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b00c9-a54e-42c6-b4fc-e16798aa100e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:11.317149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2d3b00c9-a54e-42c6-b4fc-e16798aa100e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c778e9fd5a54d9a9ff7fba042a795be'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:11.330084 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2d3b00c9-a54e-42c6-b4fc-e16798aa100e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c778e9fd5a54d9a9ff7fba042a795be'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:11.331209 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2d3b00c9-a54e-42c6-b4fc-e16798aa100e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c778e9fd5a54d9a9ff7fba042a795be'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:11.347103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2d3b00c9-a54e-42c6-b4fc-e16798aa100e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c778e9fd5a54d9a9ff7fba042a795be'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:11.349574 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2d3b00c9-a54e-42c6-b4fc-e16798aa100e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c778e9fd5a54d9a9ff7fba042a795be'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:11.372885 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1189/2342] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:45:11 2022] DELETE /identity/v3/users/0c778e9fd5a54d9a9ff7fba042a795be => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:11.374864 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66547dc9-31cc-45b9-8100-e6ce28ddeff4 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:11.375340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66547dc9-31cc-45b9-8100-e6ce28ddeff4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:11.376216 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66547dc9-31cc-45b9-8100-e6ce28ddeff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:11.408753 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-66547dc9-31cc-45b9-8100-e6ce28ddeff4 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:11.410188 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-66547dc9-31cc-45b9-8100-e6ce28ddeff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:11.516532 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1154/2343] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:11.525911 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b00c9-a54e-42c6-b4fc-e16798aa100e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:11.527404 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2d3b00c9-a54e-42c6-b4fc-e16798aa100e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:11.588643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b00c9-a54e-42c6-b4fc-e16798aa100e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:11.592225 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e54c7-4a09-415b-8018-62d1343d57f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:11.592874 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e54c7-4a09-415b-8018-62d1343d57f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:11.593148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e54c7-4a09-415b-8018-62d1343d57f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:11.593412 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e54c7-4a09-415b-8018-62d1343d57f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:11.606857 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e54c7-4a09-415b-8018-62d1343d57f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:11.608381 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e54c7-4a09-415b-8018-62d1343d57f5 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:11.620639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1190/2344] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:12.152782 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66547dc9-31cc-45b9-8100-e6ce28ddeff4 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:12.154335 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-66547dc9-31cc-45b9-8100-e6ce28ddeff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:12.185216 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66547dc9-31cc-45b9-8100-e6ce28ddeff4 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:12.194174 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fcd7c-bc70-4865-9306-608bfe0fae92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:12.195415 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fcd7c-bc70-4865-9306-608bfe0fae92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:12.195764 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fcd7c-bc70-4865-9306-608bfe0fae92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:12.196111 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fcd7c-bc70-4865-9306-608bfe0fae92 admin admin] PATH_INFO: `/v3/projects/10345b5ebceb40d098ae50fdef4d7f3d` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:12.197389 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fcd7c-bc70-4865-9306-608bfe0fae92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10345b5ebceb40d098ae50fdef4d7f3d)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:12.199490 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fcd7c-bc70-4865-9306-608bfe0fae92 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:12.262978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2f1fcd7c-bc70-4865-9306-608bfe0fae92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10345b5ebceb40d098ae50fdef4d7f3d', 'request_id': 'req-2f1fcd7c-bc70-4865-9306-608bfe0fae92'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:12.270249 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2f1fcd7c-bc70-4865-9306-608bfe0fae92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10345b5ebceb40d098ae50fdef4d7f3d', 'request_id': 'req-2f1fcd7c-bc70-4865-9306-608bfe0fae92'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:12.277092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2f1fcd7c-bc70-4865-9306-608bfe0fae92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10345b5ebceb40d098ae50fdef4d7f3d', 'request_id': 'req-2f1fcd7c-bc70-4865-9306-608bfe0fae92'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:12.290881 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2f1fcd7c-bc70-4865-9306-608bfe0fae92 admin admin] The token cache is being invalidate because project 10345b5ebceb40d098ae50fdef4d7f3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:45:12.291163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2f1fcd7c-bc70-4865-9306-608bfe0fae92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:12.291796 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2f1fcd7c-bc70-4865-9306-608bfe0fae92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:12.293370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1155/2345] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:45:12 2022] DELETE /identity/v3/projects/10345b5ebceb40d098ae50fdef4d7f3d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:12.298715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8895329-8191-4dde-8153-4ca43d078c8b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:12.299193 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8895329-8191-4dde-8153-4ca43d078c8b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:12.299302 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8895329-8191-4dde-8153-4ca43d078c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:12.319257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d8895329-8191-4dde-8153-4ca43d078c8b None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:12.320490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d8895329-8191-4dde-8153-4ca43d078c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:12.335135 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:12.386193 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1191/2346] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:12.394731 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307e498-d43b-4ada-b75d-bc3d78070ca7 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:12.395001 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307e498-d43b-4ada-b75d-bc3d78070ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:12.395276 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307e498-d43b-4ada-b75d-bc3d78070ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:12.413384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-9307e498-d43b-4ada-b75d-bc3d78070ca7 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:12.414501 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9307e498-d43b-4ada-b75d-bc3d78070ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:12.422949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1156/2347] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:12.427189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8895329-8191-4dde-8153-4ca43d078c8b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:12.437693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8895329-8191-4dde-8153-4ca43d078c8b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:12.443979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce7bd0-bd19-4bc2-8bb7-c28ca2a1db15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:12.444691 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce7bd0-bd19-4bc2-8bb7-c28ca2a1db15 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:12.444971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce7bd0-bd19-4bc2-8bb7-c28ca2a1db15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:12.445242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce7bd0-bd19-4bc2-8bb7-c28ca2a1db15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:12.445976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce7bd0-bd19-4bc2-8bb7-c28ca2a1db15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:45:12.446282 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce7bd0-bd19-4bc2-8bb7-c28ca2a1db15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:12.447937 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce7bd0-bd19-4bc2-8bb7-c28ca2a1db15 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:12.460827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1192/2348] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:45:12.465350 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307e498-d43b-4ada-b75d-bc3d78070ca7 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:12.475734 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307e498-d43b-4ada-b75d-bc3d78070ca7 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:12.480708 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c53b5e-6a35-4cd6-818e-f79e4fc118e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:12.481379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c53b5e-6a35-4cd6-818e-f79e4fc118e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:12.483163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c53b5e-6a35-4cd6-818e-f79e4fc118e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:12.483476 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c53b5e-6a35-4cd6-818e-f79e4fc118e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:12.484275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c53b5e-6a35-4cd6-818e-f79e4fc118e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:12.486885 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c53b5e-6a35-4cd6-818e-f79e4fc118e9 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:12.522386 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1157/2349] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:45:12 2022] POST /identity/v3/projects => generated 405 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:12.526437 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce7bd0-bd19-4bc2-8bb7-c28ca2a1db15 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:12.545432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce7bd0-bd19-4bc2-8bb7-c28ca2a1db15 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:12.608454 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30771c5-4e43-4b57-b062-9c2296ee7e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:12.609152 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30771c5-4e43-4b57-b062-9c2296ee7e10 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:12.609447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30771c5-4e43-4b57-b062-9c2296ee7e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:12.609701 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30771c5-4e43-4b57-b062-9c2296ee7e10 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:12.610480 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30771c5-4e43-4b57-b062-9c2296ee7e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:12.612748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30771c5-4e43-4b57-b062-9c2296ee7e10 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:12.641398 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1193/2350] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:45:12 2022] POST /identity/v3/users => generated 303 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:12.645747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c53b5e-6a35-4cd6-818e-f79e4fc118e9 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:12.659045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c53b5e-6a35-4cd6-818e-f79e4fc118e9 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:12.664201 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3cd02-f0a2-4f93-bf1b-342c189e4fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:12.664892 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3cd02-f0a2-4f93-bf1b-342c189e4fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:12.665177 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3cd02-f0a2-4f93-bf1b-342c189e4fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:12.665447 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3cd02-f0a2-4f93-bf1b-342c189e4fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:12.666538 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3cd02-f0a2-4f93-bf1b-342c189e4fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:12.667820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3cd02-f0a2-4f93-bf1b-342c189e4fd0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:12.683866 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1158/2351] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:12.685720 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30771c5-4e43-4b57-b062-9c2296ee7e10 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:12.698515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30771c5-4e43-4b57-b062-9c2296ee7e10 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:12.708457 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f0879-87bc-49a2-8fd1-6845881cd09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:12.709238 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f0879-87bc-49a2-8fd1-6845881cd09b admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:12.709520 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f0879-87bc-49a2-8fd1-6845881cd09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:12.709791 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f0879-87bc-49a2-8fd1-6845881cd09b admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:12.710520 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f0879-87bc-49a2-8fd1-6845881cd09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:12.712226 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f0879-87bc-49a2-8fd1-6845881cd09b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:12.723403 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1194/2352] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:12.727563 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3cd02-f0a2-4f93-bf1b-342c189e4fd0 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:12.738310 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3cd02-f0a2-4f93-bf1b-342c189e4fd0 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:12.743029 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c02a0-ae78-4551-8fb8-3816f654abf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:12.743926 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c02a0-ae78-4551-8fb8-3816f654abf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:12.744208 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c02a0-ae78-4551-8fb8-3816f654abf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:12.744480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c02a0-ae78-4551-8fb8-3816f654abf5 admin admin] PATH_INFO: `/v3/projects/f373f48fb6d041df9d940905dffa0c8b/users/89c3f1e3942c4e9a9abebb579bb13e1b/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:12.747752 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:12.762105 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c02a0-ae78-4551-8fb8-3816f654abf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f373f48fb6d041df9d940905dffa0c8b, user_id=89c3f1e3942c4e9a9abebb579bb13e1b, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:12.765700 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c02a0-ae78-4551-8fb8-3816f654abf5 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:12.780526 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1159/2353] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:45:12 2022] PUT /identity/v3/projects/f373f48fb6d041df9d940905dffa0c8b/users/89c3f1e3942c4e9a9abebb579bb13e1b/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:12.786507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db98d34-f16e-41e8-998f-dc935e8fc990 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:12.786822 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db98d34-f16e-41e8-998f-dc935e8fc990 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:12.787581 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db98d34-f16e-41e8-998f-dc935e8fc990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:12.806448 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3db98d34-f16e-41e8-998f-dc935e8fc990 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:12.807688 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3db98d34-f16e-41e8-998f-dc935e8fc990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:12.879459 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1195/2354] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:12.890677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c02a0-ae78-4551-8fb8-3816f654abf5 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:12.907034 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7d8c02a0-ae78-4551-8fb8-3816f654abf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:13.003578 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c02a0-ae78-4551-8fb8-3816f654abf5 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:13.008130 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa5dfd-db08-48b6-b95c-c42883ebc25d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:13.008816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa5dfd-db08-48b6-b95c-c42883ebc25d service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:13.009092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa5dfd-db08-48b6-b95c-c42883ebc25d service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:13.009382 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa5dfd-db08-48b6-b95c-c42883ebc25d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:13.019557 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa5dfd-db08-48b6-b95c-c42883ebc25d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:13.021194 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa5dfd-db08-48b6-b95c-c42883ebc25d service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:13.032036 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1160/2355] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:45:14.020655 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb49478-fddb-4ded-975c-ff959c9cf31e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:14.021167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb49478-fddb-4ded-975c-ff959c9cf31e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:14.021253 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb49478-fddb-4ded-975c-ff959c9cf31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:14.052714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-dfb49478-fddb-4ded-975c-ff959c9cf31e None None] MFA Rules not processed for user `89c3f1e3942c4e9a9abebb579bb13e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:14.053940 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-dfb49478-fddb-4ded-975c-ff959c9cf31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:14.069847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:14.145025 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1196/2356] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:45:14 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:14.146126 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa5dfd-db08-48b6-b95c-c42883ebc25d service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:14.157638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa5dfd-db08-48b6-b95c-c42883ebc25d service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:14.163171 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674985ab-3f33-438a-ad4a-d247da80d8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:14.165692 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674985ab-3f33-438a-ad4a-d247da80d8c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:14.166225 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674985ab-3f33-438a-ad4a-d247da80d8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:14.166757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674985ab-3f33-438a-ad4a-d247da80d8c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:14.167860 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674985ab-3f33-438a-ad4a-d247da80d8c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:14.170076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674985ab-3f33-438a-ad4a-d247da80d8c9 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:14.204660 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1161/2357] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:45:14 2022] POST /identity/v3/projects => generated 405 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:14.208698 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb49478-fddb-4ded-975c-ff959c9cf31e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:14.222479 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb49478-fddb-4ded-975c-ff959c9cf31e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:14.367310 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30274423-28b2-4d60-a6c8-0e87b45fe927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:14.367310 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30274423-28b2-4d60-a6c8-0e87b45fe927 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:14.367310 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30274423-28b2-4d60-a6c8-0e87b45fe927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:14.367310 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30274423-28b2-4d60-a6c8-0e87b45fe927 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:14.367752 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30274423-28b2-4d60-a6c8-0e87b45fe927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:14.370739 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30274423-28b2-4d60-a6c8-0e87b45fe927 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:14.425538 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1197/2358] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:45:14 2022] POST /identity/v3/users => generated 309 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:14.426251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674985ab-3f33-438a-ad4a-d247da80d8c9 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:14.450477 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674985ab-3f33-438a-ad4a-d247da80d8c9 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:14.458426 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1337f70-e9b8-4afd-b828-62bf0376531f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:14.461233 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1337f70-e9b8-4afd-b828-62bf0376531f admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:14.461415 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1337f70-e9b8-4afd-b828-62bf0376531f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:14.461758 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1337f70-e9b8-4afd-b828-62bf0376531f admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:14.462388 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1337f70-e9b8-4afd-b828-62bf0376531f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:14.467740 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1337f70-e9b8-4afd-b828-62bf0376531f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:14.502354 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30274423-28b2-4d60-a6c8-0e87b45fe927 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:14.503457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1162/2359] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:14.523888 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30274423-28b2-4d60-a6c8-0e87b45fe927 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:14.547847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd05bd6-7a76-4888-b52d-374eb0aefa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:14.550367 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd05bd6-7a76-4888-b52d-374eb0aefa72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:14.551678 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd05bd6-7a76-4888-b52d-374eb0aefa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:14.552039 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd05bd6-7a76-4888-b52d-374eb0aefa72 admin admin] PATH_INFO: `/v3/projects/c2123b1eb6504dbdb99a6ef323a9118f/users/3d6e269c95cf4fe98e7bf8a91ab5bc9b/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:14.592036 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd05bd6-7a76-4888-b52d-374eb0aefa72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2123b1eb6504dbdb99a6ef323a9118f, user_id=3d6e269c95cf4fe98e7bf8a91ab5bc9b, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:14.597130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd05bd6-7a76-4888-b52d-374eb0aefa72 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:14.629189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1198/2360] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:45:14 2022] PUT /identity/v3/projects/c2123b1eb6504dbdb99a6ef323a9118f/users/3d6e269c95cf4fe98e7bf8a91ab5bc9b/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:45:14.643072 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1337f70-e9b8-4afd-b828-62bf0376531f admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:14.658696 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1337f70-e9b8-4afd-b828-62bf0376531f admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:14.729348 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6cb3a-06a2-4d26-8399-290c52673d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:14.730042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6cb3a-06a2-4d26-8399-290c52673d5a admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:14.730329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6cb3a-06a2-4d26-8399-290c52673d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:14.730702 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6cb3a-06a2-4d26-8399-290c52673d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:14.731431 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6cb3a-06a2-4d26-8399-290c52673d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:14.733156 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6cb3a-06a2-4d26-8399-290c52673d5a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:14.744703 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1163/2361] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:14.748826 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd05bd6-7a76-4888-b52d-374eb0aefa72 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:14.761315 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd05bd6-7a76-4888-b52d-374eb0aefa72 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:14.768235 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785d6d9-cc56-4639-8148-15cc9352e2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:14.769163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785d6d9-cc56-4639-8148-15cc9352e2a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:14.769439 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785d6d9-cc56-4639-8148-15cc9352e2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:14.769712 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785d6d9-cc56-4639-8148-15cc9352e2a8 admin admin] PATH_INFO: `/v3/projects/c2123b1eb6504dbdb99a6ef323a9118f/users/3d6e269c95cf4fe98e7bf8a91ab5bc9b/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:14.771800 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785d6d9-cc56-4639-8148-15cc9352e2a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2123b1eb6504dbdb99a6ef323a9118f, user_id=3d6e269c95cf4fe98e7bf8a91ab5bc9b, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:14.774543 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785d6d9-cc56-4639-8148-15cc9352e2a8 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:14.791289 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1199/2362] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:45:14 2022] PUT /identity/v3/projects/c2123b1eb6504dbdb99a6ef323a9118f/users/3d6e269c95cf4fe98e7bf8a91ab5bc9b/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:45:16.556146 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aeba57-4ff8-49e2-b098-c58abcdc2027 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:16.556771 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aeba57-4ff8-49e2-b098-c58abcdc2027 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:16.556771 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aeba57-4ff8-49e2-b098-c58abcdc2027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:16.590148 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-09aeba57-4ff8-49e2-b098-c58abcdc2027 None None] MFA Rules not processed for user `3d6e269c95cf4fe98e7bf8a91ab5bc9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:16.591476 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-09aeba57-4ff8-49e2-b098-c58abcdc2027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:16.661138 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:16.699882 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1164/2363] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:45:16 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:18.204825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785d6d9-cc56-4639-8148-15cc9352e2a8 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:18.271635 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785d6d9-cc56-4639-8148-15cc9352e2a8 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:18.280161 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203eb0f-6186-4f76-bca6-03f9a1982d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:18.281392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203eb0f-6186-4f76-bca6-03f9a1982d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:18.281869 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203eb0f-6186-4f76-bca6-03f9a1982d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:18.283086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203eb0f-6186-4f76-bca6-03f9a1982d3a admin admin] PATH_INFO: `/v3/users/89c3f1e3942c4e9a9abebb579bb13e1b` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:18.284641 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203eb0f-6186-4f76-bca6-03f9a1982d3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=89c3f1e3942c4e9a9abebb579bb13e1b)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:18.286924 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203eb0f-6186-4f76-bca6-03f9a1982d3a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:18.298691 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:18.339034 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4203eb0f-6186-4f76-bca6-03f9a1982d3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89c3f1e3942c4e9a9abebb579bb13e1b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:18.347671 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4203eb0f-6186-4f76-bca6-03f9a1982d3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89c3f1e3942c4e9a9abebb579bb13e1b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:18.348391 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4203eb0f-6186-4f76-bca6-03f9a1982d3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89c3f1e3942c4e9a9abebb579bb13e1b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:18.364153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4203eb0f-6186-4f76-bca6-03f9a1982d3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89c3f1e3942c4e9a9abebb579bb13e1b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:18.365183 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4203eb0f-6186-4f76-bca6-03f9a1982d3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89c3f1e3942c4e9a9abebb579bb13e1b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:18.388651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1200/2364] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:45:18 2022] DELETE /identity/v3/users/89c3f1e3942c4e9a9abebb579bb13e1b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:45:18.700550 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aeba57-4ff8-49e2-b098-c58abcdc2027 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:18.716136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aeba57-4ff8-49e2-b098-c58abcdc2027 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:18.781915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739e9ce-789f-4e9e-a1e2-425c1e6e32b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:18.782644 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739e9ce-789f-4e9e-a1e2-425c1e6e32b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:18.782932 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739e9ce-789f-4e9e-a1e2-425c1e6e32b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:18.783205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739e9ce-789f-4e9e-a1e2-425c1e6e32b7 admin admin] PATH_INFO: `/v3/projects/f373f48fb6d041df9d940905dffa0c8b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:18.784418 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739e9ce-789f-4e9e-a1e2-425c1e6e32b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f373f48fb6d041df9d940905dffa0c8b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:18.786804 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739e9ce-789f-4e9e-a1e2-425c1e6e32b7 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:18.844350 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-7739e9ce-789f-4e9e-a1e2-425c1e6e32b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f373f48fb6d041df9d940905dffa0c8b', 'request_id': 'req-7739e9ce-789f-4e9e-a1e2-425c1e6e32b7'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:18.849911 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-7739e9ce-789f-4e9e-a1e2-425c1e6e32b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f373f48fb6d041df9d940905dffa0c8b', 'request_id': 'req-7739e9ce-789f-4e9e-a1e2-425c1e6e32b7'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:18.857179 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-7739e9ce-789f-4e9e-a1e2-425c1e6e32b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f373f48fb6d041df9d940905dffa0c8b', 'request_id': 'req-7739e9ce-789f-4e9e-a1e2-425c1e6e32b7'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:18.871158 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-7739e9ce-789f-4e9e-a1e2-425c1e6e32b7 admin admin] The token cache is being invalidate because project f373f48fb6d041df9d940905dffa0c8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:45:18.871446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-7739e9ce-789f-4e9e-a1e2-425c1e6e32b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:18.872078 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-7739e9ce-789f-4e9e-a1e2-425c1e6e32b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:18.873660 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1165/2365] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:45:18 2022] DELETE /identity/v3/projects/f373f48fb6d041df9d940905dffa0c8b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:18.877891 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203eb0f-6186-4f76-bca6-03f9a1982d3a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:18.879711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4203eb0f-6186-4f76-bca6-03f9a1982d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:18.894424 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203eb0f-6186-4f76-bca6-03f9a1982d3a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:18.958653 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b96946-8974-4dd4-a0b7-dc287e5e6d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:18.959582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96946-8974-4dd4-a0b7-dc287e5e6d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:18.959885 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96946-8974-4dd4-a0b7-dc287e5e6d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:18.960143 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96946-8974-4dd4-a0b7-dc287e5e6d28 admin admin] PATH_INFO: `/v3/users/3d6e269c95cf4fe98e7bf8a91ab5bc9b` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:18.961346 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b96946-8974-4dd4-a0b7-dc287e5e6d28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d6e269c95cf4fe98e7bf8a91ab5bc9b)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:18.963339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b96946-8974-4dd4-a0b7-dc287e5e6d28 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:19.014176 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c0b96946-8974-4dd4-a0b7-dc287e5e6d28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d6e269c95cf4fe98e7bf8a91ab5bc9b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:19.022099 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c0b96946-8974-4dd4-a0b7-dc287e5e6d28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d6e269c95cf4fe98e7bf8a91ab5bc9b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:19.023051 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c0b96946-8974-4dd4-a0b7-dc287e5e6d28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d6e269c95cf4fe98e7bf8a91ab5bc9b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:19.035819 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c0b96946-8974-4dd4-a0b7-dc287e5e6d28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d6e269c95cf4fe98e7bf8a91ab5bc9b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:19.036390 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c0b96946-8974-4dd4-a0b7-dc287e5e6d28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d6e269c95cf4fe98e7bf8a91ab5bc9b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:19.049503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1201/2366] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:45:18 2022] DELETE /identity/v3/users/3d6e269c95cf4fe98e7bf8a91ab5bc9b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:19.263334 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739e9ce-789f-4e9e-a1e2-425c1e6e32b7 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:19.264990 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7739e9ce-789f-4e9e-a1e2-425c1e6e32b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:19.278172 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739e9ce-789f-4e9e-a1e2-425c1e6e32b7 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:19.351433 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6cb44-2d5f-4574-8bd0-2deccb470551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:19.352326 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6cb44-2d5f-4574-8bd0-2deccb470551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:19.352627 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6cb44-2d5f-4574-8bd0-2deccb470551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:19.352905 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6cb44-2d5f-4574-8bd0-2deccb470551 admin admin] PATH_INFO: `/v3/projects/c2123b1eb6504dbdb99a6ef323a9118f` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:19.354211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6cb44-2d5f-4574-8bd0-2deccb470551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2123b1eb6504dbdb99a6ef323a9118f)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:19.356900 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6cb44-2d5f-4574-8bd0-2deccb470551 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:19.364751 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:19.410472 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bae6cb44-2d5f-4574-8bd0-2deccb470551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2123b1eb6504dbdb99a6ef323a9118f', 'request_id': 'req-bae6cb44-2d5f-4574-8bd0-2deccb470551'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:19.417058 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bae6cb44-2d5f-4574-8bd0-2deccb470551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2123b1eb6504dbdb99a6ef323a9118f', 'request_id': 'req-bae6cb44-2d5f-4574-8bd0-2deccb470551'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:19.423888 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bae6cb44-2d5f-4574-8bd0-2deccb470551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2123b1eb6504dbdb99a6ef323a9118f', 'request_id': 'req-bae6cb44-2d5f-4574-8bd0-2deccb470551'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:19.436308 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bae6cb44-2d5f-4574-8bd0-2deccb470551 admin admin] The token cache is being invalidate because project c2123b1eb6504dbdb99a6ef323a9118f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:45:19.436592 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bae6cb44-2d5f-4574-8bd0-2deccb470551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:19.437431 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bae6cb44-2d5f-4574-8bd0-2deccb470551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:19.439529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1166/2367] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:45:19 2022] DELETE /identity/v3/projects/c2123b1eb6504dbdb99a6ef323a9118f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:19.444756 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41700b53-3d6f-48b1-ad67-6b023cfa5ab7 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:19.445279 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41700b53-3d6f-48b1-ad67-6b023cfa5ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:19.445433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41700b53-3d6f-48b1-ad67-6b023cfa5ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:19.458852 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:19.465395 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-41700b53-3d6f-48b1-ad67-6b023cfa5ab7 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:19.467389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-41700b53-3d6f-48b1-ad67-6b023cfa5ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:19.530420 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1202/2368] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:19.538233 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8df16-0c46-40c3-8848-694b31b37882 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:19.538511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8df16-0c46-40c3-8848-694b31b37882 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:19.538816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8df16-0c46-40c3-8848-694b31b37882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:19.559217 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-c6e8df16-0c46-40c3-8848-694b31b37882 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:19.560421 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c6e8df16-0c46-40c3-8848-694b31b37882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:19.568696 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1167/2369] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:19.573042 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41700b53-3d6f-48b1-ad67-6b023cfa5ab7 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:19.583030 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41700b53-3d6f-48b1-ad67-6b023cfa5ab7 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:19.589694 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100e76c-e1e5-4201-a705-e83fbf953141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:19.590525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100e76c-e1e5-4201-a705-e83fbf953141 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:19.590920 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100e76c-e1e5-4201-a705-e83fbf953141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:19.591288 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100e76c-e1e5-4201-a705-e83fbf953141 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:19.592114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100e76c-e1e5-4201-a705-e83fbf953141 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:45:19.592420 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100e76c-e1e5-4201-a705-e83fbf953141 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:19.594245 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100e76c-e1e5-4201-a705-e83fbf953141 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:19.620301 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1203/2370] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:45:19.621209 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8df16-0c46-40c3-8848-694b31b37882 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:19.646014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8df16-0c46-40c3-8848-694b31b37882 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:19.651876 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693766e-8bea-4083-b492-afcfa2488c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:19.652591 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693766e-8bea-4083-b492-afcfa2488c94 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:19.652856 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693766e-8bea-4083-b492-afcfa2488c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:19.653129 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693766e-8bea-4083-b492-afcfa2488c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:19.653888 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693766e-8bea-4083-b492-afcfa2488c94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:19.655816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693766e-8bea-4083-b492-afcfa2488c94 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:19.688556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1168/2371] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:45:19 2022] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:45:19.692611 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100e76c-e1e5-4201-a705-e83fbf953141 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:19.710704 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100e76c-e1e5-4201-a705-e83fbf953141 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:19.795362 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61420b13-fab7-489e-9d7d-7fcf6a717039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:19.796170 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61420b13-fab7-489e-9d7d-7fcf6a717039 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:19.796539 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61420b13-fab7-489e-9d7d-7fcf6a717039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:19.796944 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61420b13-fab7-489e-9d7d-7fcf6a717039 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:19.798101 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61420b13-fab7-489e-9d7d-7fcf6a717039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:19.800257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61420b13-fab7-489e-9d7d-7fcf6a717039 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:19.825684 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1204/2372] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:45:19 2022] POST /identity/v3/users => generated 294 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:19.830130 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693766e-8bea-4083-b492-afcfa2488c94 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:19.841531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693766e-8bea-4083-b492-afcfa2488c94 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:19.847307 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c38df1-b671-4e34-a303-0977beafcbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:19.848279 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c38df1-b671-4e34-a303-0977beafcbdd admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:19.848717 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c38df1-b671-4e34-a303-0977beafcbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:19.849150 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c38df1-b671-4e34-a303-0977beafcbdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:19.850045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c38df1-b671-4e34-a303-0977beafcbdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:19.851887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c38df1-b671-4e34-a303-0977beafcbdd admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:19.870852 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1169/2373] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:19.871581 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61420b13-fab7-489e-9d7d-7fcf6a717039 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:19.884169 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61420b13-fab7-489e-9d7d-7fcf6a717039 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:19.894150 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e230f0-c6db-4c45-ad5e-9e1bd28b6547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:19.894150 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e230f0-c6db-4c45-ad5e-9e1bd28b6547 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:19.894150 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e230f0-c6db-4c45-ad5e-9e1bd28b6547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:19.894150 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e230f0-c6db-4c45-ad5e-9e1bd28b6547 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:19.894489 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e230f0-c6db-4c45-ad5e-9e1bd28b6547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:19.894489 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e230f0-c6db-4c45-ad5e-9e1bd28b6547 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:19.906301 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1205/2374] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:45:19.910723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c38df1-b671-4e34-a303-0977beafcbdd admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:19.941025 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c38df1-b671-4e34-a303-0977beafcbdd admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:19.958238 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21344c-ff92-4f96-b52c-e46ccdb215e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:19.959284 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21344c-ff92-4f96-b52c-e46ccdb215e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:19.959629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21344c-ff92-4f96-b52c-e46ccdb215e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:19.966809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21344c-ff92-4f96-b52c-e46ccdb215e2 admin admin] PATH_INFO: `/v3/projects/a57d9f1cb55948fca054617eec12d8b4/users/840252fa0fa3471dbcaeaf5f635862f6/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:19.988919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21344c-ff92-4f96-b52c-e46ccdb215e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a57d9f1cb55948fca054617eec12d8b4, user_id=840252fa0fa3471dbcaeaf5f635862f6, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:19.991920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21344c-ff92-4f96-b52c-e46ccdb215e2 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:20.015006 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1170/2375] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:45:19 2022] PUT /identity/v3/projects/a57d9f1cb55948fca054617eec12d8b4/users/840252fa0fa3471dbcaeaf5f635862f6/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:20.025414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696f5fe-8c66-4ae8-ad4c-82b75867ff46 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:20.025414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696f5fe-8c66-4ae8-ad4c-82b75867ff46 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:20.025802 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696f5fe-8c66-4ae8-ad4c-82b75867ff46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:20.056135 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3696f5fe-8c66-4ae8-ad4c-82b75867ff46 None None] MFA Rules not processed for user `840252fa0fa3471dbcaeaf5f635862f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:20.058563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3696f5fe-8c66-4ae8-ad4c-82b75867ff46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:20.137006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1206/2376] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:45:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:20.142244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21344c-ff92-4f96-b52c-e46ccdb215e2 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:20.230616 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21344c-ff92-4f96-b52c-e46ccdb215e2 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:20.236330 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9f96e-7d1a-4895-b4b2-9d7c2d400f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:20.237011 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9f96e-7d1a-4895-b4b2-9d7c2d400f44 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:20.237337 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9f96e-7d1a-4895-b4b2-9d7c2d400f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:20.237653 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9f96e-7d1a-4895-b4b2-9d7c2d400f44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:20.238366 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9f96e-7d1a-4895-b4b2-9d7c2d400f44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:20.240310 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9f96e-7d1a-4895-b4b2-9d7c2d400f44 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:20.269688 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1171/2377] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:45:20 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:20.275727 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696f5fe-8c66-4ae8-ad4c-82b75867ff46 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:20.284521 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:20.292989 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696f5fe-8c66-4ae8-ad4c-82b75867ff46 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:20.354601 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1acc8-27e8-4b14-93da-e88ac4ea531d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:20.355300 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1acc8-27e8-4b14-93da-e88ac4ea531d admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:20.355578 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1acc8-27e8-4b14-93da-e88ac4ea531d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:20.355860 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1acc8-27e8-4b14-93da-e88ac4ea531d admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:20.356627 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1acc8-27e8-4b14-93da-e88ac4ea531d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:20.358649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1acc8-27e8-4b14-93da-e88ac4ea531d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:20.379472 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1207/2378] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:45:20 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:20.383648 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9f96e-7d1a-4895-b4b2-9d7c2d400f44 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:20.394449 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9f96e-7d1a-4895-b4b2-9d7c2d400f44 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:20.399070 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a2f24-d643-4cc7-9304-3b6032d80ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:20.399747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a2f24-d643-4cc7-9304-3b6032d80ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:20.400029 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a2f24-d643-4cc7-9304-3b6032d80ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:20.400309 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a2f24-d643-4cc7-9304-3b6032d80ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:20.401065 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a2f24-d643-4cc7-9304-3b6032d80ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:20.403040 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a2f24-d643-4cc7-9304-3b6032d80ac1 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:20.414067 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1172/2379] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:20.418200 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1acc8-27e8-4b14-93da-e88ac4ea531d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:20.428648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1acc8-27e8-4b14-93da-e88ac4ea531d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:20.433301 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a75b2-7367-4733-8e6c-a45c92981c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:20.433998 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a75b2-7367-4733-8e6c-a45c92981c8f admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:20.434276 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a75b2-7367-4733-8e6c-a45c92981c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:20.434545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a75b2-7367-4733-8e6c-a45c92981c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:20.435336 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a75b2-7367-4733-8e6c-a45c92981c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:20.436920 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a75b2-7367-4733-8e6c-a45c92981c8f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:20.447728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1208/2380] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:20.451888 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a2f24-d643-4cc7-9304-3b6032d80ac1 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:20.462471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a2f24-d643-4cc7-9304-3b6032d80ac1 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:20.467569 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb436c5e-7987-472e-af1d-a53aea2888d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:20.468592 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb436c5e-7987-472e-af1d-a53aea2888d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:20.468874 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb436c5e-7987-472e-af1d-a53aea2888d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:20.469176 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb436c5e-7987-472e-af1d-a53aea2888d7 admin admin] PATH_INFO: `/v3/projects/b80ea732047b46819a2fdfa22e889fc7/users/def5c1f90d934846be581f867bafaa2d/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:20.471827 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:20.488556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb436c5e-7987-472e-af1d-a53aea2888d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b80ea732047b46819a2fdfa22e889fc7, user_id=def5c1f90d934846be581f867bafaa2d, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:20.492820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb436c5e-7987-472e-af1d-a53aea2888d7 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:20.512624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1173/2381] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:45:20 2022] PUT /identity/v3/projects/b80ea732047b46819a2fdfa22e889fc7/users/def5c1f90d934846be581f867bafaa2d/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:20.524642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b2b6c-4114-431e-b367-117aa781ab47 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:20.524924 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b2b6c-4114-431e-b367-117aa781ab47 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:20.525190 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b2b6c-4114-431e-b367-117aa781ab47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:20.553601 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a93b2b6c-4114-431e-b367-117aa781ab47 None None] MFA Rules not processed for user `def5c1f90d934846be581f867bafaa2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:20.554863 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a93b2b6c-4114-431e-b367-117aa781ab47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:20.621229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1209/2382] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:45:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:20.626720 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb436c5e-7987-472e-af1d-a53aea2888d7 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:20.697464 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb436c5e-7987-472e-af1d-a53aea2888d7 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:20.703034 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a58f7d-1a03-4982-8d8c-e71ceee9fc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:20.703841 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a58f7d-1a03-4982-8d8c-e71ceee9fc6d admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:20.704121 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a58f7d-1a03-4982-8d8c-e71ceee9fc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:20.704393 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a58f7d-1a03-4982-8d8c-e71ceee9fc6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:20.705056 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a58f7d-1a03-4982-8d8c-e71ceee9fc6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:20.706977 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a58f7d-1a03-4982-8d8c-e71ceee9fc6d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:20.732337 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1174/2383] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:45:20 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:45:20.737390 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b2b6c-4114-431e-b367-117aa781ab47 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:20.751724 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b2b6c-4114-431e-b367-117aa781ab47 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:20.813865 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040bb30-df9f-4bcc-b6f0-182de00f8a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:20.814549 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040bb30-df9f-4bcc-b6f0-182de00f8a4e admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:20.814881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040bb30-df9f-4bcc-b6f0-182de00f8a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:20.815142 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040bb30-df9f-4bcc-b6f0-182de00f8a4e admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:20.815840 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040bb30-df9f-4bcc-b6f0-182de00f8a4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:20.817758 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040bb30-df9f-4bcc-b6f0-182de00f8a4e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:20.835803 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:20.841937 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1210/2384] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:45:20 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:45:20.845826 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a58f7d-1a03-4982-8d8c-e71ceee9fc6d admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:20.856037 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a58f7d-1a03-4982-8d8c-e71ceee9fc6d admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:20.861415 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7fb1a-b2a7-43f4-8455-d638b60271cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:20.862072 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7fb1a-b2a7-43f4-8455-d638b60271cd admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:20.862349 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7fb1a-b2a7-43f4-8455-d638b60271cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:20.862649 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7fb1a-b2a7-43f4-8455-d638b60271cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:20.863397 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7fb1a-b2a7-43f4-8455-d638b60271cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:20.864977 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7fb1a-b2a7-43f4-8455-d638b60271cd admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:20.876380 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1175/2385] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:45:20.880696 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040bb30-df9f-4bcc-b6f0-182de00f8a4e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:20.894406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040bb30-df9f-4bcc-b6f0-182de00f8a4e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:20.902320 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b727bf-cecb-4d0d-9ed9-e2e12101de1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:20.903271 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b727bf-cecb-4d0d-9ed9-e2e12101de1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:20.903545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b727bf-cecb-4d0d-9ed9-e2e12101de1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:20.903815 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b727bf-cecb-4d0d-9ed9-e2e12101de1f admin admin] PATH_INFO: `/v3/projects/f299939616de4b32bf51b1417fe09b54/users/4cebba7853794115919d739a1955ec30/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:20.919091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b727bf-cecb-4d0d-9ed9-e2e12101de1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f299939616de4b32bf51b1417fe09b54, user_id=4cebba7853794115919d739a1955ec30, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:20.921708 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b727bf-cecb-4d0d-9ed9-e2e12101de1f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:20.937452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1211/2386] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:45:20 2022] PUT /identity/v3/projects/f299939616de4b32bf51b1417fe09b54/users/4cebba7853794115919d739a1955ec30/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:20.941777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7fb1a-b2a7-43f4-8455-d638b60271cd admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:20.952463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7fb1a-b2a7-43f4-8455-d638b60271cd admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:20.957809 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b727bf-cecb-4d0d-9ed9-e2e12101de1f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:20.962101 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-17b727bf-cecb-4d0d-9ed9-e2e12101de1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:21.018526 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d94055-95f8-4d4e-ad7f-28ffc2f9c81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:21.019334 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d94055-95f8-4d4e-ad7f-28ffc2f9c81d admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:21.019610 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d94055-95f8-4d4e-ad7f-28ffc2f9c81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:21.019880 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d94055-95f8-4d4e-ad7f-28ffc2f9c81d admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:21.020604 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d94055-95f8-4d4e-ad7f-28ffc2f9c81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:21.022226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d94055-95f8-4d4e-ad7f-28ffc2f9c81d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:21.036596 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1176/2387] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:21.037617 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d94055-95f8-4d4e-ad7f-28ffc2f9c81d admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:21.047401 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b727bf-cecb-4d0d-9ed9-e2e12101de1f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:21.048984 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d94055-95f8-4d4e-ad7f-28ffc2f9c81d admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:21.053128 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1a2c4-24ea-4093-9f85-0e84451bd64d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:21.053784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1a2c4-24ea-4093-9f85-0e84451bd64d service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:21.054033 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1210a-52b9-4da6-8f7e-fd4dca18ae57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:21.054156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1a2c4-24ea-4093-9f85-0e84451bd64d service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:21.054325 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1a2c4-24ea-4093-9f85-0e84451bd64d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:21.055067 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1210a-52b9-4da6-8f7e-fd4dca18ae57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:21.055412 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1210a-52b9-4da6-8f7e-fd4dca18ae57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:21.055745 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1210a-52b9-4da6-8f7e-fd4dca18ae57 admin admin] PATH_INFO: `/v3/projects/f299939616de4b32bf51b1417fe09b54/users/4cebba7853794115919d739a1955ec30/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:21.056272 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-efc1a2c4-24ea-4093-9f85-0e84451bd64d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:21.057942 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1210a-52b9-4da6-8f7e-fd4dca18ae57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f299939616de4b32bf51b1417fe09b54, user_id=4cebba7853794115919d739a1955ec30, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:21.060702 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1210a-52b9-4da6-8f7e-fd4dca18ae57 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:21.073281 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1177/2388] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:45:21 2022] PUT /identity/v3/projects/f299939616de4b32bf51b1417fe09b54/users/4cebba7853794115919d739a1955ec30/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:21.083238 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642d83c-d024-4e08-9620-afc74bdf2dab None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:21.083542 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642d83c-d024-4e08-9620-afc74bdf2dab None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:21.083796 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642d83c-d024-4e08-9620-afc74bdf2dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:21.123060 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1a2c4-24ea-4093-9f85-0e84451bd64d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:21.125477 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1a2c4-24ea-4093-9f85-0e84451bd64d service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:21.128639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-c642d83c-d024-4e08-9620-afc74bdf2dab None None] MFA Rules not processed for user `4cebba7853794115919d739a1955ec30`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:21.129943 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c642d83c-d024-4e08-9620-afc74bdf2dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:21.138381 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1212/2389] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:21.174238 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:21.218750 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1178/2390] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:45:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:45:21.230618 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1a2c4-24ea-4093-9f85-0e84451bd64d service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:21.232062 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-efc1a2c4-24ea-4093-9f85-0e84451bd64d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:21.294249 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1a2c4-24ea-4093-9f85-0e84451bd64d service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:21.326115 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:21.356630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cae249-3b31-4acc-a954-203f3c258ca5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:21.358260 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cae249-3b31-4acc-a954-203f3c258ca5 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:21.358748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cae249-3b31-4acc-a954-203f3c258ca5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:21.358949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cae249-3b31-4acc-a954-203f3c258ca5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:21.374893 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cae249-3b31-4acc-a954-203f3c258ca5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:21.376481 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cae249-3b31-4acc-a954-203f3c258ca5 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:21.390514 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1213/2391] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:21.958982 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642d83c-d024-4e08-9620-afc74bdf2dab None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:21.960550 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c642d83c-d024-4e08-9620-afc74bdf2dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:22.015413 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cae249-3b31-4acc-a954-203f3c258ca5 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:22.017621 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a7cae249-3b31-4acc-a954-203f3c258ca5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:22.029237 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cae249-3b31-4acc-a954-203f3c258ca5 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:22.033264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dcceb-5950-4cfa-9ec1-9951afc1c2d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:22.033936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dcceb-5950-4cfa-9ec1-9951afc1c2d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:22.034216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dcceb-5950-4cfa-9ec1-9951afc1c2d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:22.034486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dcceb-5950-4cfa-9ec1-9951afc1c2d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:22.102870 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dcceb-5950-4cfa-9ec1-9951afc1c2d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:22.104362 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dcceb-5950-4cfa-9ec1-9951afc1c2d9 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:22.115748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1214/2392] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:45:22.164595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642d83c-d024-4e08-9620-afc74bdf2dab None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:22.168286 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa95aa-2d24-49f4-89b5-ace319b7af14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:22.168940 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa95aa-2d24-49f4-89b5-ace319b7af14 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:22.169219 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa95aa-2d24-49f4-89b5-ace319b7af14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:22.169489 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa95aa-2d24-49f4-89b5-ace319b7af14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:22.171547 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e5fa95aa-2d24-49f4-89b5-ace319b7af14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:22.239067 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa95aa-2d24-49f4-89b5-ace319b7af14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:22.240493 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa95aa-2d24-49f4-89b5-ace319b7af14 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:22.250442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1179/2393] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:24.090565 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dcceb-5950-4cfa-9ec1-9951afc1c2d9 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:24.092381 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e93dcceb-5950-4cfa-9ec1-9951afc1c2d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:24.193625 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dcceb-5950-4cfa-9ec1-9951afc1c2d9 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:24.200438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819a652-7830-40fb-ab41-b6d54ffe114f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:24.200825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819a652-7830-40fb-ab41-b6d54ffe114f service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:24.201175 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819a652-7830-40fb-ab41-b6d54ffe114f service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:24.201525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819a652-7830-40fb-ab41-b6d54ffe114f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:24.205509 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8819a652-7830-40fb-ab41-b6d54ffe114f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:24.222281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819a652-7830-40fb-ab41-b6d54ffe114f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:24.224382 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819a652-7830-40fb-ab41-b6d54ffe114f service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:24.237236 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1215/2394] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:26.349810 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa95aa-2d24-49f4-89b5-ace319b7af14 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:26.359230 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa95aa-2d24-49f4-89b5-ace319b7af14 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:26.363989 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cd198-2c68-4f18-97d4-ed4215a7472e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:26.364793 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cd198-2c68-4f18-97d4-ed4215a7472e service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:26.365074 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cd198-2c68-4f18-97d4-ed4215a7472e service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:26.365376 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cd198-2c68-4f18-97d4-ed4215a7472e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:26.428875 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741cd198-2c68-4f18-97d4-ed4215a7472e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:26.430305 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741cd198-2c68-4f18-97d4-ed4215a7472e service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:26.439615 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1180/2395] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:28.594800 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819a652-7830-40fb-ab41-b6d54ffe114f service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:28.662283 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:28.671553 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819a652-7830-40fb-ab41-b6d54ffe114f service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:28.677104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0bfe1-cc91-4efb-8519-d19a1b1d23f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:28.677985 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0bfe1-cc91-4efb-8519-d19a1b1d23f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:28.678394 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0bfe1-cc91-4efb-8519-d19a1b1d23f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:28.678710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0bfe1-cc91-4efb-8519-d19a1b1d23f7 admin admin] PATH_INFO: `/v3/users/840252fa0fa3471dbcaeaf5f635862f6` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:28.680878 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0bfe1-cc91-4efb-8519-d19a1b1d23f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=840252fa0fa3471dbcaeaf5f635862f6)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:28.682587 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0bfe1-cc91-4efb-8519-d19a1b1d23f7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:28.737488 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b2d0bfe1-cc91-4efb-8519-d19a1b1d23f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '840252fa0fa3471dbcaeaf5f635862f6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:28.745575 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b2d0bfe1-cc91-4efb-8519-d19a1b1d23f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '840252fa0fa3471dbcaeaf5f635862f6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:28.746248 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b2d0bfe1-cc91-4efb-8519-d19a1b1d23f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '840252fa0fa3471dbcaeaf5f635862f6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:28.759917 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b2d0bfe1-cc91-4efb-8519-d19a1b1d23f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '840252fa0fa3471dbcaeaf5f635862f6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:28.760679 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b2d0bfe1-cc91-4efb-8519-d19a1b1d23f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '840252fa0fa3471dbcaeaf5f635862f6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:28.775954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1216/2396] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:45:28 2022] DELETE /identity/v3/users/840252fa0fa3471dbcaeaf5f635862f6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:45:28.780517 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37eabf-4981-41a6-9daa-325c3e2ada4d None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:28.781013 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37eabf-4981-41a6-9daa-325c3e2ada4d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:28.781110 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37eabf-4981-41a6-9daa-325c3e2ada4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:28.799232 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-fe37eabf-4981-41a6-9daa-325c3e2ada4d None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:28.801138 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-fe37eabf-4981-41a6-9daa-325c3e2ada4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:28.812681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:28.846042 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4cd8d-3eac-484b-907d-a2638178f27e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:28.846348 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4cd8d-3eac-484b-907d-a2638178f27e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:28.846629 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4cd8d-3eac-484b-907d-a2638178f27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:28.870072 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c8f4cd8d-3eac-484b-907d-a2638178f27e None None] MFA Rules not processed for user `cbf7d6db675047cbb3a3f16631c59622`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:28.871333 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c8f4cd8d-3eac-484b-907d-a2638178f27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:28.875987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1181/2397] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:28.886831 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37eabf-4981-41a6-9daa-325c3e2ada4d None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:28.888643 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-fe37eabf-4981-41a6-9daa-325c3e2ada4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:28.938668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1217/2398] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 13:45:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:45:28.963213 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37eabf-4981-41a6-9daa-325c3e2ada4d None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:28.968128 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45ed24-484c-46ce-99df-ac325d8cbe23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:28.969152 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45ed24-484c-46ce-99df-ac325d8cbe23 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:28.969272 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45ed24-484c-46ce-99df-ac325d8cbe23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:28.969567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45ed24-484c-46ce-99df-ac325d8cbe23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:28.990806 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45ed24-484c-46ce-99df-ac325d8cbe23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:28.992396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45ed24-484c-46ce-99df-ac325d8cbe23 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:29.003267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1182/2399] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:45:29.018101 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4cd8d-3eac-484b-907d-a2638178f27e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:29.019636 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c8f4cd8d-3eac-484b-907d-a2638178f27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:29.094292 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4cd8d-3eac-484b-907d-a2638178f27e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:29.100476 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a483476-d200-407c-aa2d-5398123bc4da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd0e37b0404419bb5752228bd809be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:29.101137 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a483476-d200-407c-aa2d-5398123bc4da service swift] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:29.101414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a483476-d200-407c-aa2d-5398123bc4da service swift] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:29.101682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a483476-d200-407c-aa2d-5398123bc4da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:29.111637 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a483476-d200-407c-aa2d-5398123bc4da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:29.113320 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a483476-d200-407c-aa2d-5398123bc4da service swift] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:29.122163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1218/2400] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 13:45:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:45:29.327176 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45ed24-484c-46ce-99df-ac325d8cbe23 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:29.329357 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6d45ed24-484c-46ce-99df-ac325d8cbe23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:29.352152 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45ed24-484c-46ce-99df-ac325d8cbe23 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:29.357289 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addbac8-9b23-4840-91c8-76d4ea7dd5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:29.358277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addbac8-9b23-4840-91c8-76d4ea7dd5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:29.358835 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addbac8-9b23-4840-91c8-76d4ea7dd5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:29.359234 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addbac8-9b23-4840-91c8-76d4ea7dd5e3 admin admin] PATH_INFO: `/v3/projects/a57d9f1cb55948fca054617eec12d8b4` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:29.361003 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addbac8-9b23-4840-91c8-76d4ea7dd5e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a57d9f1cb55948fca054617eec12d8b4)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:29.363036 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addbac8-9b23-4840-91c8-76d4ea7dd5e3 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:29.430121 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5addbac8-9b23-4840-91c8-76d4ea7dd5e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a57d9f1cb55948fca054617eec12d8b4', 'request_id': 'req-5addbac8-9b23-4840-91c8-76d4ea7dd5e3'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:29.437664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5addbac8-9b23-4840-91c8-76d4ea7dd5e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a57d9f1cb55948fca054617eec12d8b4', 'request_id': 'req-5addbac8-9b23-4840-91c8-76d4ea7dd5e3'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:29.448093 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5addbac8-9b23-4840-91c8-76d4ea7dd5e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a57d9f1cb55948fca054617eec12d8b4', 'request_id': 'req-5addbac8-9b23-4840-91c8-76d4ea7dd5e3'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:29.463808 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5addbac8-9b23-4840-91c8-76d4ea7dd5e3 admin admin] The token cache is being invalidate because project a57d9f1cb55948fca054617eec12d8b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:45:29.464621 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5addbac8-9b23-4840-91c8-76d4ea7dd5e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:29.465270 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5addbac8-9b23-4840-91c8-76d4ea7dd5e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:29.470438 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1183/2401] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:45:29 2022] DELETE /identity/v3/projects/a57d9f1cb55948fca054617eec12d8b4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:29.472341 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a483476-d200-407c-aa2d-5398123bc4da service swift] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:29.483077 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a483476-d200-407c-aa2d-5398123bc4da service swift] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:29.490829 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:29.572364 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0fb73-25d7-4bb9-9ff7-315229f6126e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:29.573824 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0fb73-25d7-4bb9-9ff7-315229f6126e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:29.574376 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0fb73-25d7-4bb9-9ff7-315229f6126e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:29.574904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0fb73-25d7-4bb9-9ff7-315229f6126e admin admin] PATH_INFO: `/v3/users/def5c1f90d934846be581f867bafaa2d` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:29.576959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0fb73-25d7-4bb9-9ff7-315229f6126e admin admin] RBAC: Authorizing `identity:delete_user(user_id=def5c1f90d934846be581f867bafaa2d)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:29.580337 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0fb73-25d7-4bb9-9ff7-315229f6126e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:29.655143 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a2b0fb73-25d7-4bb9-9ff7-315229f6126e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'def5c1f90d934846be581f867bafaa2d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:29.666521 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a2b0fb73-25d7-4bb9-9ff7-315229f6126e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'def5c1f90d934846be581f867bafaa2d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:29.667158 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a2b0fb73-25d7-4bb9-9ff7-315229f6126e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'def5c1f90d934846be581f867bafaa2d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:29.685621 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a2b0fb73-25d7-4bb9-9ff7-315229f6126e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'def5c1f90d934846be581f867bafaa2d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:29.686986 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a2b0fb73-25d7-4bb9-9ff7-315229f6126e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'def5c1f90d934846be581f867bafaa2d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:29.705058 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1219/2402] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:45:29 2022] DELETE /identity/v3/users/def5c1f90d934846be581f867bafaa2d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:30.091833 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addbac8-9b23-4840-91c8-76d4ea7dd5e3 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:30.093701 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5addbac8-9b23-4840-91c8-76d4ea7dd5e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:30.120262 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addbac8-9b23-4840-91c8-76d4ea7dd5e3 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:30.185235 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:30.212647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d384eb0-095c-4f1d-9bae-7be8b52d8672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:30.213547 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d384eb0-095c-4f1d-9bae-7be8b52d8672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:30.213967 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d384eb0-095c-4f1d-9bae-7be8b52d8672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:30.214244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d384eb0-095c-4f1d-9bae-7be8b52d8672 admin admin] PATH_INFO: `/v3/projects/b80ea732047b46819a2fdfa22e889fc7` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:30.215585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d384eb0-095c-4f1d-9bae-7be8b52d8672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b80ea732047b46819a2fdfa22e889fc7)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:30.218261 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d384eb0-095c-4f1d-9bae-7be8b52d8672 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:30.305450 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5d384eb0-095c-4f1d-9bae-7be8b52d8672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b80ea732047b46819a2fdfa22e889fc7', 'request_id': 'req-5d384eb0-095c-4f1d-9bae-7be8b52d8672'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:30.326502 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5d384eb0-095c-4f1d-9bae-7be8b52d8672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b80ea732047b46819a2fdfa22e889fc7', 'request_id': 'req-5d384eb0-095c-4f1d-9bae-7be8b52d8672'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:30.335480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5d384eb0-095c-4f1d-9bae-7be8b52d8672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b80ea732047b46819a2fdfa22e889fc7', 'request_id': 'req-5d384eb0-095c-4f1d-9bae-7be8b52d8672'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:30.351092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5d384eb0-095c-4f1d-9bae-7be8b52d8672 admin admin] The token cache is being invalidate because project b80ea732047b46819a2fdfa22e889fc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:45:30.351477 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5d384eb0-095c-4f1d-9bae-7be8b52d8672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:30.352174 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5d384eb0-095c-4f1d-9bae-7be8b52d8672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:30.354189 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1184/2403] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:45:30 2022] DELETE /identity/v3/projects/b80ea732047b46819a2fdfa22e889fc7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:30.358130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0fb73-25d7-4bb9-9ff7-315229f6126e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:30.359787 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a2b0fb73-25d7-4bb9-9ff7-315229f6126e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:30.374872 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0fb73-25d7-4bb9-9ff7-315229f6126e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:30.443188 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f384e8d-75fc-4446-89e1-3fb8f835c7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:30.444152 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f384e8d-75fc-4446-89e1-3fb8f835c7c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:30.444430 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f384e8d-75fc-4446-89e1-3fb8f835c7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:30.444702 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f384e8d-75fc-4446-89e1-3fb8f835c7c3 admin admin] PATH_INFO: `/v3/users/4cebba7853794115919d739a1955ec30` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:30.445880 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f384e8d-75fc-4446-89e1-3fb8f835c7c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cebba7853794115919d739a1955ec30)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:30.447817 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f384e8d-75fc-4446-89e1-3fb8f835c7c3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:30.488810 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:30.506869 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6f384e8d-75fc-4446-89e1-3fb8f835c7c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cebba7853794115919d739a1955ec30'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:30.519008 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6f384e8d-75fc-4446-89e1-3fb8f835c7c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cebba7853794115919d739a1955ec30'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:30.519643 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6f384e8d-75fc-4446-89e1-3fb8f835c7c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cebba7853794115919d739a1955ec30'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:30.536912 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6f384e8d-75fc-4446-89e1-3fb8f835c7c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cebba7853794115919d739a1955ec30'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:30.537797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6f384e8d-75fc-4446-89e1-3fb8f835c7c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cebba7853794115919d739a1955ec30'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:30.554773 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1220/2404] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:45:30 2022] DELETE /identity/v3/users/4cebba7853794115919d739a1955ec30 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:30.902944 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d384eb0-095c-4f1d-9bae-7be8b52d8672 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:30.904465 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5d384eb0-095c-4f1d-9bae-7be8b52d8672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:30.921729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d384eb0-095c-4f1d-9bae-7be8b52d8672 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:31.002729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fd6c9-8648-4a1c-95df-5e71bf726ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:31.003563 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fd6c9-8648-4a1c-95df-5e71bf726ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:31.003906 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fd6c9-8648-4a1c-95df-5e71bf726ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:31.004243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fd6c9-8648-4a1c-95df-5e71bf726ecf admin admin] PATH_INFO: `/v3/projects/f299939616de4b32bf51b1417fe09b54` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:31.005536 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478fd6c9-8648-4a1c-95df-5e71bf726ecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f299939616de4b32bf51b1417fe09b54)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:31.008151 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478fd6c9-8648-4a1c-95df-5e71bf726ecf admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:31.065442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-478fd6c9-8648-4a1c-95df-5e71bf726ecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f299939616de4b32bf51b1417fe09b54', 'request_id': 'req-478fd6c9-8648-4a1c-95df-5e71bf726ecf'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:31.074559 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-478fd6c9-8648-4a1c-95df-5e71bf726ecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f299939616de4b32bf51b1417fe09b54', 'request_id': 'req-478fd6c9-8648-4a1c-95df-5e71bf726ecf'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:31.081360 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-478fd6c9-8648-4a1c-95df-5e71bf726ecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f299939616de4b32bf51b1417fe09b54', 'request_id': 'req-478fd6c9-8648-4a1c-95df-5e71bf726ecf'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:31.096740 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:31.100677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-478fd6c9-8648-4a1c-95df-5e71bf726ecf admin admin] The token cache is being invalidate because project f299939616de4b32bf51b1417fe09b54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:45:31.101618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-478fd6c9-8648-4a1c-95df-5e71bf726ecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:31.103035 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-478fd6c9-8648-4a1c-95df-5e71bf726ecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:31.106653 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1185/2405] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:45:30 2022] DELETE /identity/v3/projects/f299939616de4b32bf51b1417fe09b54 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:31.110940 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0507b1d-2c0b-4e18-9eb3-9109066a4a8b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:31.111424 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0507b1d-2c0b-4e18-9eb3-9109066a4a8b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:31.111573 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0507b1d-2c0b-4e18-9eb3-9109066a4a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:31.133072 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f0507b1d-2c0b-4e18-9eb3-9109066a4a8b None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:31.134445 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f0507b1d-2c0b-4e18-9eb3-9109066a4a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:31.231769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1221/2406] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:31.241957 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832842a-e6d9-4efb-a196-5fdbb958049a None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:31.242429 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832842a-e6d9-4efb-a196-5fdbb958049a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:31.243045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832842a-e6d9-4efb-a196-5fdbb958049a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:31.271748 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-f832842a-e6d9-4efb-a196-5fdbb958049a None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:31.273764 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f832842a-e6d9-4efb-a196-5fdbb958049a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:31.293553 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0507b1d-2c0b-4e18-9eb3-9109066a4a8b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:31.296125 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1186/2407] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:31.309370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0507b1d-2c0b-4e18-9eb3-9109066a4a8b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:31.315035 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c72420-1cbc-4335-b6b0-169c5caae103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:31.315851 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c72420-1cbc-4335-b6b0-169c5caae103 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:31.316136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c72420-1cbc-4335-b6b0-169c5caae103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:31.316523 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c72420-1cbc-4335-b6b0-169c5caae103 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:31.317396 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c72420-1cbc-4335-b6b0-169c5caae103 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:45:31.317855 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c72420-1cbc-4335-b6b0-169c5caae103 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:31.319915 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c72420-1cbc-4335-b6b0-169c5caae103 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:31.336663 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1222/2408] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:45:31.342496 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832842a-e6d9-4efb-a196-5fdbb958049a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:31.362124 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832842a-e6d9-4efb-a196-5fdbb958049a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:31.375605 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863bc92-4906-4391-94f8-9c93c30e4f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:31.376356 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863bc92-4906-4391-94f8-9c93c30e4f93 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:31.376639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863bc92-4906-4391-94f8-9c93c30e4f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:31.376913 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863bc92-4906-4391-94f8-9c93c30e4f93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:31.377617 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863bc92-4906-4391-94f8-9c93c30e4f93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:31.379696 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863bc92-4906-4391-94f8-9c93c30e4f93 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:31.418623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1187/2409] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:45:31 2022] POST /identity/v3/projects => generated 365 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:45:31.422200 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c72420-1cbc-4335-b6b0-169c5caae103 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:31.434209 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c72420-1cbc-4335-b6b0-169c5caae103 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:31.547638 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62f028-3b0a-4062-a233-df4d6399f367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:31.547638 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62f028-3b0a-4062-a233-df4d6399f367 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:31.548711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62f028-3b0a-4062-a233-df4d6399f367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:31.549031 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62f028-3b0a-4062-a233-df4d6399f367 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:31.549863 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62f028-3b0a-4062-a233-df4d6399f367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:31.553192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62f028-3b0a-4062-a233-df4d6399f367 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:31.594254 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1223/2410] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:45:31 2022] POST /identity/v3/users => generated 283 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:31.595910 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863bc92-4906-4391-94f8-9c93c30e4f93 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:31.609047 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863bc92-4906-4391-94f8-9c93c30e4f93 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:31.646240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026997e-4057-4fc4-9513-611cd76706b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:31.646996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026997e-4057-4fc4-9513-611cd76706b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:31.647277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026997e-4057-4fc4-9513-611cd76706b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:31.647700 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026997e-4057-4fc4-9513-611cd76706b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:31.648655 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026997e-4057-4fc4-9513-611cd76706b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:31.650345 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026997e-4057-4fc4-9513-611cd76706b9 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:31.664856 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1188/2411] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:31.668696 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62f028-3b0a-4062-a233-df4d6399f367 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:31.682124 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62f028-3b0a-4062-a233-df4d6399f367 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:31.687129 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fde76-feb6-4786-8bfb-239e7a21cc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:31.687842 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fde76-feb6-4786-8bfb-239e7a21cc56 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:31.688130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fde76-feb6-4786-8bfb-239e7a21cc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:31.688522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fde76-feb6-4786-8bfb-239e7a21cc56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:31.689246 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fde76-feb6-4786-8bfb-239e7a21cc56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:31.691837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fde76-feb6-4786-8bfb-239e7a21cc56 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:31.704070 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1224/2412] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:45:31.708445 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026997e-4057-4fc4-9513-611cd76706b9 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:31.720839 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026997e-4057-4fc4-9513-611cd76706b9 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:31.727360 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdae684-7678-4fb8-8e88-caf4f1cc2f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:31.728293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdae684-7678-4fb8-8e88-caf4f1cc2f49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:31.728639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdae684-7678-4fb8-8e88-caf4f1cc2f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:31.728998 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdae684-7678-4fb8-8e88-caf4f1cc2f49 admin admin] PATH_INFO: `/v3/projects/cbd727ae9d2b4bdb8ae21a6a15d2f10d/users/8233c252eb7a4352a71ee3bffc49e5b0/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:31.748732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdae684-7678-4fb8-8e88-caf4f1cc2f49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbd727ae9d2b4bdb8ae21a6a15d2f10d, user_id=8233c252eb7a4352a71ee3bffc49e5b0, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:31.752117 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdae684-7678-4fb8-8e88-caf4f1cc2f49 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:31.772346 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1189/2413] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:45:31 2022] PUT /identity/v3/projects/cbd727ae9d2b4bdb8ae21a6a15d2f10d/users/8233c252eb7a4352a71ee3bffc49e5b0/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:45:31.785728 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fa4d4-17a9-47c1-9129-289c47f63c38 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:31.785936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fa4d4-17a9-47c1-9129-289c47f63c38 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:31.786193 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fa4d4-17a9-47c1-9129-289c47f63c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:31.816062 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:31.820135 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6c2fa4d4-17a9-47c1-9129-289c47f63c38 None None] MFA Rules not processed for user `8233c252eb7a4352a71ee3bffc49e5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:31.821637 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6c2fa4d4-17a9-47c1-9129-289c47f63c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:31.906502 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1225/2414] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:45:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:31.910641 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdae684-7678-4fb8-8e88-caf4f1cc2f49 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:31.980234 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdae684-7678-4fb8-8e88-caf4f1cc2f49 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:31.985007 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19774d-3255-4b5b-9349-807697aff277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:31.985813 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19774d-3255-4b5b-9349-807697aff277 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:31.986101 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19774d-3255-4b5b-9349-807697aff277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:31.986375 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19774d-3255-4b5b-9349-807697aff277 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:31.987099 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19774d-3255-4b5b-9349-807697aff277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:31.989003 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19774d-3255-4b5b-9349-807697aff277 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:32.021535 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1190/2415] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:45:31 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:45:32.025645 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fa4d4-17a9-47c1-9129-289c47f63c38 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:32.039279 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fa4d4-17a9-47c1-9129-289c47f63c38 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:32.109466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba7511-c74f-4674-8d0e-2bc2071b66b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:32.110170 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba7511-c74f-4674-8d0e-2bc2071b66b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:32.110457 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba7511-c74f-4674-8d0e-2bc2071b66b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:32.110920 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba7511-c74f-4674-8d0e-2bc2071b66b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:32.111541 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba7511-c74f-4674-8d0e-2bc2071b66b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:32.113532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba7511-c74f-4674-8d0e-2bc2071b66b6 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:32.136433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1226/2416] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:45:32 2022] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:45:32.143127 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19774d-3255-4b5b-9349-807697aff277 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:32.156117 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19774d-3255-4b5b-9349-807697aff277 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:32.162336 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4414cd7-6eb0-4001-a456-f3da25da868f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:32.163079 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4414cd7-6eb0-4001-a456-f3da25da868f admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:32.163358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4414cd7-6eb0-4001-a456-f3da25da868f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:32.163625 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4414cd7-6eb0-4001-a456-f3da25da868f admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:32.164363 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4414cd7-6eb0-4001-a456-f3da25da868f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:32.166021 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4414cd7-6eb0-4001-a456-f3da25da868f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:32.178793 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1191/2417] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:45:32.183230 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba7511-c74f-4674-8d0e-2bc2071b66b6 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:32.193737 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba7511-c74f-4674-8d0e-2bc2071b66b6 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:32.198332 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5dfb7-b100-4de6-85ba-8e7fa8c56fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:32.199258 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5dfb7-b100-4de6-85ba-8e7fa8c56fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:32.199539 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5dfb7-b100-4de6-85ba-8e7fa8c56fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:32.199809 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5dfb7-b100-4de6-85ba-8e7fa8c56fd2 admin admin] PATH_INFO: `/v3/projects/4b27ae4d8caa4b9d843f5f7ae7c62be8/users/24ff878c89304454b460f0fdeaf55e5e/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:32.225710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5dfb7-b100-4de6-85ba-8e7fa8c56fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b27ae4d8caa4b9d843f5f7ae7c62be8, user_id=24ff878c89304454b460f0fdeaf55e5e, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:32.230943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5dfb7-b100-4de6-85ba-8e7fa8c56fd2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:32.272556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1227/2418] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:45:32 2022] PUT /identity/v3/projects/4b27ae4d8caa4b9d843f5f7ae7c62be8/users/24ff878c89304454b460f0fdeaf55e5e/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:32.276763 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4414cd7-6eb0-4001-a456-f3da25da868f admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:32.287755 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4414cd7-6eb0-4001-a456-f3da25da868f admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:32.353301 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69f744-39f6-46f7-a0b6-29170886632a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:32.354117 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69f744-39f6-46f7-a0b6-29170886632a admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:32.354470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69f744-39f6-46f7-a0b6-29170886632a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:32.354832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69f744-39f6-46f7-a0b6-29170886632a admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:32.355770 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69f744-39f6-46f7-a0b6-29170886632a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:32.357553 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69f744-39f6-46f7-a0b6-29170886632a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:32.372570 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1192/2419] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:32.378263 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5dfb7-b100-4de6-85ba-8e7fa8c56fd2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:32.393316 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5dfb7-b100-4de6-85ba-8e7fa8c56fd2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:32.399052 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c81d7-b121-453f-b6eb-f1f138ea1c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:32.400345 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c81d7-b121-453f-b6eb-f1f138ea1c8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:32.400723 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c81d7-b121-453f-b6eb-f1f138ea1c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:32.401088 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c81d7-b121-453f-b6eb-f1f138ea1c8b admin admin] PATH_INFO: `/v3/projects/4b27ae4d8caa4b9d843f5f7ae7c62be8/users/24ff878c89304454b460f0fdeaf55e5e/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:32.414784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c81d7-b121-453f-b6eb-f1f138ea1c8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b27ae4d8caa4b9d843f5f7ae7c62be8, user_id=24ff878c89304454b460f0fdeaf55e5e, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:32.417507 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c81d7-b121-453f-b6eb-f1f138ea1c8b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:32.433769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1228/2420] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:45:32 2022] PUT /identity/v3/projects/4b27ae4d8caa4b9d843f5f7ae7c62be8/users/24ff878c89304454b460f0fdeaf55e5e/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:45:32.445138 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92894d1-f5db-42b4-a8a2-999b7f06d838 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:32.445450 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92894d1-f5db-42b4-a8a2-999b7f06d838 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:32.445731 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92894d1-f5db-42b4-a8a2-999b7f06d838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:32.459064 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:32.487398 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-a92894d1-f5db-42b4-a8a2-999b7f06d838 None None] MFA Rules not processed for user `24ff878c89304454b460f0fdeaf55e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:32.488607 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a92894d1-f5db-42b4-a8a2-999b7f06d838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:32.599840 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1193/2421] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:45:32 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:32.613683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c81d7-b121-453f-b6eb-f1f138ea1c8b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:32.615489 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-560c81d7-b121-453f-b6eb-f1f138ea1c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:32.738162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c81d7-b121-453f-b6eb-f1f138ea1c8b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:32.743521 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bd67a-9472-406d-af39-8989fab73743 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:32.744813 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bd67a-9472-406d-af39-8989fab73743 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:32.745101 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bd67a-9472-406d-af39-8989fab73743 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:32.745374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bd67a-9472-406d-af39-8989fab73743 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:32.770005 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bd67a-9472-406d-af39-8989fab73743 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:32.776602 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bd67a-9472-406d-af39-8989fab73743 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:32.792086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:32.806774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1229/2422] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:32 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:32.924621 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92894d1-f5db-42b4-a8a2-999b7f06d838 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:32.935237 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92894d1-f5db-42b4-a8a2-999b7f06d838 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:32.939766 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b824864-19fb-4a51-8569-f2687eea3c2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:32.940461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b824864-19fb-4a51-8569-f2687eea3c2d service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:32.940755 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b824864-19fb-4a51-8569-f2687eea3c2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:32.941206 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b824864-19fb-4a51-8569-f2687eea3c2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:33.017501 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b824864-19fb-4a51-8569-f2687eea3c2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:33.019056 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b824864-19fb-4a51-8569-f2687eea3c2d service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:33.031631 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1194/2423] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:33.178434 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bd67a-9472-406d-af39-8989fab73743 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:33.180000 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-010bd67a-9472-406d-af39-8989fab73743 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:33.289142 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bd67a-9472-406d-af39-8989fab73743 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:33.294079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1813b54-b71d-470e-8258-2d687c6a4ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:33.295322 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1813b54-b71d-470e-8258-2d687c6a4ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:33.295617 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1813b54-b71d-470e-8258-2d687c6a4ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:33.295963 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1813b54-b71d-470e-8258-2d687c6a4ff6 admin admin] PATH_INFO: `/v3/users/455a2648683543769918197e6798ae8a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:33.298059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1813b54-b71d-470e-8258-2d687c6a4ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=455a2648683543769918197e6798ae8a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:33.300204 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1813b54-b71d-470e-8258-2d687c6a4ff6 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:33.381619 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c1813b54-b71d-470e-8258-2d687c6a4ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '455a2648683543769918197e6798ae8a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:33.402310 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c1813b54-b71d-470e-8258-2d687c6a4ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '455a2648683543769918197e6798ae8a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:33.402527 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c1813b54-b71d-470e-8258-2d687c6a4ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '455a2648683543769918197e6798ae8a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:33.417107 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c1813b54-b71d-470e-8258-2d687c6a4ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '455a2648683543769918197e6798ae8a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:33.418047 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c1813b54-b71d-470e-8258-2d687c6a4ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '455a2648683543769918197e6798ae8a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:33.444142 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1230/2424] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:45:33 2022] DELETE /identity/v3/users/455a2648683543769918197e6798ae8a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:33.672513 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b824864-19fb-4a51-8569-f2687eea3c2d service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:33.693293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b824864-19fb-4a51-8569-f2687eea3c2d service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:33.764997 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d7271-1535-473c-a620-e45c745d3071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:33.765956 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d7271-1535-473c-a620-e45c745d3071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:33.766234 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d7271-1535-473c-a620-e45c745d3071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:33.766498 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d7271-1535-473c-a620-e45c745d3071 admin admin] PATH_INFO: `/v3/projects/d80cc5adb96c4bac87fa83a335327781` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:33.767717 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d7271-1535-473c-a620-e45c745d3071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d80cc5adb96c4bac87fa83a335327781)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:33.769637 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d7271-1535-473c-a620-e45c745d3071 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:33.812442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:33.836822 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3e6d7271-1535-473c-a620-e45c745d3071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd80cc5adb96c4bac87fa83a335327781', 'request_id': 'req-3e6d7271-1535-473c-a620-e45c745d3071'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:33.844036 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3e6d7271-1535-473c-a620-e45c745d3071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd80cc5adb96c4bac87fa83a335327781', 'request_id': 'req-3e6d7271-1535-473c-a620-e45c745d3071'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:33.853841 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3e6d7271-1535-473c-a620-e45c745d3071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd80cc5adb96c4bac87fa83a335327781', 'request_id': 'req-3e6d7271-1535-473c-a620-e45c745d3071'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:33.877407 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3e6d7271-1535-473c-a620-e45c745d3071 admin admin] The token cache is being invalidate because project d80cc5adb96c4bac87fa83a335327781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:45:33.877600 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3e6d7271-1535-473c-a620-e45c745d3071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:33.878257 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3e6d7271-1535-473c-a620-e45c745d3071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:33.880411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1195/2425] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:45:33 2022] DELETE /identity/v3/projects/d80cc5adb96c4bac87fa83a335327781 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:38.180109 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1813b54-b71d-470e-8258-2d687c6a4ff6 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:38.182185 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c1813b54-b71d-470e-8258-2d687c6a4ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:38.196642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1813b54-b71d-470e-8258-2d687c6a4ff6 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:38.266911 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982fb51-cbbb-4eb5-80f7-c08fc1d3a973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:38.267909 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982fb51-cbbb-4eb5-80f7-c08fc1d3a973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:38.268097 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982fb51-cbbb-4eb5-80f7-c08fc1d3a973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:38.268327 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982fb51-cbbb-4eb5-80f7-c08fc1d3a973 admin admin] PATH_INFO: `/v3/users/8233c252eb7a4352a71ee3bffc49e5b0` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:38.269624 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982fb51-cbbb-4eb5-80f7-c08fc1d3a973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8233c252eb7a4352a71ee3bffc49e5b0)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:38.271683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982fb51-cbbb-4eb5-80f7-c08fc1d3a973 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:38.298665 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:38.329441 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d982fb51-cbbb-4eb5-80f7-c08fc1d3a973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8233c252eb7a4352a71ee3bffc49e5b0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:38.341530 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d982fb51-cbbb-4eb5-80f7-c08fc1d3a973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8233c252eb7a4352a71ee3bffc49e5b0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:38.342392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d982fb51-cbbb-4eb5-80f7-c08fc1d3a973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8233c252eb7a4352a71ee3bffc49e5b0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:38.358090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d982fb51-cbbb-4eb5-80f7-c08fc1d3a973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8233c252eb7a4352a71ee3bffc49e5b0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:38.360850 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d982fb51-cbbb-4eb5-80f7-c08fc1d3a973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8233c252eb7a4352a71ee3bffc49e5b0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:38.373662 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1231/2426] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:45:38 2022] DELETE /identity/v3/users/8233c252eb7a4352a71ee3bffc49e5b0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:38.378383 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988fb1c-1766-4ea4-895a-b3b914f547a2 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:38.378946 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988fb1c-1766-4ea4-895a-b3b914f547a2 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:38.379098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988fb1c-1766-4ea4-895a-b3b914f547a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:38.402296 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-2988fb1c-1766-4ea4-895a-b3b914f547a2 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:38.403556 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2988fb1c-1766-4ea4-895a-b3b914f547a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:38.484104 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1196/2427] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:38.496298 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982fb51-cbbb-4eb5-80f7-c08fc1d3a973 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:38.497920 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d982fb51-cbbb-4eb5-80f7-c08fc1d3a973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:38.576647 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982fb51-cbbb-4eb5-80f7-c08fc1d3a973 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:38.582623 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb126b-e072-4f1b-9058-dc6af753b337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:38.582623 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb126b-e072-4f1b-9058-dc6af753b337 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:38.582623 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb126b-e072-4f1b-9058-dc6af753b337 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:38.583027 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb126b-e072-4f1b-9058-dc6af753b337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:38.597596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb126b-e072-4f1b-9058-dc6af753b337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:38.600024 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb126b-e072-4f1b-9058-dc6af753b337 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:38.610954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1232/2428] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:45:39.233438 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988fb1c-1766-4ea4-895a-b3b914f547a2 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:39.235206 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2988fb1c-1766-4ea4-895a-b3b914f547a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:39.247708 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988fb1c-1766-4ea4-895a-b3b914f547a2 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:39.253105 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c57a34-e235-4ab1-9705-47d3e2376455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:39.253988 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c57a34-e235-4ab1-9705-47d3e2376455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:39.254262 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c57a34-e235-4ab1-9705-47d3e2376455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:39.254534 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c57a34-e235-4ab1-9705-47d3e2376455 admin admin] PATH_INFO: `/v3/projects/cbd727ae9d2b4bdb8ae21a6a15d2f10d` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:39.255766 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c57a34-e235-4ab1-9705-47d3e2376455 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbd727ae9d2b4bdb8ae21a6a15d2f10d)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:39.257680 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c57a34-e235-4ab1-9705-47d3e2376455 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:39.307954 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d3c57a34-e235-4ab1-9705-47d3e2376455 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbd727ae9d2b4bdb8ae21a6a15d2f10d', 'request_id': 'req-d3c57a34-e235-4ab1-9705-47d3e2376455'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:39.313645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d3c57a34-e235-4ab1-9705-47d3e2376455 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbd727ae9d2b4bdb8ae21a6a15d2f10d', 'request_id': 'req-d3c57a34-e235-4ab1-9705-47d3e2376455'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:39.319785 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d3c57a34-e235-4ab1-9705-47d3e2376455 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbd727ae9d2b4bdb8ae21a6a15d2f10d', 'request_id': 'req-d3c57a34-e235-4ab1-9705-47d3e2376455'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:39.334431 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d3c57a34-e235-4ab1-9705-47d3e2376455 admin admin] The token cache is being invalidate because project cbd727ae9d2b4bdb8ae21a6a15d2f10d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:45:39.334752 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d3c57a34-e235-4ab1-9705-47d3e2376455 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:39.335372 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d3c57a34-e235-4ab1-9705-47d3e2376455 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:39.336914 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1197/2429] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:45:39 2022] DELETE /identity/v3/projects/cbd727ae9d2b4bdb8ae21a6a15d2f10d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:39.340992 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb126b-e072-4f1b-9058-dc6af753b337 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:39.351021 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb126b-e072-4f1b-9058-dc6af753b337 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:39.411973 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693a3c2-75ef-4bec-b987-2bccc9f6c03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:39.412877 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693a3c2-75ef-4bec-b987-2bccc9f6c03f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:39.413135 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693a3c2-75ef-4bec-b987-2bccc9f6c03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:39.413421 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693a3c2-75ef-4bec-b987-2bccc9f6c03f admin admin] PATH_INFO: `/v3/users/24ff878c89304454b460f0fdeaf55e5e` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:39.414689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693a3c2-75ef-4bec-b987-2bccc9f6c03f admin admin] RBAC: Authorizing `identity:delete_user(user_id=24ff878c89304454b460f0fdeaf55e5e)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:39.416626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693a3c2-75ef-4bec-b987-2bccc9f6c03f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:39.469499 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:39.476245 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8693a3c2-75ef-4bec-b987-2bccc9f6c03f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24ff878c89304454b460f0fdeaf55e5e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:39.485253 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8693a3c2-75ef-4bec-b987-2bccc9f6c03f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24ff878c89304454b460f0fdeaf55e5e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:39.485912 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8693a3c2-75ef-4bec-b987-2bccc9f6c03f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24ff878c89304454b460f0fdeaf55e5e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:39.497720 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8693a3c2-75ef-4bec-b987-2bccc9f6c03f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24ff878c89304454b460f0fdeaf55e5e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:39.498341 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8693a3c2-75ef-4bec-b987-2bccc9f6c03f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24ff878c89304454b460f0fdeaf55e5e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:39.512677 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1233/2430] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:45:39 2022] DELETE /identity/v3/users/24ff878c89304454b460f0fdeaf55e5e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:39.900214 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c57a34-e235-4ab1-9705-47d3e2376455 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:39.901696 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d3c57a34-e235-4ab1-9705-47d3e2376455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:39.917778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c57a34-e235-4ab1-9705-47d3e2376455 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:39.971421 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:39.987789 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558db5ba-dfcf-439a-91d1-739d82ae0647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:39.988681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558db5ba-dfcf-439a-91d1-739d82ae0647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:39.988953 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558db5ba-dfcf-439a-91d1-739d82ae0647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:39.989193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558db5ba-dfcf-439a-91d1-739d82ae0647 admin admin] PATH_INFO: `/v3/projects/4b27ae4d8caa4b9d843f5f7ae7c62be8` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:39.990478 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558db5ba-dfcf-439a-91d1-739d82ae0647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b27ae4d8caa4b9d843f5f7ae7c62be8)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:39.992422 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558db5ba-dfcf-439a-91d1-739d82ae0647 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:40.042027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-558db5ba-dfcf-439a-91d1-739d82ae0647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b27ae4d8caa4b9d843f5f7ae7c62be8', 'request_id': 'req-558db5ba-dfcf-439a-91d1-739d82ae0647'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:40.047832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-558db5ba-dfcf-439a-91d1-739d82ae0647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b27ae4d8caa4b9d843f5f7ae7c62be8', 'request_id': 'req-558db5ba-dfcf-439a-91d1-739d82ae0647'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:40.054544 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-558db5ba-dfcf-439a-91d1-739d82ae0647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b27ae4d8caa4b9d843f5f7ae7c62be8', 'request_id': 'req-558db5ba-dfcf-439a-91d1-739d82ae0647'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:40.068732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-558db5ba-dfcf-439a-91d1-739d82ae0647 admin admin] The token cache is being invalidate because project 4b27ae4d8caa4b9d843f5f7ae7c62be8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:45:40.069022 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-558db5ba-dfcf-439a-91d1-739d82ae0647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:40.069643 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-558db5ba-dfcf-439a-91d1-739d82ae0647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:40.071252 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1198/2431] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:45:39 2022] DELETE /identity/v3/projects/4b27ae4d8caa4b9d843f5f7ae7c62be8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:40.076239 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daccbe9-0746-4e1a-8c15-0e232a8ca94a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:40.076515 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daccbe9-0746-4e1a-8c15-0e232a8ca94a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:40.076816 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daccbe9-0746-4e1a-8c15-0e232a8ca94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:40.096366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0daccbe9-0746-4e1a-8c15-0e232a8ca94a None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:40.097571 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0daccbe9-0746-4e1a-8c15-0e232a8ca94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:40.172404 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1234/2432] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:40.180165 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b608dc-72be-40a0-b41b-168af23ae255 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:40.180452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b608dc-72be-40a0-b41b-168af23ae255 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:40.180730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b608dc-72be-40a0-b41b-168af23ae255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:40.199911 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-53b608dc-72be-40a0-b41b-168af23ae255 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:40.201191 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-53b608dc-72be-40a0-b41b-168af23ae255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:40.210998 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1199/2433] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:40.215814 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daccbe9-0746-4e1a-8c15-0e232a8ca94a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:40.225839 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daccbe9-0746-4e1a-8c15-0e232a8ca94a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:40.230676 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935380b9-6060-4144-a1ec-8a2008ceef4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:40.231346 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935380b9-6060-4144-a1ec-8a2008ceef4e admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:40.231623 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935380b9-6060-4144-a1ec-8a2008ceef4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:40.231886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935380b9-6060-4144-a1ec-8a2008ceef4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:40.232631 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935380b9-6060-4144-a1ec-8a2008ceef4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:45:40.232934 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935380b9-6060-4144-a1ec-8a2008ceef4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:40.234687 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935380b9-6060-4144-a1ec-8a2008ceef4e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:40.246509 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1235/2434] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:45:40.251457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b608dc-72be-40a0-b41b-168af23ae255 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:40.261249 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b608dc-72be-40a0-b41b-168af23ae255 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:40.266710 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3b299-0a42-446f-92e0-d0f779257d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:40.267378 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3b299-0a42-446f-92e0-d0f779257d91 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:40.267656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3b299-0a42-446f-92e0-d0f779257d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:40.267926 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3b299-0a42-446f-92e0-d0f779257d91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:40.268623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3b299-0a42-446f-92e0-d0f779257d91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:40.270809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3b299-0a42-446f-92e0-d0f779257d91 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:40.301567 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1200/2435] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:45:40 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:40.302773 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935380b9-6060-4144-a1ec-8a2008ceef4e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:40.313412 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935380b9-6060-4144-a1ec-8a2008ceef4e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:40.370231 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a239d6a-1888-4330-947b-b4f9920e4c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:40.370993 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a239d6a-1888-4330-947b-b4f9920e4c91 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:40.371277 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a239d6a-1888-4330-947b-b4f9920e4c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:40.371537 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a239d6a-1888-4330-947b-b4f9920e4c91 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:40.372260 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a239d6a-1888-4330-947b-b4f9920e4c91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:40.374218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a239d6a-1888-4330-947b-b4f9920e4c91 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:40.400695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1236/2436] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:45:40 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:40.404959 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3b299-0a42-446f-92e0-d0f779257d91 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:40.416259 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3b299-0a42-446f-92e0-d0f779257d91 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:40.420892 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe00e34-e46e-4fee-b326-4b8d576b0055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:40.421584 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe00e34-e46e-4fee-b326-4b8d576b0055 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:40.421868 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe00e34-e46e-4fee-b326-4b8d576b0055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:40.422142 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe00e34-e46e-4fee-b326-4b8d576b0055 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:40.422982 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe00e34-e46e-4fee-b326-4b8d576b0055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:40.424583 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe00e34-e46e-4fee-b326-4b8d576b0055 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:40.435314 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1201/2437] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:40.439773 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a239d6a-1888-4330-947b-b4f9920e4c91 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:40.450013 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a239d6a-1888-4330-947b-b4f9920e4c91 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:40.455483 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0afe6-6607-4fae-a55e-83a152f50bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:40.455839 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0afe6-6607-4fae-a55e-83a152f50bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:40.456656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0afe6-6607-4fae-a55e-83a152f50bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:40.456939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0afe6-6607-4fae-a55e-83a152f50bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:40.457676 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0afe6-6607-4fae-a55e-83a152f50bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:40.459318 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0afe6-6607-4fae-a55e-83a152f50bc2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:40.469932 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1237/2438] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:40.474191 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe00e34-e46e-4fee-b326-4b8d576b0055 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:40.484429 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe00e34-e46e-4fee-b326-4b8d576b0055 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:40.489633 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a51101-1f86-414b-8e26-91e4e6a56dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:40.490521 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a51101-1f86-414b-8e26-91e4e6a56dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:40.490832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a51101-1f86-414b-8e26-91e4e6a56dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:40.491106 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a51101-1f86-414b-8e26-91e4e6a56dcf admin admin] PATH_INFO: `/v3/projects/a31dae6a21f8447f896b5d570f982154/users/c48875e20481495e9b965ae81b13015a/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:40.506255 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a51101-1f86-414b-8e26-91e4e6a56dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31dae6a21f8447f896b5d570f982154, user_id=c48875e20481495e9b965ae81b13015a, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:40.508927 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a51101-1f86-414b-8e26-91e4e6a56dcf admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:40.523597 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1202/2439] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:45:40 2022] PUT /identity/v3/projects/a31dae6a21f8447f896b5d570f982154/users/c48875e20481495e9b965ae81b13015a/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:40.534826 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bca9c7-585f-4e05-aff9-596aa507e363 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:40.535274 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bca9c7-585f-4e05-aff9-596aa507e363 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:40.535663 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bca9c7-585f-4e05-aff9-596aa507e363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:40.569711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-88bca9c7-585f-4e05-aff9-596aa507e363 None None] MFA Rules not processed for user `c48875e20481495e9b965ae81b13015a`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:40.570957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-88bca9c7-585f-4e05-aff9-596aa507e363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:40.585180 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:40.651398 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1238/2440] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:45:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:40.656110 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a51101-1f86-414b-8e26-91e4e6a56dcf admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:40.726191 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a51101-1f86-414b-8e26-91e4e6a56dcf admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:40.733637 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17556b65-fbbb-471c-9033-641299712335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:40.734450 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17556b65-fbbb-471c-9033-641299712335 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:40.734873 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17556b65-fbbb-471c-9033-641299712335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:40.735138 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17556b65-fbbb-471c-9033-641299712335 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:40.735814 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17556b65-fbbb-471c-9033-641299712335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:40.737980 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17556b65-fbbb-471c-9033-641299712335 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:40.751732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:40.767995 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1203/2441] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:45:40 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:40.772271 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bca9c7-585f-4e05-aff9-596aa507e363 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:40.783047 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bca9c7-585f-4e05-aff9-596aa507e363 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:40.841325 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f287e6-0ae0-4954-a7a6-e7c1e48f03ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:40.842003 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f287e6-0ae0-4954-a7a6-e7c1e48f03ca admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:40.842285 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f287e6-0ae0-4954-a7a6-e7c1e48f03ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:40.842554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f287e6-0ae0-4954-a7a6-e7c1e48f03ca admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:40.843288 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f287e6-0ae0-4954-a7a6-e7c1e48f03ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:40.845190 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f287e6-0ae0-4954-a7a6-e7c1e48f03ca admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:40.865920 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1239/2442] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:45:40 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:45:40.872286 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17556b65-fbbb-471c-9033-641299712335 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:40.884387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17556b65-fbbb-471c-9033-641299712335 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:40.890369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f58dfa-2078-4bda-8506-bf3531010a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:40.891337 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f58dfa-2078-4bda-8506-bf3531010a50 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:40.891713 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f58dfa-2078-4bda-8506-bf3531010a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:40.892094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f58dfa-2078-4bda-8506-bf3531010a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:40.893149 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f58dfa-2078-4bda-8506-bf3531010a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:40.895526 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f58dfa-2078-4bda-8506-bf3531010a50 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:40.907147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1204/2443] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:40.911676 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f287e6-0ae0-4954-a7a6-e7c1e48f03ca admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:40.923141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f287e6-0ae0-4954-a7a6-e7c1e48f03ca admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:40.929913 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf75a9c-916b-4921-ab2b-ee7df6f89525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:40.930882 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf75a9c-916b-4921-ab2b-ee7df6f89525 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:40.931161 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf75a9c-916b-4921-ab2b-ee7df6f89525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:40.931437 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf75a9c-916b-4921-ab2b-ee7df6f89525 admin admin] PATH_INFO: `/v3/projects/c954972bd09f4663bd9bb37d3f733101/users/2dec1cb41bd8481ab836a1b2fe5bdfdc/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:40.949540 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf75a9c-916b-4921-ab2b-ee7df6f89525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c954972bd09f4663bd9bb37d3f733101, user_id=2dec1cb41bd8481ab836a1b2fe5bdfdc, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:40.952217 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf75a9c-916b-4921-ab2b-ee7df6f89525 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:40.971053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1240/2444] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:45:40 2022] PUT /identity/v3/projects/c954972bd09f4663bd9bb37d3f733101/users/2dec1cb41bd8481ab836a1b2fe5bdfdc/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:40.975190 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f58dfa-2078-4bda-8506-bf3531010a50 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:40.985353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f58dfa-2078-4bda-8506-bf3531010a50 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:41.047139 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f041d3-848c-4015-9997-435e7dff6351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:41.047818 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f041d3-848c-4015-9997-435e7dff6351 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:41.048099 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f041d3-848c-4015-9997-435e7dff6351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:41.048372 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f041d3-848c-4015-9997-435e7dff6351 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:41.049201 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f041d3-848c-4015-9997-435e7dff6351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:41.050721 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f041d3-848c-4015-9997-435e7dff6351 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:41.060978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1205/2445] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:41.065876 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf75a9c-916b-4921-ab2b-ee7df6f89525 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:41.077109 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf75a9c-916b-4921-ab2b-ee7df6f89525 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:41.083286 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c701e2a-ec16-4d95-a140-d0b24d6432ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:41.084228 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c701e2a-ec16-4d95-a140-d0b24d6432ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:41.084505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c701e2a-ec16-4d95-a140-d0b24d6432ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:41.084779 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c701e2a-ec16-4d95-a140-d0b24d6432ed admin admin] PATH_INFO: `/v3/projects/c954972bd09f4663bd9bb37d3f733101/users/2dec1cb41bd8481ab836a1b2fe5bdfdc/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:41.087121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c701e2a-ec16-4d95-a140-d0b24d6432ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=c954972bd09f4663bd9bb37d3f733101, user_id=2dec1cb41bd8481ab836a1b2fe5bdfdc, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:41.089865 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c701e2a-ec16-4d95-a140-d0b24d6432ed admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:41.101038 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1241/2446] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:45:41 2022] PUT /identity/v3/projects/c954972bd09f4663bd9bb37d3f733101/users/2dec1cb41bd8481ab836a1b2fe5bdfdc/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:41.173767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f27fe-741f-4c0a-8c0c-a54e0306e90a None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:41.174109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f27fe-741f-4c0a-8c0c-a54e0306e90a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:41.174540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f27fe-741f-4c0a-8c0c-a54e0306e90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:41.202846 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-ef6f27fe-741f-4c0a-8c0c-a54e0306e90a None None] MFA Rules not processed for user `2dec1cb41bd8481ab836a1b2fe5bdfdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:41.204147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ef6f27fe-741f-4c0a-8c0c-a54e0306e90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:41.274294 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1206/2447] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:45:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:41.286328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c701e2a-ec16-4d95-a140-d0b24d6432ed admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:41.288175 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9c701e2a-ec16-4d95-a140-d0b24d6432ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:41.344867 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c701e2a-ec16-4d95-a140-d0b24d6432ed admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:41.348551 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933b93d-3570-4312-a9a7-54e2e50c25b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:41.349314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933b93d-3570-4312-a9a7-54e2e50c25b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:41.349588 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933b93d-3570-4312-a9a7-54e2e50c25b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:41.349882 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933b93d-3570-4312-a9a7-54e2e50c25b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:41.358997 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933b93d-3570-4312-a9a7-54e2e50c25b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:41.360597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933b93d-3570-4312-a9a7-54e2e50c25b8 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:41.370165 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1242/2448] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:41.446728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f27fe-741f-4c0a-8c0c-a54e0306e90a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:41.457048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f27fe-741f-4c0a-8c0c-a54e0306e90a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:41.461006 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fce223-69a4-435a-a0e7-b18602bca173 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:41.461679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fce223-69a4-435a-a0e7-b18602bca173 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:41.462076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fce223-69a4-435a-a0e7-b18602bca173 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:41.462350 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fce223-69a4-435a-a0e7-b18602bca173 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:41.526559 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fce223-69a4-435a-a0e7-b18602bca173 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:41.527953 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fce223-69a4-435a-a0e7-b18602bca173 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:41.537399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1207/2449] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:41.818794 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933b93d-3570-4312-a9a7-54e2e50c25b8 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:41.829560 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:41.883946 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933b93d-3570-4312-a9a7-54e2e50c25b8 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:41.889486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc37217-1b6b-49dd-8b1c-f319e95e477e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:41.890783 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc37217-1b6b-49dd-8b1c-f319e95e477e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:41.891005 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc37217-1b6b-49dd-8b1c-f319e95e477e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:41.891274 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc37217-1b6b-49dd-8b1c-f319e95e477e admin admin] PATH_INFO: `/v3/users/c48875e20481495e9b965ae81b13015a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:41.892532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc37217-1b6b-49dd-8b1c-f319e95e477e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c48875e20481495e9b965ae81b13015a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:41.894452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc37217-1b6b-49dd-8b1c-f319e95e477e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:41.946860 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4dc37217-1b6b-49dd-8b1c-f319e95e477e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c48875e20481495e9b965ae81b13015a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:41.956232 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4dc37217-1b6b-49dd-8b1c-f319e95e477e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c48875e20481495e9b965ae81b13015a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:41.956982 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4dc37217-1b6b-49dd-8b1c-f319e95e477e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c48875e20481495e9b965ae81b13015a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:41.969771 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4dc37217-1b6b-49dd-8b1c-f319e95e477e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c48875e20481495e9b965ae81b13015a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:41.970466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4dc37217-1b6b-49dd-8b1c-f319e95e477e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c48875e20481495e9b965ae81b13015a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:41.983068 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1243/2450] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:45:41 2022] DELETE /identity/v3/users/c48875e20481495e9b965ae81b13015a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:41.987804 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf611f-e4ed-4835-b99e-6120b363c893 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:41.988273 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf611f-e4ed-4835-b99e-6120b363c893 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:41.988408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf611f-e4ed-4835-b99e-6120b363c893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:41.995199 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:42.007439 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-97bf611f-e4ed-4835-b99e-6120b363c893 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:42.008645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-97bf611f-e4ed-4835-b99e-6120b363c893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:42.075033 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1208/2451] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:45:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:42.085116 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc37217-1b6b-49dd-8b1c-f319e95e477e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:42.086639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4dc37217-1b6b-49dd-8b1c-f319e95e477e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:42.148149 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc37217-1b6b-49dd-8b1c-f319e95e477e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:42.152552 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a26c8-3ed6-4046-a22a-aa299e8faa35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:42.153204 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a26c8-3ed6-4046-a22a-aa299e8faa35 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:42.153486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a26c8-3ed6-4046-a22a-aa299e8faa35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:42.153761 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a26c8-3ed6-4046-a22a-aa299e8faa35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:42.164951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a26c8-3ed6-4046-a22a-aa299e8faa35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:42.166386 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a26c8-3ed6-4046-a22a-aa299e8faa35 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:42.176816 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1244/2452] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:42.484992 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf611f-e4ed-4835-b99e-6120b363c893 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:42.487438 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-97bf611f-e4ed-4835-b99e-6120b363c893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:42.519190 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf611f-e4ed-4835-b99e-6120b363c893 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:42.524384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8be4c2-52df-41ae-a0cb-a918f68699bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:42.525466 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8be4c2-52df-41ae-a0cb-a918f68699bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:42.525747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8be4c2-52df-41ae-a0cb-a918f68699bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:42.526071 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8be4c2-52df-41ae-a0cb-a918f68699bf admin admin] PATH_INFO: `/v3/projects/a31dae6a21f8447f896b5d570f982154` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:42.527334 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8be4c2-52df-41ae-a0cb-a918f68699bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a31dae6a21f8447f896b5d570f982154)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:42.529284 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8be4c2-52df-41ae-a0cb-a918f68699bf admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:42.593113 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6e8be4c2-52df-41ae-a0cb-a918f68699bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a31dae6a21f8447f896b5d570f982154', 'request_id': 'req-6e8be4c2-52df-41ae-a0cb-a918f68699bf'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:42.600233 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6e8be4c2-52df-41ae-a0cb-a918f68699bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a31dae6a21f8447f896b5d570f982154', 'request_id': 'req-6e8be4c2-52df-41ae-a0cb-a918f68699bf'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:42.607343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6e8be4c2-52df-41ae-a0cb-a918f68699bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a31dae6a21f8447f896b5d570f982154', 'request_id': 'req-6e8be4c2-52df-41ae-a0cb-a918f68699bf'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:42.621918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6e8be4c2-52df-41ae-a0cb-a918f68699bf admin admin] The token cache is being invalidate because project a31dae6a21f8447f896b5d570f982154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:45:42.622202 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6e8be4c2-52df-41ae-a0cb-a918f68699bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:42.622943 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6e8be4c2-52df-41ae-a0cb-a918f68699bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:42.628153 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1209/2453] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:45:42 2022] DELETE /identity/v3/projects/a31dae6a21f8447f896b5d570f982154 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:42.629295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a26c8-3ed6-4046-a22a-aa299e8faa35 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:42.643704 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a26c8-3ed6-4046-a22a-aa299e8faa35 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:42.679135 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:42.718485 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bed2a-7207-42c3-8824-5873c6d449bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:42.719599 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bed2a-7207-42c3-8824-5873c6d449bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:42.719928 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bed2a-7207-42c3-8824-5873c6d449bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:42.720213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bed2a-7207-42c3-8824-5873c6d449bc admin admin] PATH_INFO: `/v3/users/2dec1cb41bd8481ab836a1b2fe5bdfdc` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:42.721499 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bed2a-7207-42c3-8824-5873c6d449bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dec1cb41bd8481ab836a1b2fe5bdfdc)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:42.723633 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bed2a-7207-42c3-8824-5873c6d449bc admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:42.788185 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0a4bed2a-7207-42c3-8824-5873c6d449bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dec1cb41bd8481ab836a1b2fe5bdfdc'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:42.795931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0a4bed2a-7207-42c3-8824-5873c6d449bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dec1cb41bd8481ab836a1b2fe5bdfdc'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:42.796725 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0a4bed2a-7207-42c3-8824-5873c6d449bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dec1cb41bd8481ab836a1b2fe5bdfdc'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:42.808759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0a4bed2a-7207-42c3-8824-5873c6d449bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dec1cb41bd8481ab836a1b2fe5bdfdc'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:42.809431 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0a4bed2a-7207-42c3-8824-5873c6d449bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dec1cb41bd8481ab836a1b2fe5bdfdc'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:42.822926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1245/2454] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:45:42 2022] DELETE /identity/v3/users/2dec1cb41bd8481ab836a1b2fe5bdfdc => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:43.112589 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8be4c2-52df-41ae-a0cb-a918f68699bf admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:43.114124 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6e8be4c2-52df-41ae-a0cb-a918f68699bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:43.129172 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8be4c2-52df-41ae-a0cb-a918f68699bf admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:43.192747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb72dfa-738d-4752-94e3-ce040f10d841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:43.193640 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb72dfa-738d-4752-94e3-ce040f10d841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:43.193933 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb72dfa-738d-4752-94e3-ce040f10d841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:43.194178 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb72dfa-738d-4752-94e3-ce040f10d841 admin admin] PATH_INFO: `/v3/projects/c954972bd09f4663bd9bb37d3f733101` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:43.195679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb72dfa-738d-4752-94e3-ce040f10d841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c954972bd09f4663bd9bb37d3f733101)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:43.197747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb72dfa-738d-4752-94e3-ce040f10d841 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:43.236144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:43.251611 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-abb72dfa-738d-4752-94e3-ce040f10d841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c954972bd09f4663bd9bb37d3f733101', 'request_id': 'req-abb72dfa-738d-4752-94e3-ce040f10d841'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:43.258129 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-abb72dfa-738d-4752-94e3-ce040f10d841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c954972bd09f4663bd9bb37d3f733101', 'request_id': 'req-abb72dfa-738d-4752-94e3-ce040f10d841'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:43.265980 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-abb72dfa-738d-4752-94e3-ce040f10d841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c954972bd09f4663bd9bb37d3f733101', 'request_id': 'req-abb72dfa-738d-4752-94e3-ce040f10d841'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:43.279905 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-abb72dfa-738d-4752-94e3-ce040f10d841 admin admin] The token cache is being invalidate because project c954972bd09f4663bd9bb37d3f733101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:45:43.280191 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-abb72dfa-738d-4752-94e3-ce040f10d841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:43.280803 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-abb72dfa-738d-4752-94e3-ce040f10d841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:43.282627 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1210/2455] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:45:43 2022] DELETE /identity/v3/projects/c954972bd09f4663bd9bb37d3f733101 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:43.615009 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bed2a-7207-42c3-8824-5873c6d449bc admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:43.617115 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0a4bed2a-7207-42c3-8824-5873c6d449bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:43.728955 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bed2a-7207-42c3-8824-5873c6d449bc admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:43.773418 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:43.796001 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be60cb-65ce-417b-b9ec-898614a710e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:43.797041 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be60cb-65ce-417b-b9ec-898614a710e4 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:43.797637 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be60cb-65ce-417b-b9ec-898614a710e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:43.797937 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be60cb-65ce-417b-b9ec-898614a710e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:43.799905 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-05be60cb-65ce-417b-b9ec-898614a710e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:43.812653 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be60cb-65ce-417b-b9ec-898614a710e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:43.814280 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be60cb-65ce-417b-b9ec-898614a710e4 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:43.825156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1246/2456] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:45.549707 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6eedc-5180-4c55-9cc9-904b02c0be06 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:45.550305 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6eedc-5180-4c55-9cc9-904b02c0be06 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:45.550305 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6eedc-5180-4c55-9cc9-904b02c0be06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:45.570388 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-a5e6eedc-5180-4c55-9cc9-904b02c0be06 None None] MFA Rules not processed for user `cbf7d6db675047cbb3a3f16631c59622`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:45.571628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a5e6eedc-5180-4c55-9cc9-904b02c0be06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:45.632610 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1211/2457] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 13:45:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:45.646348 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be60cb-65ce-417b-b9ec-898614a710e4 service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:45.647900 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-05be60cb-65ce-417b-b9ec-898614a710e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:45.722785 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be60cb-65ce-417b-b9ec-898614a710e4 service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:45.728324 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e983ac-b2d1-4754-a80e-02292beb8896 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd0e37b0404419bb5752228bd809be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:45.728982 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e983ac-b2d1-4754-a80e-02292beb8896 service swift] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:45.729261 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e983ac-b2d1-4754-a80e-02292beb8896 service swift] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:45.729533 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e983ac-b2d1-4754-a80e-02292beb8896 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:45.738402 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e983ac-b2d1-4754-a80e-02292beb8896 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:45.740028 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e983ac-b2d1-4754-a80e-02292beb8896 service swift] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:45.748580 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1247/2458] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 13:45:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:45:55.623811 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=38,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:55.745339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=44 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:57.977356 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6eedc-5180-4c55-9cc9-904b02c0be06 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:57.979097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a5e6eedc-5180-4c55-9cc9-904b02c0be06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:57.996672 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6eedc-5180-4c55-9cc9-904b02c0be06 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:58.003222 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35226361-b018-4f1b-b954-92e678b019a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:58.004043 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35226361-b018-4f1b-b954-92e678b019a2 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:58.004486 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35226361-b018-4f1b-b954-92e678b019a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:58.004930 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35226361-b018-4f1b-b954-92e678b019a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:58.006876 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-35226361-b018-4f1b-b954-92e678b019a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:58.070788 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35226361-b018-4f1b-b954-92e678b019a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:58.072460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35226361-b018-4f1b-b954-92e678b019a2 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:58.081671 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1212/2459] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:03.227900 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b169e5-2ab6-455e-97e7-2fbe4bec58ec None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:03.228382 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b169e5-2ab6-455e-97e7-2fbe4bec58ec None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:03.228483 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b169e5-2ab6-455e-97e7-2fbe4bec58ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:03.246799 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-39b169e5-2ab6-455e-97e7-2fbe4bec58ec None None] MFA Rules not processed for user `cbf7d6db675047cbb3a3f16631c59622`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:03.247995 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-39b169e5-2ab6-455e-97e7-2fbe4bec58ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:03.256661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1248/2460] 10.222.0.18 () {58 vars in 967 bytes} [Thu Jun 2 13:46:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:03.272848 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35226361-b018-4f1b-b954-92e678b019a2 service nova] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:03.284296 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35226361-b018-4f1b-b954-92e678b019a2 service nova] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:03.289511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e461a1-49bf-45de-af86-6c6ab1ce5d44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd0e37b0404419bb5752228bd809be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:03.290155 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e461a1-49bf-45de-af86-6c6ab1ce5d44 service swift] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:03.290434 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e461a1-49bf-45de-af86-6c6ab1ce5d44 service swift] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:03.290734 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e461a1-49bf-45de-af86-6c6ab1ce5d44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:03.298794 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e461a1-49bf-45de-af86-6c6ab1ce5d44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:03.300369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e461a1-49bf-45de-af86-6c6ab1ce5d44 service swift] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:03.308440 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1213/2461] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 13:46:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:46:09.586403 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b169e5-2ab6-455e-97e7-2fbe4bec58ec None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:09.603503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b169e5-2ab6-455e-97e7-2fbe4bec58ec None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:09.611560 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4200a71-8508-4be7-b60a-8ec8a4dcd7e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:09.612222 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4200a71-8508-4be7-b60a-8ec8a4dcd7e2 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:09.612501 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4200a71-8508-4be7-b60a-8ec8a4dcd7e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:09.612772 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4200a71-8508-4be7-b60a-8ec8a4dcd7e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:09.615157 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d4200a71-8508-4be7-b60a-8ec8a4dcd7e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:09.686008 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4200a71-8508-4be7-b60a-8ec8a4dcd7e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:09.687626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4200a71-8508-4be7-b60a-8ec8a4dcd7e2 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:09.697677 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1249/2462] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:13.013772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e461a1-49bf-45de-af86-6c6ab1ce5d44 service swift] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:13.015926 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d8e461a1-49bf-45de-af86-6c6ab1ce5d44 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:13.033068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e461a1-49bf-45de-af86-6c6ab1ce5d44 service swift] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:13.039907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f28df-a15e-436e-ae12-ee582fc21dfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:13.041018 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f28df-a15e-436e-ae12-ee582fc21dfe service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:13.041483 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f28df-a15e-436e-ae12-ee582fc21dfe service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:13.041913 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f28df-a15e-436e-ae12-ee582fc21dfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:13.044228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3a8f28df-a15e-436e-ae12-ee582fc21dfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:13.058306 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f28df-a15e-436e-ae12-ee582fc21dfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:13.060361 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f28df-a15e-436e-ae12-ee582fc21dfe service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:13.076530 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1214/2463] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:18.664983 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4200a71-8508-4be7-b60a-8ec8a4dcd7e2 service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:18.666556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d4200a71-8508-4be7-b60a-8ec8a4dcd7e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:18.735808 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4200a71-8508-4be7-b60a-8ec8a4dcd7e2 service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:18.740351 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631367f-5c39-457f-9181-3e758a70c619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:18.741367 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631367f-5c39-457f-9181-3e758a70c619 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:18.741776 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631367f-5c39-457f-9181-3e758a70c619 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:18.742181 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631367f-5c39-457f-9181-3e758a70c619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:18.744723 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a631367f-5c39-457f-9181-3e758a70c619 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:18.822089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631367f-5c39-457f-9181-3e758a70c619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:18.823687 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631367f-5c39-457f-9181-3e758a70c619 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:18.834180 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1250/2464] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:21.970611 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f28df-a15e-436e-ae12-ee582fc21dfe service nova] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:21.972312 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3a8f28df-a15e-436e-ae12-ee582fc21dfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:21.992015 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f28df-a15e-436e-ae12-ee582fc21dfe service nova] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:21.997295 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0a3e0-c6b9-427e-9e24-a39f0ef9610c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:21.998238 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0a3e0-c6b9-427e-9e24-a39f0ef9610c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:21.998512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0a3e0-c6b9-427e-9e24-a39f0ef9610c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:21.998812 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0a3e0-c6b9-427e-9e24-a39f0ef9610c admin admin] PATH_INFO: `/v3/users/e1cd9b4bda834e90b366d83445c85810` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:22.000255 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0a3e0-c6b9-427e-9e24-a39f0ef9610c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1cd9b4bda834e90b366d83445c85810)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:22.002390 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0a3e0-c6b9-427e-9e24-a39f0ef9610c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:22.054444 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-40e0a3e0-c6b9-427e-9e24-a39f0ef9610c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1cd9b4bda834e90b366d83445c85810'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:22.063125 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-40e0a3e0-c6b9-427e-9e24-a39f0ef9610c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1cd9b4bda834e90b366d83445c85810'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:22.063825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-40e0a3e0-c6b9-427e-9e24-a39f0ef9610c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1cd9b4bda834e90b366d83445c85810'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:22.071814 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-40e0a3e0-c6b9-427e-9e24-a39f0ef9610c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1cd9b4bda834e90b366d83445c85810'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:22.087099 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-40e0a3e0-c6b9-427e-9e24-a39f0ef9610c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1cd9b4bda834e90b366d83445c85810'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:22.093875 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1215/2465] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:46:21 2022] DELETE /identity/v3/users/e1cd9b4bda834e90b366d83445c85810 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:22.284973 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631367f-5c39-457f-9181-3e758a70c619 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:22.296275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631367f-5c39-457f-9181-3e758a70c619 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:22.354892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:22.373314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62734253-b349-416c-8584-a13eb7ecea7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:22.374277 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62734253-b349-416c-8584-a13eb7ecea7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:22.374628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62734253-b349-416c-8584-a13eb7ecea7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:22.374900 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62734253-b349-416c-8584-a13eb7ecea7a admin admin] PATH_INFO: `/v3/projects/53fedc6ae99343a58a50790023f03c5e` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:22.376115 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62734253-b349-416c-8584-a13eb7ecea7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=53fedc6ae99343a58a50790023f03c5e)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:22.378071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62734253-b349-416c-8584-a13eb7ecea7a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:22.427470 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-62734253-b349-416c-8584-a13eb7ecea7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53fedc6ae99343a58a50790023f03c5e', 'request_id': 'req-62734253-b349-416c-8584-a13eb7ecea7a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:22.434203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-62734253-b349-416c-8584-a13eb7ecea7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53fedc6ae99343a58a50790023f03c5e', 'request_id': 'req-62734253-b349-416c-8584-a13eb7ecea7a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:22.442926 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-62734253-b349-416c-8584-a13eb7ecea7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53fedc6ae99343a58a50790023f03c5e', 'request_id': 'req-62734253-b349-416c-8584-a13eb7ecea7a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:22.463061 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-62734253-b349-416c-8584-a13eb7ecea7a admin admin] The token cache is being invalidate because project 53fedc6ae99343a58a50790023f03c5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:46:22.463347 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-62734253-b349-416c-8584-a13eb7ecea7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:22.464060 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-62734253-b349-416c-8584-a13eb7ecea7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:22.465754 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1251/2466] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:46:22 2022] DELETE /identity/v3/projects/53fedc6ae99343a58a50790023f03c5e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:22.471006 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5927137-520b-47ee-ac12-f79729260f13 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:22.471310 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5927137-520b-47ee-ac12-f79729260f13 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:22.471720 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5927137-520b-47ee-ac12-f79729260f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:22.492377 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d5927137-520b-47ee-ac12-f79729260f13 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:22.493777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d5927137-520b-47ee-ac12-f79729260f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:22.539956 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:22.560945 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1216/2467] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:22.569317 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dfaed-ee15-42ff-b70e-d4a499336d10 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:22.569604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dfaed-ee15-42ff-b70e-d4a499336d10 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:22.569877 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dfaed-ee15-42ff-b70e-d4a499336d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:22.590179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-fe3dfaed-ee15-42ff-b70e-d4a499336d10 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:22.591526 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fe3dfaed-ee15-42ff-b70e-d4a499336d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:22.600654 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1252/2468] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:22.605136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5927137-520b-47ee-ac12-f79729260f13 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:22.615244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5927137-520b-47ee-ac12-f79729260f13 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:22.620382 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073790a1-1134-4144-87de-c74ae0e14ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:22.621061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073790a1-1134-4144-87de-c74ae0e14ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:22.621338 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073790a1-1134-4144-87de-c74ae0e14ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:22.621604 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073790a1-1134-4144-87de-c74ae0e14ed2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:22.622416 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073790a1-1134-4144-87de-c74ae0e14ed2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:46:22.622756 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073790a1-1134-4144-87de-c74ae0e14ed2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:22.624485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073790a1-1134-4144-87de-c74ae0e14ed2 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:22.637461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1217/2469] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:46:22.642527 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3dfaed-ee15-42ff-b70e-d4a499336d10 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:22.654461 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3dfaed-ee15-42ff-b70e-d4a499336d10 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:22.660030 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c7033-61b5-4c6d-a7bc-baf3138b634f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:22.660703 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c7033-61b5-4c6d-a7bc-baf3138b634f admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:22.660982 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c7033-61b5-4c6d-a7bc-baf3138b634f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:22.661251 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c7033-61b5-4c6d-a7bc-baf3138b634f admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:22.661961 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c7033-61b5-4c6d-a7bc-baf3138b634f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:22.663968 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c7033-61b5-4c6d-a7bc-baf3138b634f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:22.702348 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1253/2470] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:46:22 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:46:22.706830 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073790a1-1134-4144-87de-c74ae0e14ed2 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:22.717880 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073790a1-1134-4144-87de-c74ae0e14ed2 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:22.776615 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed06f1c-e9d8-43a7-bd96-cb92d0ee9432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:22.777286 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed06f1c-e9d8-43a7-bd96-cb92d0ee9432 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:22.777566 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed06f1c-e9d8-43a7-bd96-cb92d0ee9432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:22.777841 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed06f1c-e9d8-43a7-bd96-cb92d0ee9432 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:22.778523 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed06f1c-e9d8-43a7-bd96-cb92d0ee9432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:22.780536 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed06f1c-e9d8-43a7-bd96-cb92d0ee9432 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:22.805708 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1218/2471] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:46:22 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:46:22.811528 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c7033-61b5-4c6d-a7bc-baf3138b634f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:22.822261 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c7033-61b5-4c6d-a7bc-baf3138b634f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:22.826957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f394267-000e-4e7d-b299-9cd4e81f5b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:22.827617 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f394267-000e-4e7d-b299-9cd4e81f5b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:22.827895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f394267-000e-4e7d-b299-9cd4e81f5b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:22.828185 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f394267-000e-4e7d-b299-9cd4e81f5b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:22.828941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f394267-000e-4e7d-b299-9cd4e81f5b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:22.830608 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f394267-000e-4e7d-b299-9cd4e81f5b2b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:22.841710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1254/2472] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:46:22.846046 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed06f1c-e9d8-43a7-bd96-cb92d0ee9432 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:22.856471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed06f1c-e9d8-43a7-bd96-cb92d0ee9432 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:22.861007 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783259fd-ccfd-4635-9cb7-977fbeea9dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:22.861667 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783259fd-ccfd-4635-9cb7-977fbeea9dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:22.861947 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783259fd-ccfd-4635-9cb7-977fbeea9dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:22.862251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783259fd-ccfd-4635-9cb7-977fbeea9dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:22.863028 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783259fd-ccfd-4635-9cb7-977fbeea9dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:22.864604 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783259fd-ccfd-4635-9cb7-977fbeea9dc3 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:22.875089 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1219/2473] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:46:22.879610 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f394267-000e-4e7d-b299-9cd4e81f5b2b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:22.890180 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f394267-000e-4e7d-b299-9cd4e81f5b2b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:22.894883 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3405482-498a-4bd5-a7d0-a15e06054103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:22.895798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3405482-498a-4bd5-a7d0-a15e06054103 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:22.896084 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3405482-498a-4bd5-a7d0-a15e06054103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:22.896355 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3405482-498a-4bd5-a7d0-a15e06054103 admin admin] PATH_INFO: `/v3/projects/7a29c07e1eb24423a7e4a1d3aa4c2e5f/users/672b4989962f4710b95ba9c26b9e0c6a/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:22.911216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3405482-498a-4bd5-a7d0-a15e06054103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a29c07e1eb24423a7e4a1d3aa4c2e5f, user_id=672b4989962f4710b95ba9c26b9e0c6a, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:22.913844 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3405482-498a-4bd5-a7d0-a15e06054103 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:22.928655 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1255/2474] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:46:22 2022] PUT /identity/v3/projects/7a29c07e1eb24423a7e4a1d3aa4c2e5f/users/672b4989962f4710b95ba9c26b9e0c6a/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:22.941839 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cc894-30d6-406a-9f92-cfcd50ff67ac None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:22.942138 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cc894-30d6-406a-9f92-cfcd50ff67ac None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:22.942416 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cc894-30d6-406a-9f92-cfcd50ff67ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:22.972619 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-083cc894-30d6-406a-9f92-cfcd50ff67ac None None] MFA Rules not processed for user `672b4989962f4710b95ba9c26b9e0c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:22.973816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-083cc894-30d6-406a-9f92-cfcd50ff67ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:23.045523 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1220/2475] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:23.058809 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3405482-498a-4bd5-a7d0-a15e06054103 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:23.060810 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d3405482-498a-4bd5-a7d0-a15e06054103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:23.128209 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:23.145864 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3405482-498a-4bd5-a7d0-a15e06054103 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:23.153301 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e233859-ebd0-4ec3-988c-d96c9873ec11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0061e2927843cf86769d2beab18743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:23.153974 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e233859-ebd0-4ec3-988c-d96c9873ec11 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:23.154273 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e233859-ebd0-4ec3-988c-d96c9873ec11 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:23.154545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e233859-ebd0-4ec3-988c-d96c9873ec11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:23.163757 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e233859-ebd0-4ec3-988c-d96c9873ec11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:23.165736 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e233859-ebd0-4ec3-988c-d96c9873ec11 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:23.175268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1256/2476] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:23.482245 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cc894-30d6-406a-9f92-cfcd50ff67ac None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:23.483716 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-083cc894-30d6-406a-9f92-cfcd50ff67ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:23.541976 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:23.561457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cc894-30d6-406a-9f92-cfcd50ff67ac None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:23.566138 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72debe-e11f-4872-9cb5-059a7bf9cc7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:23.566891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72debe-e11f-4872-9cb5-059a7bf9cc7e service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:23.567193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72debe-e11f-4872-9cb5-059a7bf9cc7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:23.567473 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72debe-e11f-4872-9cb5-059a7bf9cc7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:23.569599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4e72debe-e11f-4872-9cb5-059a7bf9cc7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:23.643365 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72debe-e11f-4872-9cb5-059a7bf9cc7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:23.644877 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72debe-e11f-4872-9cb5-059a7bf9cc7e service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:23.656341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1221/2477] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:26.967678 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e233859-ebd0-4ec3-988c-d96c9873ec11 service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:26.969347 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5e233859-ebd0-4ec3-988c-d96c9873ec11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:26.986237 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e233859-ebd0-4ec3-988c-d96c9873ec11 service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:26.991005 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036dd8b-d4d9-4f8e-813a-7ad3f36d782d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:26.991909 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036dd8b-d4d9-4f8e-813a-7ad3f36d782d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:26.992188 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036dd8b-d4d9-4f8e-813a-7ad3f36d782d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:26.992458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036dd8b-d4d9-4f8e-813a-7ad3f36d782d admin admin] PATH_INFO: `/v3/users/bb90d2315ce54db8820d4943b1a8c53c` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:26.993793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036dd8b-d4d9-4f8e-813a-7ad3f36d782d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb90d2315ce54db8820d4943b1a8c53c)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:26.995773 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036dd8b-d4d9-4f8e-813a-7ad3f36d782d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:27.070992 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d036dd8b-d4d9-4f8e-813a-7ad3f36d782d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb90d2315ce54db8820d4943b1a8c53c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:27.078818 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d036dd8b-d4d9-4f8e-813a-7ad3f36d782d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb90d2315ce54db8820d4943b1a8c53c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:27.079444 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d036dd8b-d4d9-4f8e-813a-7ad3f36d782d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb90d2315ce54db8820d4943b1a8c53c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:27.091889 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d036dd8b-d4d9-4f8e-813a-7ad3f36d782d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb90d2315ce54db8820d4943b1a8c53c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:27.092560 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d036dd8b-d4d9-4f8e-813a-7ad3f36d782d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb90d2315ce54db8820d4943b1a8c53c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:27.106452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1257/2478] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:46:26 2022] DELETE /identity/v3/users/bb90d2315ce54db8820d4943b1a8c53c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:27.309101 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72debe-e11f-4872-9cb5-059a7bf9cc7e service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:27.320721 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72debe-e11f-4872-9cb5-059a7bf9cc7e service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:27.399696 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae9e69-6c9b-4a1c-b255-41d6d228269e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:27.400664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae9e69-6c9b-4a1c-b255-41d6d228269e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:27.401021 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae9e69-6c9b-4a1c-b255-41d6d228269e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:27.401460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae9e69-6c9b-4a1c-b255-41d6d228269e admin admin] PATH_INFO: `/v3/projects/898189f142c046fa847b171d0bfba16a` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:27.402688 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae9e69-6c9b-4a1c-b255-41d6d228269e admin admin] RBAC: Authorizing `identity:delete_project(project_id=898189f142c046fa847b171d0bfba16a)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:27.404577 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae9e69-6c9b-4a1c-b255-41d6d228269e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:27.453931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9eae9e69-6c9b-4a1c-b255-41d6d228269e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '898189f142c046fa847b171d0bfba16a', 'request_id': 'req-9eae9e69-6c9b-4a1c-b255-41d6d228269e'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:27.459629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9eae9e69-6c9b-4a1c-b255-41d6d228269e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '898189f142c046fa847b171d0bfba16a', 'request_id': 'req-9eae9e69-6c9b-4a1c-b255-41d6d228269e'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:27.466601 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9eae9e69-6c9b-4a1c-b255-41d6d228269e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '898189f142c046fa847b171d0bfba16a', 'request_id': 'req-9eae9e69-6c9b-4a1c-b255-41d6d228269e'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:27.482023 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9eae9e69-6c9b-4a1c-b255-41d6d228269e admin admin] The token cache is being invalidate because project 898189f142c046fa847b171d0bfba16a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:46:27.482309 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9eae9e69-6c9b-4a1c-b255-41d6d228269e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:27.483034 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9eae9e69-6c9b-4a1c-b255-41d6d228269e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:27.484708 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1222/2479] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:46:27 2022] DELETE /identity/v3/projects/898189f142c046fa847b171d0bfba16a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:27.490007 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6ec2f-a1c5-4a19-ad02-259af3c2abcf None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:27.490291 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6ec2f-a1c5-4a19-ad02-259af3c2abcf None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:27.490593 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6ec2f-a1c5-4a19-ad02-259af3c2abcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:27.511276 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b8d6ec2f-a1c5-4a19-ad02-259af3c2abcf None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:27.512836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b8d6ec2f-a1c5-4a19-ad02-259af3c2abcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:27.579283 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1258/2480] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:27.588059 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59397878-a815-4a86-98d7-f5b9a127d512 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:27.588344 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59397878-a815-4a86-98d7-f5b9a127d512 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:27.588618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59397878-a815-4a86-98d7-f5b9a127d512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:27.609828 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-59397878-a815-4a86-98d7-f5b9a127d512 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:27.611072 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-59397878-a815-4a86-98d7-f5b9a127d512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:27.619956 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1223/2481] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:27.624352 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6ec2f-a1c5-4a19-ad02-259af3c2abcf None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:27.634955 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6ec2f-a1c5-4a19-ad02-259af3c2abcf None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:27.641254 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3e7f8-def9-4009-bf15-1d8c3392a91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:27.641951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3e7f8-def9-4009-bf15-1d8c3392a91e admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:27.642229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3e7f8-def9-4009-bf15-1d8c3392a91e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:27.642503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3e7f8-def9-4009-bf15-1d8c3392a91e admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:27.643276 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3e7f8-def9-4009-bf15-1d8c3392a91e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:46:27.643580 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3e7f8-def9-4009-bf15-1d8c3392a91e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:27.645188 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3e7f8-def9-4009-bf15-1d8c3392a91e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:27.657726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1259/2482] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:46:27.662364 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59397878-a815-4a86-98d7-f5b9a127d512 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:27.672189 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59397878-a815-4a86-98d7-f5b9a127d512 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:27.677446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98d0bc-c954-451c-a213-6bcc32367145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:27.678099 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98d0bc-c954-451c-a213-6bcc32367145 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:27.678379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98d0bc-c954-451c-a213-6bcc32367145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:27.678677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98d0bc-c954-451c-a213-6bcc32367145 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:27.679487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98d0bc-c954-451c-a213-6bcc32367145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:27.681591 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98d0bc-c954-451c-a213-6bcc32367145 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:27.691484 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:27.710157 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1224/2483] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:46:27 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:46:27.714544 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3e7f8-def9-4009-bf15-1d8c3392a91e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:27.724721 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3e7f8-def9-4009-bf15-1d8c3392a91e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:27.769660 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:27.789476 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0224c6-89e4-49f5-a414-7fe770ae903e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:27.790434 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0224c6-89e4-49f5-a414-7fe770ae903e admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:27.790875 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0224c6-89e4-49f5-a414-7fe770ae903e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:27.791234 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0224c6-89e4-49f5-a414-7fe770ae903e admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:27.792296 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0224c6-89e4-49f5-a414-7fe770ae903e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:27.794734 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0224c6-89e4-49f5-a414-7fe770ae903e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:27.820314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1260/2484] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:46:27 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:46:27.824804 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98d0bc-c954-451c-a213-6bcc32367145 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:27.835767 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98d0bc-c954-451c-a213-6bcc32367145 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:27.841995 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14919e-f934-4bed-bc47-b4f732e8f60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:27.842671 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14919e-f934-4bed-bc47-b4f732e8f60e admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:27.843000 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14919e-f934-4bed-bc47-b4f732e8f60e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:27.843271 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14919e-f934-4bed-bc47-b4f732e8f60e admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:27.844003 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14919e-f934-4bed-bc47-b4f732e8f60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:27.845618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14919e-f934-4bed-bc47-b4f732e8f60e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:27.856667 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1225/2485] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:46:27.860878 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0224c6-89e4-49f5-a414-7fe770ae903e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:27.871969 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0224c6-89e4-49f5-a414-7fe770ae903e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:27.877328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a003a-2a5b-4c9a-89a2-36b8f6c0eda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:27.877973 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a003a-2a5b-4c9a-89a2-36b8f6c0eda6 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:27.878249 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a003a-2a5b-4c9a-89a2-36b8f6c0eda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:27.878519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a003a-2a5b-4c9a-89a2-36b8f6c0eda6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:27.879270 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a003a-2a5b-4c9a-89a2-36b8f6c0eda6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:27.880846 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a003a-2a5b-4c9a-89a2-36b8f6c0eda6 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:27.891927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1261/2486] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:46:27.896880 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14919e-f934-4bed-bc47-b4f732e8f60e admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:27.909603 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14919e-f934-4bed-bc47-b4f732e8f60e admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:27.914370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a10f88-cf1a-4f58-96bb-c29eb8ba3e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:27.915495 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a10f88-cf1a-4f58-96bb-c29eb8ba3e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:27.915785 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a10f88-cf1a-4f58-96bb-c29eb8ba3e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:27.916042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a10f88-cf1a-4f58-96bb-c29eb8ba3e75 admin admin] PATH_INFO: `/v3/projects/0346769299f24fa69673ae623cbc3c47/users/53fa91203ff347e58ef0517341be4520/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:27.934224 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a10f88-cf1a-4f58-96bb-c29eb8ba3e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0346769299f24fa69673ae623cbc3c47, user_id=53fa91203ff347e58ef0517341be4520, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:27.937085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a10f88-cf1a-4f58-96bb-c29eb8ba3e75 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:27.953121 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1226/2487] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:46:27 2022] PUT /identity/v3/projects/0346769299f24fa69673ae623cbc3c47/users/53fa91203ff347e58ef0517341be4520/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:27.964571 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e927f05-3c89-4584-8f7c-415e21540026 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:27.964858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e927f05-3c89-4584-8f7c-415e21540026 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:27.965120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e927f05-3c89-4584-8f7c-415e21540026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:27.996408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8e927f05-3c89-4584-8f7c-415e21540026 None None] MFA Rules not processed for user `53fa91203ff347e58ef0517341be4520`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:27.998021 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8e927f05-3c89-4584-8f7c-415e21540026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:28.066904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1262/2488] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:28.071874 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a10f88-cf1a-4f58-96bb-c29eb8ba3e75 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:28.134228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a10f88-cf1a-4f58-96bb-c29eb8ba3e75 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:28.139598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b1f5a-a121-47cc-ba4c-2c8a12560413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:28.140250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b1f5a-a121-47cc-ba4c-2c8a12560413 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:28.140529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b1f5a-a121-47cc-ba4c-2c8a12560413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:28.140785 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b1f5a-a121-47cc-ba4c-2c8a12560413 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:28.141459 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b1f5a-a121-47cc-ba4c-2c8a12560413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:28.143375 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b1f5a-a121-47cc-ba4c-2c8a12560413 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:28.170923 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1227/2489] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:46:28 2022] POST /identity/v3/projects => generated 363 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:46:28.175274 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e927f05-3c89-4584-8f7c-415e21540026 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:28.186153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e927f05-3c89-4584-8f7c-415e21540026 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:28.242343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae097ebc-2aae-44db-a1ef-5308012ee309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:28.243071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae097ebc-2aae-44db-a1ef-5308012ee309 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:28.243346 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae097ebc-2aae-44db-a1ef-5308012ee309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:28.243614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae097ebc-2aae-44db-a1ef-5308012ee309 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:28.244309 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae097ebc-2aae-44db-a1ef-5308012ee309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:28.246208 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae097ebc-2aae-44db-a1ef-5308012ee309 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:28.267559 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1263/2490] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:46:28 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:46:28.272330 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b1f5a-a121-47cc-ba4c-2c8a12560413 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:28.283488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b1f5a-a121-47cc-ba4c-2c8a12560413 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:28.288858 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f168cf-b55f-4318-92d1-b69bf7cc8ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:28.289816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f168cf-b55f-4318-92d1-b69bf7cc8ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:28.290092 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f168cf-b55f-4318-92d1-b69bf7cc8ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:28.290433 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f168cf-b55f-4318-92d1-b69bf7cc8ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:28.291284 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f168cf-b55f-4318-92d1-b69bf7cc8ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:28.293271 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f168cf-b55f-4318-92d1-b69bf7cc8ea1 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:28.305992 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1228/2491] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:46:28.310561 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae097ebc-2aae-44db-a1ef-5308012ee309 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:28.321159 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae097ebc-2aae-44db-a1ef-5308012ee309 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:28.326660 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1341dda-2dd3-40cd-beca-3b27482c2550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:28.327628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1341dda-2dd3-40cd-beca-3b27482c2550 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:28.327905 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1341dda-2dd3-40cd-beca-3b27482c2550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:28.328198 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1341dda-2dd3-40cd-beca-3b27482c2550 admin admin] PATH_INFO: `/v3/projects/fba63c736b444daab3b2076822eb18c1/users/f767053f36e449b087bf3ba020f52616/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:28.344019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1341dda-2dd3-40cd-beca-3b27482c2550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba63c736b444daab3b2076822eb18c1, user_id=f767053f36e449b087bf3ba020f52616, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:28.346696 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1341dda-2dd3-40cd-beca-3b27482c2550 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:28.360611 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1264/2492] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:46:28 2022] PUT /identity/v3/projects/fba63c736b444daab3b2076822eb18c1/users/f767053f36e449b087bf3ba020f52616/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:46:28.364399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f168cf-b55f-4318-92d1-b69bf7cc8ea1 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:28.375508 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f168cf-b55f-4318-92d1-b69bf7cc8ea1 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:28.440700 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829cca2-956e-45cd-ac03-77b70b982022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:28.441382 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829cca2-956e-45cd-ac03-77b70b982022 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:28.441722 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829cca2-956e-45cd-ac03-77b70b982022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:28.441910 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829cca2-956e-45cd-ac03-77b70b982022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:28.442650 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829cca2-956e-45cd-ac03-77b70b982022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:28.444241 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829cca2-956e-45cd-ac03-77b70b982022 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:28.463343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1229/2493] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:46:28.469686 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1341dda-2dd3-40cd-beca-3b27482c2550 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:28.486325 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1341dda-2dd3-40cd-beca-3b27482c2550 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:28.495678 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b74ad-23d3-4486-93d0-d1c4bee85304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:28.495678 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b74ad-23d3-4486-93d0-d1c4bee85304 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:28.495678 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b74ad-23d3-4486-93d0-d1c4bee85304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:28.495678 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b74ad-23d3-4486-93d0-d1c4bee85304 admin admin] PATH_INFO: `/v3/projects/fba63c736b444daab3b2076822eb18c1/users/f767053f36e449b087bf3ba020f52616/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:28.497437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829cca2-956e-45cd-ac03-77b70b982022 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:28.497437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1829cca2-956e-45cd-ac03-77b70b982022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:28.500625 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b74ad-23d3-4486-93d0-d1c4bee85304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba63c736b444daab3b2076822eb18c1, user_id=f767053f36e449b087bf3ba020f52616, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:28.503337 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b74ad-23d3-4486-93d0-d1c4bee85304 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:28.509975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829cca2-956e-45cd-ac03-77b70b982022 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:28.516169 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1265/2494] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:46:28 2022] PUT /identity/v3/projects/fba63c736b444daab3b2076822eb18c1/users/f767053f36e449b087bf3ba020f52616/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:28.526593 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08507f16-5630-4133-8013-209b89db8181 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:28.526972 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08507f16-5630-4133-8013-209b89db8181 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:28.527250 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08507f16-5630-4133-8013-209b89db8181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:28.534620 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:28.536176 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:28.556327 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-08507f16-5630-4133-8013-209b89db8181 None None] MFA Rules not processed for user `f767053f36e449b087bf3ba020f52616`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:28.557793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-08507f16-5630-4133-8013-209b89db8181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:28.573057 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dd1db-c123-43e5-8337-0222d5209dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:28.573971 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dd1db-c123-43e5-8337-0222d5209dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:28.574248 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dd1db-c123-43e5-8337-0222d5209dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:28.574518 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dd1db-c123-43e5-8337-0222d5209dc3 admin admin] PATH_INFO: `/v3/users/672b4989962f4710b95ba9c26b9e0c6a` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:28.575731 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6dd1db-c123-43e5-8337-0222d5209dc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=672b4989962f4710b95ba9c26b9e0c6a)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:28.577666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6dd1db-c123-43e5-8337-0222d5209dc3 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:28.627344 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bc6dd1db-c123-43e5-8337-0222d5209dc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '672b4989962f4710b95ba9c26b9e0c6a'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:28.631333 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1266/2495] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:28 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:46:28.639648 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bc6dd1db-c123-43e5-8337-0222d5209dc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '672b4989962f4710b95ba9c26b9e0c6a'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:28.640606 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bc6dd1db-c123-43e5-8337-0222d5209dc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '672b4989962f4710b95ba9c26b9e0c6a'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:28.646218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08507f16-5630-4133-8013-209b89db8181 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:28.647730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-08507f16-5630-4133-8013-209b89db8181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:28.647889 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bc6dd1db-c123-43e5-8337-0222d5209dc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '672b4989962f4710b95ba9c26b9e0c6a'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:28.659812 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bc6dd1db-c123-43e5-8337-0222d5209dc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '672b4989962f4710b95ba9c26b9e0c6a'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:28.665949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1230/2496] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:46:28 2022] DELETE /identity/v3/users/672b4989962f4710b95ba9c26b9e0c6a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:46:28.671223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a490e0-05a0-40f3-ae0d-41500e18644a None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:28.671529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a490e0-05a0-40f3-ae0d-41500e18644a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:28.671809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a490e0-05a0-40f3-ae0d-41500e18644a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:28.696845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-41a490e0-05a0-40f3-ae0d-41500e18644a None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:28.698027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-41a490e0-05a0-40f3-ae0d-41500e18644a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:28.714711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08507f16-5630-4133-8013-209b89db8181 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:28.758080 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1231/2497] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:46:28.765651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedf0fe-6908-4ce1-8564-ad4282d19abd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:28.766380 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedf0fe-6908-4ce1-8564-ad4282d19abd service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:28.766685 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedf0fe-6908-4ce1-8564-ad4282d19abd service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:28.766960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedf0fe-6908-4ce1-8564-ad4282d19abd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:28.768454 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a490e0-05a0-40f3-ae0d-41500e18644a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:28.768828 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9fedf0fe-6908-4ce1-8564-ad4282d19abd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:28.769864 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-41a490e0-05a0-40f3-ae0d-41500e18644a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:28.821283 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:28.827942 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a490e0-05a0-40f3-ae0d-41500e18644a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:28.832497 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:28.832721 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad733b-0442-4100-bb9e-c2c380a38fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:28.833510 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad733b-0442-4100-bb9e-c2c380a38fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:28.833946 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad733b-0442-4100-bb9e-c2c380a38fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:28.834283 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad733b-0442-4100-bb9e-c2c380a38fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:28.835557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fedf0fe-6908-4ce1-8564-ad4282d19abd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:28.837569 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fedf0fe-6908-4ce1-8564-ad4282d19abd service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:28.844429 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad733b-0442-4100-bb9e-c2c380a38fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:28.845842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad733b-0442-4100-bb9e-c2c380a38fa8 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:28.847070 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1267/2498] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:28 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:28.856308 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1232/2499] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:46:29.156931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedf0fe-6908-4ce1-8564-ad4282d19abd service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:29.158618 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9fedf0fe-6908-4ce1-8564-ad4282d19abd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:29.174436 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedf0fe-6908-4ce1-8564-ad4282d19abd service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:29.179421 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bdc4a-ce71-4351-a6af-63fad07b6b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:29.180380 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bdc4a-ce71-4351-a6af-63fad07b6b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:29.180659 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bdc4a-ce71-4351-a6af-63fad07b6b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:29.180927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bdc4a-ce71-4351-a6af-63fad07b6b4b admin admin] PATH_INFO: `/v3/projects/7a29c07e1eb24423a7e4a1d3aa4c2e5f` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:29.182674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bdc4a-ce71-4351-a6af-63fad07b6b4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a29c07e1eb24423a7e4a1d3aa4c2e5f)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:29.184853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bdc4a-ce71-4351-a6af-63fad07b6b4b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:29.240070 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2b7bdc4a-ce71-4351-a6af-63fad07b6b4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a29c07e1eb24423a7e4a1d3aa4c2e5f', 'request_id': 'req-2b7bdc4a-ce71-4351-a6af-63fad07b6b4b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:29.245895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2b7bdc4a-ce71-4351-a6af-63fad07b6b4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a29c07e1eb24423a7e4a1d3aa4c2e5f', 'request_id': 'req-2b7bdc4a-ce71-4351-a6af-63fad07b6b4b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:29.256079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2b7bdc4a-ce71-4351-a6af-63fad07b6b4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a29c07e1eb24423a7e4a1d3aa4c2e5f', 'request_id': 'req-2b7bdc4a-ce71-4351-a6af-63fad07b6b4b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:29.272044 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2b7bdc4a-ce71-4351-a6af-63fad07b6b4b admin admin] The token cache is being invalidate because project 7a29c07e1eb24423a7e4a1d3aa4c2e5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:46:29.272817 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2b7bdc4a-ce71-4351-a6af-63fad07b6b4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:29.273382 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2b7bdc4a-ce71-4351-a6af-63fad07b6b4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:29.275615 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1268/2500] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:46:29 2022] DELETE /identity/v3/projects/7a29c07e1eb24423a7e4a1d3aa4c2e5f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:29.280597 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeae2eb-b3a5-49a7-92b4-1914804abb98 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:29.280889 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeae2eb-b3a5-49a7-92b4-1914804abb98 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:29.281165 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeae2eb-b3a5-49a7-92b4-1914804abb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:29.287919 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bdc4a-ce71-4351-a6af-63fad07b6b4b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:29.289394 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2b7bdc4a-ce71-4351-a6af-63fad07b6b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:29.301426 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-9aeae2eb-b3a5-49a7-92b4-1914804abb98 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:29.302651 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9aeae2eb-b3a5-49a7-92b4-1914804abb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:29.357424 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bdc4a-ce71-4351-a6af-63fad07b6b4b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:29.362101 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888047bf-2855-453f-8e04-b0175b1cd5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:29.363020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888047bf-2855-453f-8e04-b0175b1cd5a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:29.363300 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888047bf-2855-453f-8e04-b0175b1cd5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:29.363572 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888047bf-2855-453f-8e04-b0175b1cd5a0 admin admin] PATH_INFO: `/v3/users/53fa91203ff347e58ef0517341be4520` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:29.364774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888047bf-2855-453f-8e04-b0175b1cd5a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53fa91203ff347e58ef0517341be4520)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:29.366748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888047bf-2855-453f-8e04-b0175b1cd5a0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:29.368677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1233/2501] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:46:29.376272 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598886a1-b9c8-4556-9a67-ad515ae7b527 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:29.376559 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598886a1-b9c8-4556-9a67-ad515ae7b527 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:29.376833 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598886a1-b9c8-4556-9a67-ad515ae7b527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:29.396528 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-598886a1-b9c8-4556-9a67-ad515ae7b527 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:29.397850 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-598886a1-b9c8-4556-9a67-ad515ae7b527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:29.408502 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1234/2502] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:46:29.413346 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598886a1-b9c8-4556-9a67-ad515ae7b527 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:29.423264 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598886a1-b9c8-4556-9a67-ad515ae7b527 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:29.425020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-888047bf-2855-453f-8e04-b0175b1cd5a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53fa91203ff347e58ef0517341be4520'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:29.428273 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdacfe47-36a6-4831-a7fb-f916332424cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:29.428932 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacfe47-36a6-4831-a7fb-f916332424cd admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:29.429398 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacfe47-36a6-4831-a7fb-f916332424cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:29.429587 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacfe47-36a6-4831-a7fb-f916332424cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:29.430519 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdacfe47-36a6-4831-a7fb-f916332424cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:46:29.431308 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdacfe47-36a6-4831-a7fb-f916332424cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:29.433048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdacfe47-36a6-4831-a7fb-f916332424cd admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:29.433795 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-888047bf-2855-453f-8e04-b0175b1cd5a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53fa91203ff347e58ef0517341be4520'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:29.434423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-888047bf-2855-453f-8e04-b0175b1cd5a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53fa91203ff347e58ef0517341be4520'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:29.448761 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1235/2503] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:46:29.448963 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-888047bf-2855-453f-8e04-b0175b1cd5a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53fa91203ff347e58ef0517341be4520'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:29.448963 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-888047bf-2855-453f-8e04-b0175b1cd5a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53fa91203ff347e58ef0517341be4520'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:29.450280 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdacfe47-36a6-4831-a7fb-f916332424cd admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:29.451986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-bdacfe47-36a6-4831-a7fb-f916332424cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:29.456656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:29.462587 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1269/2504] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:46:29 2022] DELETE /identity/v3/users/53fa91203ff347e58ef0517341be4520 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:29.467403 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4d05e-6787-4777-a779-40552458577b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:29.467995 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4d05e-6787-4777-a779-40552458577b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:29.468367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdacfe47-36a6-4831-a7fb-f916332424cd admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:29.468685 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4d05e-6787-4777-a779-40552458577b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:29.488353 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4bd4d05e-6787-4777-a779-40552458577b None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:29.489587 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4bd4d05e-6787-4777-a779-40552458577b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:29.524554 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469bec9-474e-407f-9b7b-572113eb9146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:29.525780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469bec9-474e-407f-9b7b-572113eb9146 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:29.525780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469bec9-474e-407f-9b7b-572113eb9146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:29.525780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469bec9-474e-407f-9b7b-572113eb9146 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:29.526112 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469bec9-474e-407f-9b7b-572113eb9146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:29.528044 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469bec9-474e-407f-9b7b-572113eb9146 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:29.550985 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1270/2505] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:46:29.558155 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1236/2506] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:46:29 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:46:29.559132 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4d05e-6787-4777-a779-40552458577b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:29.561285 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469bec9-474e-407f-9b7b-572113eb9146 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:29.563277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0469bec9-474e-407f-9b7b-572113eb9146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:29.569586 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4d05e-6787-4777-a779-40552458577b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:29.627142 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469bec9-474e-407f-9b7b-572113eb9146 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:29.632919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a7a1e-738a-44d3-9513-2618f4ea811c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:29.633985 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a7a1e-738a-44d3-9513-2618f4ea811c service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:29.634454 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a7a1e-738a-44d3-9513-2618f4ea811c service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:29.634957 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a7a1e-738a-44d3-9513-2618f4ea811c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:29.639336 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f151428-ca89-440e-91d7-d8e50e5af421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:29.640421 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f151428-ca89-440e-91d7-d8e50e5af421 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:29.640871 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f151428-ca89-440e-91d7-d8e50e5af421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:29.641423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f151428-ca89-440e-91d7-d8e50e5af421 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:29.642558 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f151428-ca89-440e-91d7-d8e50e5af421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:29.645947 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f151428-ca89-440e-91d7-d8e50e5af421 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:29.650141 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a7a1e-738a-44d3-9513-2618f4ea811c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:29.652338 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a7a1e-738a-44d3-9513-2618f4ea811c service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:29.658455 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:29.668658 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1237/2507] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:29.674444 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1271/2508] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:46:29 2022] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:46:29.678947 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a7a1e-738a-44d3-9513-2618f4ea811c service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:29.689456 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a7a1e-738a-44d3-9513-2618f4ea811c service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:29.695608 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fd62e-becd-453b-8812-713fc36e672b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:29.696476 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fd62e-becd-453b-8812-713fc36e672b admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:29.696957 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fd62e-becd-453b-8812-713fc36e672b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:29.697168 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fd62e-becd-453b-8812-713fc36e672b admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:29.697965 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fd62e-becd-453b-8812-713fc36e672b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:29.699681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fd62e-becd-453b-8812-713fc36e672b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:29.711051 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1238/2509] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:46:29.715586 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f151428-ca89-440e-91d7-d8e50e5af421 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:29.726385 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f151428-ca89-440e-91d7-d8e50e5af421 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:29.732715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa76baf-a653-4b47-b1ce-f4fed965e293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:29.733394 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa76baf-a653-4b47-b1ce-f4fed965e293 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:29.733721 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa76baf-a653-4b47-b1ce-f4fed965e293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:29.733995 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa76baf-a653-4b47-b1ce-f4fed965e293 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:29.734784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa76baf-a653-4b47-b1ce-f4fed965e293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:29.736389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa76baf-a653-4b47-b1ce-f4fed965e293 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:29.747693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1272/2510] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:46:29.752165 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fd62e-becd-453b-8812-713fc36e672b admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:29.764800 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fd62e-becd-453b-8812-713fc36e672b admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:29.770476 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2eb07a-897a-4c35-bbc3-4c61e3842d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:29.771413 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2eb07a-897a-4c35-bbc3-4c61e3842d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:29.771691 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2eb07a-897a-4c35-bbc3-4c61e3842d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:29.771966 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2eb07a-897a-4c35-bbc3-4c61e3842d9d admin admin] PATH_INFO: `/v3/projects/357b81c098e04662a4b794cae3a3d181/users/adb887da93534a9cb682034b8945cf7b/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:29.787325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2eb07a-897a-4c35-bbc3-4c61e3842d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=357b81c098e04662a4b794cae3a3d181, user_id=adb887da93534a9cb682034b8945cf7b, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:29.790066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2eb07a-897a-4c35-bbc3-4c61e3842d9d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:29.803881 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1239/2511] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:46:29 2022] PUT /identity/v3/projects/357b81c098e04662a4b794cae3a3d181/users/adb887da93534a9cb682034b8945cf7b/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:46:29.818073 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13e8c0-72e5-4869-85f6-09750eed0509 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:29.818073 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13e8c0-72e5-4869-85f6-09750eed0509 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:29.818073 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13e8c0-72e5-4869-85f6-09750eed0509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:29.850513 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2f13e8c0-72e5-4869-85f6-09750eed0509 None None] MFA Rules not processed for user `adb887da93534a9cb682034b8945cf7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:29.851762 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2f13e8c0-72e5-4869-85f6-09750eed0509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:29.919805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1273/2512] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:29.924612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2eb07a-897a-4c35-bbc3-4c61e3842d9d admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:29.949413 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13e8c0-72e5-4869-85f6-09750eed0509 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:29.951459 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2f13e8c0-72e5-4869-85f6-09750eed0509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:29.964120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:29.994231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2eb07a-897a-4c35-bbc3-4c61e3842d9d admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:29.998971 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688fac6-8df0-49bc-acc9-156e34ce90fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:29.999737 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688fac6-8df0-49bc-acc9-156e34ce90fa admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:30.000005 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688fac6-8df0-49bc-acc9-156e34ce90fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:30.000276 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688fac6-8df0-49bc-acc9-156e34ce90fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:30.000966 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688fac6-8df0-49bc-acc9-156e34ce90fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:30.002900 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688fac6-8df0-49bc-acc9-156e34ce90fa admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:30.027084 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13e8c0-72e5-4869-85f6-09750eed0509 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:30.028939 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1240/2513] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:46:29 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:46:30.033017 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688fac6-8df0-49bc-acc9-156e34ce90fa admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:30.083070 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d837f-0e5d-4e61-a099-4fa9b4d5efab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:30.084270 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d837f-0e5d-4e61-a099-4fa9b4d5efab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:30.084549 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d837f-0e5d-4e61-a099-4fa9b4d5efab admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:30.084820 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d837f-0e5d-4e61-a099-4fa9b4d5efab admin admin] PATH_INFO: `/v3/projects/0346769299f24fa69673ae623cbc3c47` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:30.085988 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d837f-0e5d-4e61-a099-4fa9b4d5efab admin admin] RBAC: Authorizing `identity:delete_project(project_id=0346769299f24fa69673ae623cbc3c47)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:30.088126 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d837f-0e5d-4e61-a099-4fa9b4d5efab admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:30.094273 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688fac6-8df0-49bc-acc9-156e34ce90fa admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:30.099411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705bffc-3f18-425f-8963-d292cb9d9083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:30.100085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705bffc-3f18-425f-8963-d292cb9d9083 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:30.100363 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705bffc-3f18-425f-8963-d292cb9d9083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:30.101901 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705bffc-3f18-425f-8963-d292cb9d9083 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:30.102981 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705bffc-3f18-425f-8963-d292cb9d9083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:30.105123 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705bffc-3f18-425f-8963-d292cb9d9083 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:30.130747 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1241/2514] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:46:30 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:46:30.131949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705bffc-3f18-425f-8963-d292cb9d9083 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:30.138180 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c48d837f-0e5d-4e61-a099-4fa9b4d5efab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0346769299f24fa69673ae623cbc3c47', 'request_id': 'req-c48d837f-0e5d-4e61-a099-4fa9b4d5efab'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:30.143936 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705bffc-3f18-425f-8963-d292cb9d9083 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:30.144581 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c48d837f-0e5d-4e61-a099-4fa9b4d5efab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0346769299f24fa69673ae623cbc3c47', 'request_id': 'req-c48d837f-0e5d-4e61-a099-4fa9b4d5efab'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:30.152134 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c48d837f-0e5d-4e61-a099-4fa9b4d5efab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0346769299f24fa69673ae623cbc3c47', 'request_id': 'req-c48d837f-0e5d-4e61-a099-4fa9b4d5efab'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:30.168352 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c48d837f-0e5d-4e61-a099-4fa9b4d5efab admin admin] The token cache is being invalidate because project 0346769299f24fa69673ae623cbc3c47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:46:30.169007 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c48d837f-0e5d-4e61-a099-4fa9b4d5efab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:30.169610 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c48d837f-0e5d-4e61-a099-4fa9b4d5efab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:30.171509 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1274/2515] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:46:29 2022] DELETE /identity/v3/projects/0346769299f24fa69673ae623cbc3c47 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:30.174893 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d837f-0e5d-4e61-a099-4fa9b4d5efab admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:30.176226 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c48d837f-0e5d-4e61-a099-4fa9b4d5efab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:30.178670 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:30.203468 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff46ca1-c72d-41e9-9b58-d32ecbc5af71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:30.204145 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff46ca1-c72d-41e9-9b58-d32ecbc5af71 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:30.204450 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff46ca1-c72d-41e9-9b58-d32ecbc5af71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:30.204723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff46ca1-c72d-41e9-9b58-d32ecbc5af71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:30.205453 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff46ca1-c72d-41e9-9b58-d32ecbc5af71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:30.207091 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff46ca1-c72d-41e9-9b58-d32ecbc5af71 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:30.220438 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1242/2516] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:46:30.221318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff46ca1-c72d-41e9-9b58-d32ecbc5af71 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:30.223099 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5ff46ca1-c72d-41e9-9b58-d32ecbc5af71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:30.225251 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:30.236209 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff46ca1-c72d-41e9-9b58-d32ecbc5af71 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:30.241136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b3228-4f41-43e1-95ee-7d6f09252d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:30.242035 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b3228-4f41-43e1-95ee-7d6f09252d74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:30.242318 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b3228-4f41-43e1-95ee-7d6f09252d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:30.242615 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b3228-4f41-43e1-95ee-7d6f09252d74 admin admin] PATH_INFO: `/v3/projects/d3927d14cd464ffa867870b44cafbe1e/users/a1d804efd18b40f1bbf99d9798afe8c9/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:30.248669 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d837f-0e5d-4e61-a099-4fa9b4d5efab admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:30.253612 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd5c54-3e80-4226-aab8-13ea2f303f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:30.254581 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd5c54-3e80-4226-aab8-13ea2f303f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:30.254943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd5c54-3e80-4226-aab8-13ea2f303f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:30.255415 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd5c54-3e80-4226-aab8-13ea2f303f23 admin admin] PATH_INFO: `/v3/users/f767053f36e449b087bf3ba020f52616` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:30.256693 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd5c54-3e80-4226-aab8-13ea2f303f23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f767053f36e449b087bf3ba020f52616)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:30.258031 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b3228-4f41-43e1-95ee-7d6f09252d74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3927d14cd464ffa867870b44cafbe1e, user_id=a1d804efd18b40f1bbf99d9798afe8c9, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:30.259583 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd5c54-3e80-4226-aab8-13ea2f303f23 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:30.261265 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b3228-4f41-43e1-95ee-7d6f09252d74 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:30.275482 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1243/2517] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:46:30 2022] PUT /identity/v3/projects/d3927d14cd464ffa867870b44cafbe1e/users/a1d804efd18b40f1bbf99d9798afe8c9/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:46:30.279351 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b3228-4f41-43e1-95ee-7d6f09252d74 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:30.310079 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a8dd5c54-3e80-4226-aab8-13ea2f303f23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f767053f36e449b087bf3ba020f52616'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:30.318388 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a8dd5c54-3e80-4226-aab8-13ea2f303f23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f767053f36e449b087bf3ba020f52616'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:30.319030 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a8dd5c54-3e80-4226-aab8-13ea2f303f23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f767053f36e449b087bf3ba020f52616'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:30.331836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a8dd5c54-3e80-4226-aab8-13ea2f303f23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f767053f36e449b087bf3ba020f52616'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:30.332506 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a8dd5c54-3e80-4226-aab8-13ea2f303f23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f767053f36e449b087bf3ba020f52616'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:30.344701 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1275/2518] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:46:30 2022] DELETE /identity/v3/users/f767053f36e449b087bf3ba020f52616 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:30.346961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b3228-4f41-43e1-95ee-7d6f09252d74 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:30.405277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659bdc1-de07-41b7-be37-25225520f0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:30.405970 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659bdc1-de07-41b7-be37-25225520f0dd admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:30.406235 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659bdc1-de07-41b7-be37-25225520f0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:30.406540 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659bdc1-de07-41b7-be37-25225520f0dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:30.407348 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659bdc1-de07-41b7-be37-25225520f0dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:30.408922 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659bdc1-de07-41b7-be37-25225520f0dd admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:30.419769 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1244/2519] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:46:30.424357 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd5c54-3e80-4226-aab8-13ea2f303f23 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:30.425737 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a8dd5c54-3e80-4226-aab8-13ea2f303f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:30.440119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd5c54-3e80-4226-aab8-13ea2f303f23 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:30.445628 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de730a-dad5-4142-92cb-d0452f305669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:30.447183 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de730a-dad5-4142-92cb-d0452f305669 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:30.447463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de730a-dad5-4142-92cb-d0452f305669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:30.447743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de730a-dad5-4142-92cb-d0452f305669 admin admin] PATH_INFO: `/v3/projects/d3927d14cd464ffa867870b44cafbe1e/users/a1d804efd18b40f1bbf99d9798afe8c9/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:30.449973 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de730a-dad5-4142-92cb-d0452f305669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3927d14cd464ffa867870b44cafbe1e, user_id=a1d804efd18b40f1bbf99d9798afe8c9, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:30.452661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de730a-dad5-4142-92cb-d0452f305669 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:30.464221 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1276/2520] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:46:30 2022] PUT /identity/v3/projects/d3927d14cd464ffa867870b44cafbe1e/users/a1d804efd18b40f1bbf99d9798afe8c9/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:30.474624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bf785-f660-4cc4-9f33-c6b030ef7d14 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:30.474914 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bf785-f660-4cc4-9f33-c6b030ef7d14 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:30.475185 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bf785-f660-4cc4-9f33-c6b030ef7d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:30.507027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-056bf785-f660-4cc4-9f33-c6b030ef7d14 None None] MFA Rules not processed for user `a1d804efd18b40f1bbf99d9798afe8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:30.508308 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-056bf785-f660-4cc4-9f33-c6b030ef7d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:30.552232 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:30.583739 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1245/2521] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:30 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:30.595179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de730a-dad5-4142-92cb-d0452f305669 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:30.596933 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-79de730a-dad5-4142-92cb-d0452f305669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:30.632327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056bf785-f660-4cc4-9f33-c6b030ef7d14 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:30.634307 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-056bf785-f660-4cc4-9f33-c6b030ef7d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:30.676830 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de730a-dad5-4142-92cb-d0452f305669 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:30.680761 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c57fa7-317b-4539-8088-7913e279c542 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:30.681416 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c57fa7-317b-4539-8088-7913e279c542 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:30.681726 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c57fa7-317b-4539-8088-7913e279c542 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:30.681977 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c57fa7-317b-4539-8088-7913e279c542 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:30.691960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c57fa7-317b-4539-8088-7913e279c542 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:30.693403 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c57fa7-317b-4539-8088-7913e279c542 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:30.703453 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1277/2522] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:30 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:30.707758 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056bf785-f660-4cc4-9f33-c6b030ef7d14 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:30.712444 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cbd7f-c839-4da4-acdd-c3675942297f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:30.713315 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cbd7f-c839-4da4-acdd-c3675942297f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:30.713592 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cbd7f-c839-4da4-acdd-c3675942297f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:30.713861 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cbd7f-c839-4da4-acdd-c3675942297f admin admin] PATH_INFO: `/v3/projects/fba63c736b444daab3b2076822eb18c1` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:30.715068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3cbd7f-c839-4da4-acdd-c3675942297f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba63c736b444daab3b2076822eb18c1)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:30.717045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3cbd7f-c839-4da4-acdd-c3675942297f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:30.771733 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8b3cbd7f-c839-4da4-acdd-c3675942297f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba63c736b444daab3b2076822eb18c1', 'request_id': 'req-8b3cbd7f-c839-4da4-acdd-c3675942297f'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:30.777387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8b3cbd7f-c839-4da4-acdd-c3675942297f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba63c736b444daab3b2076822eb18c1', 'request_id': 'req-8b3cbd7f-c839-4da4-acdd-c3675942297f'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:30.779382 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c57fa7-317b-4539-8088-7913e279c542 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:30.784365 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8b3cbd7f-c839-4da4-acdd-c3675942297f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba63c736b444daab3b2076822eb18c1', 'request_id': 'req-8b3cbd7f-c839-4da4-acdd-c3675942297f'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:30.788393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c57fa7-317b-4539-8088-7913e279c542 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:30.797235 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8b3cbd7f-c839-4da4-acdd-c3675942297f admin admin] The token cache is being invalidate because project fba63c736b444daab3b2076822eb18c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:46:30.797615 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8b3cbd7f-c839-4da4-acdd-c3675942297f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:30.798333 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8b3cbd7f-c839-4da4-acdd-c3675942297f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:30.800208 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1246/2523] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:46:30 2022] DELETE /identity/v3/projects/fba63c736b444daab3b2076822eb18c1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:46:30.804890 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0588173-957d-4543-995f-a5e5e1e49d1c None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:30.805338 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0588173-957d-4543-995f-a5e5e1e49d1c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:30.805632 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0588173-957d-4543-995f-a5e5e1e49d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:30.823745 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-f0588173-957d-4543-995f-a5e5e1e49d1c None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:30.824970 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f0588173-957d-4543-995f-a5e5e1e49d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:30.838493 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00f14c-110f-43ad-9b61-fa610e31a27d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:30.839195 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00f14c-110f-43ad-9b61-fa610e31a27d service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:30.839478 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00f14c-110f-43ad-9b61-fa610e31a27d service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:30.839754 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00f14c-110f-43ad-9b61-fa610e31a27d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:30.841626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-db00f14c-110f-43ad-9b61-fa610e31a27d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:30.847918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:30.889218 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1247/2524] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:46:30.897036 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df356542-e422-4c77-bbde-ddffabd5fd55 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:30.897317 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df356542-e422-4c77-bbde-ddffabd5fd55 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:30.897585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df356542-e422-4c77-bbde-ddffabd5fd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:30.902350 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00f14c-110f-43ad-9b61-fa610e31a27d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:30.904016 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00f14c-110f-43ad-9b61-fa610e31a27d service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:30.913715 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1278/2525] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:30.917234 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-df356542-e422-4c77-bbde-ddffabd5fd55 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:30.918425 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-df356542-e422-4c77-bbde-ddffabd5fd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:30.926443 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1248/2526] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:46:30.931232 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00f14c-110f-43ad-9b61-fa610e31a27d service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:30.941722 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00f14c-110f-43ad-9b61-fa610e31a27d service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:30.946700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c9965-6157-438c-a1ad-4465996a8a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:30.947358 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c9965-6157-438c-a1ad-4465996a8a82 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:30.947639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c9965-6157-438c-a1ad-4465996a8a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:30.947911 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c9965-6157-438c-a1ad-4465996a8a82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:30.948630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c9965-6157-438c-a1ad-4465996a8a82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:46:30.948937 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c9965-6157-438c-a1ad-4465996a8a82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:30.950506 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c9965-6157-438c-a1ad-4465996a8a82 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:30.963115 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1279/2527] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:46:30.967758 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df356542-e422-4c77-bbde-ddffabd5fd55 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:30.972647 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:30.979668 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df356542-e422-4c77-bbde-ddffabd5fd55 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:30.986357 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851d1c0-2b3e-48e3-9695-4a3d71a0a368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:30.987090 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851d1c0-2b3e-48e3-9695-4a3d71a0a368 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:30.987366 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851d1c0-2b3e-48e3-9695-4a3d71a0a368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:30.987631 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851d1c0-2b3e-48e3-9695-4a3d71a0a368 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:30.988315 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851d1c0-2b3e-48e3-9695-4a3d71a0a368 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:30.990195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851d1c0-2b3e-48e3-9695-4a3d71a0a368 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:31.026282 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1249/2528] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:46:30 2022] POST /identity/v3/projects => generated 393 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:46:31.030723 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c9965-6157-438c-a1ad-4465996a8a82 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:31.043730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c9965-6157-438c-a1ad-4465996a8a82 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:31.108405 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276efbb-092b-4a79-85d6-5760f18a52e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:31.109080 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276efbb-092b-4a79-85d6-5760f18a52e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:31.109363 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276efbb-092b-4a79-85d6-5760f18a52e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:31.109661 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276efbb-092b-4a79-85d6-5760f18a52e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:31.110368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276efbb-092b-4a79-85d6-5760f18a52e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:31.112325 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276efbb-092b-4a79-85d6-5760f18a52e4 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:31.131770 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1280/2529] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:46:31 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:46:31.136743 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851d1c0-2b3e-48e3-9695-4a3d71a0a368 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:31.147427 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851d1c0-2b3e-48e3-9695-4a3d71a0a368 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:31.152732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec6d49-612d-44e3-b51c-4f931e02817d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:31.153394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec6d49-612d-44e3-b51c-4f931e02817d admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:31.153669 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec6d49-612d-44e3-b51c-4f931e02817d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:31.153934 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec6d49-612d-44e3-b51c-4f931e02817d admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:31.154684 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec6d49-612d-44e3-b51c-4f931e02817d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:31.156363 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec6d49-612d-44e3-b51c-4f931e02817d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:31.167365 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1250/2530] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:46:31.171911 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276efbb-092b-4a79-85d6-5760f18a52e4 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:31.187730 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276efbb-092b-4a79-85d6-5760f18a52e4 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:31.194553 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480744f-31b5-442a-9cc6-e6da1d957508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:31.195355 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480744f-31b5-442a-9cc6-e6da1d957508 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:31.195636 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480744f-31b5-442a-9cc6-e6da1d957508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:31.195975 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480744f-31b5-442a-9cc6-e6da1d957508 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:31.196744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480744f-31b5-442a-9cc6-e6da1d957508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:31.198341 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480744f-31b5-442a-9cc6-e6da1d957508 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:31.209138 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1281/2531] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:46:31.213650 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec6d49-612d-44e3-b51c-4f931e02817d admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:31.227304 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec6d49-612d-44e3-b51c-4f931e02817d admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:31.232374 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e97aa0-01be-4244-8f75-7eb59684e5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:31.233323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e97aa0-01be-4244-8f75-7eb59684e5b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:31.233597 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e97aa0-01be-4244-8f75-7eb59684e5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:31.233873 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e97aa0-01be-4244-8f75-7eb59684e5b4 admin admin] PATH_INFO: `/v3/projects/f991cc76330f492891f2a3cfd8e1a846/users/426f3ba8efb1488e80572c2de05184f1/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:31.249317 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e97aa0-01be-4244-8f75-7eb59684e5b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f991cc76330f492891f2a3cfd8e1a846, user_id=426f3ba8efb1488e80572c2de05184f1, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:31.252054 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e97aa0-01be-4244-8f75-7eb59684e5b4 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:31.267489 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1251/2532] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:46:31 2022] PUT /identity/v3/projects/f991cc76330f492891f2a3cfd8e1a846/users/426f3ba8efb1488e80572c2de05184f1/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:31.279347 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdfe14-a93b-474c-965a-8bee2b4265a3 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:31.279645 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdfe14-a93b-474c-965a-8bee2b4265a3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:31.279929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdfe14-a93b-474c-965a-8bee2b4265a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:31.310887 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a0bdfe14-a93b-474c-965a-8bee2b4265a3 None None] MFA Rules not processed for user `426f3ba8efb1488e80572c2de05184f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:31.312133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a0bdfe14-a93b-474c-965a-8bee2b4265a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:31.384322 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1282/2533] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:31.391641 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e97aa0-01be-4244-8f75-7eb59684e5b4 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:31.462535 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e97aa0-01be-4244-8f75-7eb59684e5b4 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:31.467870 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2a762-8197-45c8-8039-08b00401374e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:31.468519 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2a762-8197-45c8-8039-08b00401374e admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:31.468792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2a762-8197-45c8-8039-08b00401374e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:31.469062 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2a762-8197-45c8-8039-08b00401374e admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:31.469736 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2a762-8197-45c8-8039-08b00401374e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:31.471672 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2a762-8197-45c8-8039-08b00401374e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:31.500157 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1252/2534] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:46:31 2022] POST /identity/v3/projects => generated 389 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:46:31.504226 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdfe14-a93b-474c-965a-8bee2b4265a3 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:31.510037 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:31.516959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdfe14-a93b-474c-965a-8bee2b4265a3 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:31.578978 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212919d-6586-491c-8609-6b466b5b427c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:31.579659 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212919d-6586-491c-8609-6b466b5b427c admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:31.579945 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212919d-6586-491c-8609-6b466b5b427c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:31.580215 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212919d-6586-491c-8609-6b466b5b427c admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:31.580909 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212919d-6586-491c-8609-6b466b5b427c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:31.582859 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212919d-6586-491c-8609-6b466b5b427c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:31.604690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1283/2535] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:46:31 2022] POST /identity/v3/users => generated 301 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:46:31.608917 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2a762-8197-45c8-8039-08b00401374e admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:31.619793 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2a762-8197-45c8-8039-08b00401374e admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:31.624903 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348530ae-d210-4d50-a742-02c2a4722298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:31.625557 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348530ae-d210-4d50-a742-02c2a4722298 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:31.626029 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348530ae-d210-4d50-a742-02c2a4722298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:31.626246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348530ae-d210-4d50-a742-02c2a4722298 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:31.627030 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348530ae-d210-4d50-a742-02c2a4722298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:31.628621 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348530ae-d210-4d50-a742-02c2a4722298 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:31.640337 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1253/2536] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:46:31.646875 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212919d-6586-491c-8609-6b466b5b427c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:31.658244 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212919d-6586-491c-8609-6b466b5b427c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:31.664006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b0d60-43ce-4842-89f0-758599b4aa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:31.665048 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b0d60-43ce-4842-89f0-758599b4aa66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:31.665328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b0d60-43ce-4842-89f0-758599b4aa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:31.665581 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b0d60-43ce-4842-89f0-758599b4aa66 admin admin] PATH_INFO: `/v3/projects/ecfc818f7f1f46c6b0d69ae217222e86/users/4593c06618b042b6b79a81a220e87f17/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:31.680935 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b0d60-43ce-4842-89f0-758599b4aa66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecfc818f7f1f46c6b0d69ae217222e86, user_id=4593c06618b042b6b79a81a220e87f17, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:31.683698 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b0d60-43ce-4842-89f0-758599b4aa66 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:31.699089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1284/2537] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:46:31 2022] PUT /identity/v3/projects/ecfc818f7f1f46c6b0d69ae217222e86/users/4593c06618b042b6b79a81a220e87f17/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:31.703331 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348530ae-d210-4d50-a742-02c2a4722298 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:31.714546 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348530ae-d210-4d50-a742-02c2a4722298 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:31.789523 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70223fd4-e97b-485d-b0bb-fa3e551b0c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:31.790529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70223fd4-e97b-485d-b0bb-fa3e551b0c44 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:31.790840 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70223fd4-e97b-485d-b0bb-fa3e551b0c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:31.791113 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70223fd4-e97b-485d-b0bb-fa3e551b0c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:31.791844 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70223fd4-e97b-485d-b0bb-fa3e551b0c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:31.793449 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70223fd4-e97b-485d-b0bb-fa3e551b0c44 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:31.804050 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1254/2538] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:46:31.808658 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b0d60-43ce-4842-89f0-758599b4aa66 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:31.819757 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b0d60-43ce-4842-89f0-758599b4aa66 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:31.825792 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c13f4b-beaa-4510-8bfb-542b605edd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:31.826713 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c13f4b-beaa-4510-8bfb-542b605edd3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:31.826992 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c13f4b-beaa-4510-8bfb-542b605edd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:31.827264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c13f4b-beaa-4510-8bfb-542b605edd3f admin admin] PATH_INFO: `/v3/projects/ecfc818f7f1f46c6b0d69ae217222e86/users/4593c06618b042b6b79a81a220e87f17/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:31.829686 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c13f4b-beaa-4510-8bfb-542b605edd3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecfc818f7f1f46c6b0d69ae217222e86, user_id=4593c06618b042b6b79a81a220e87f17, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:31.833528 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c13f4b-beaa-4510-8bfb-542b605edd3f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:31.844558 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1285/2539] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:46:31 2022] PUT /identity/v3/projects/ecfc818f7f1f46c6b0d69ae217222e86/users/4593c06618b042b6b79a81a220e87f17/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:46:31.854975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f9b52-214c-43d2-affc-36f855820e47 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:31.855281 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f9b52-214c-43d2-affc-36f855820e47 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:31.855555 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f9b52-214c-43d2-affc-36f855820e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:31.881865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-671f9b52-214c-43d2-affc-36f855820e47 None None] MFA Rules not processed for user `4593c06618b042b6b79a81a220e87f17`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:31.883116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-671f9b52-214c-43d2-affc-36f855820e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:31.887812 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:31.957343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1255/2540] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:31 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:31.970706 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c13f4b-beaa-4510-8bfb-542b605edd3f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:31.972202 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-99c13f4b-beaa-4510-8bfb-542b605edd3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:32.029363 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c13f4b-beaa-4510-8bfb-542b605edd3f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:32.033164 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942f5e2-7e00-4a81-9758-d9202b68101d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:32.033805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942f5e2-7e00-4a81-9758-d9202b68101d service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:32.034080 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942f5e2-7e00-4a81-9758-d9202b68101d service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:32.034351 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942f5e2-7e00-4a81-9758-d9202b68101d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:32.044008 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942f5e2-7e00-4a81-9758-d9202b68101d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:32.045460 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942f5e2-7e00-4a81-9758-d9202b68101d service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:32.057812 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1286/2541] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:31 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:32.114526 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f9b52-214c-43d2-affc-36f855820e47 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:32.125009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f9b52-214c-43d2-affc-36f855820e47 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:32.128941 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c938ffd-0b56-4856-a743-5a709605f0a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:32.129599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c938ffd-0b56-4856-a743-5a709605f0a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:32.129878 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c938ffd-0b56-4856-a743-5a709605f0a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:32.130150 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c938ffd-0b56-4856-a743-5a709605f0a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:32.190436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c938ffd-0b56-4856-a743-5a709605f0a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:32.191927 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c938ffd-0b56-4856-a743-5a709605f0a5 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:32.201480 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1256/2542] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:35.730449 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942f5e2-7e00-4a81-9758-d9202b68101d service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:35.786991 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:35.792074 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942f5e2-7e00-4a81-9758-d9202b68101d service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:35.799457 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63814b4-697b-40ba-a6a0-471bb9213a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:35.800727 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63814b4-697b-40ba-a6a0-471bb9213a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:35.801146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63814b4-697b-40ba-a6a0-471bb9213a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:35.801558 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63814b4-697b-40ba-a6a0-471bb9213a6f admin admin] PATH_INFO: `/v3/users/426f3ba8efb1488e80572c2de05184f1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:35.803476 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63814b4-697b-40ba-a6a0-471bb9213a6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=426f3ba8efb1488e80572c2de05184f1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:35.806655 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63814b4-697b-40ba-a6a0-471bb9213a6f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:35.875662 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c63814b4-697b-40ba-a6a0-471bb9213a6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '426f3ba8efb1488e80572c2de05184f1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:35.885932 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c63814b4-697b-40ba-a6a0-471bb9213a6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '426f3ba8efb1488e80572c2de05184f1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:35.886653 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c63814b4-697b-40ba-a6a0-471bb9213a6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '426f3ba8efb1488e80572c2de05184f1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:35.899916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c63814b4-697b-40ba-a6a0-471bb9213a6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '426f3ba8efb1488e80572c2de05184f1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:35.900368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c63814b4-697b-40ba-a6a0-471bb9213a6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '426f3ba8efb1488e80572c2de05184f1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:35.912823 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1287/2543] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:46:35 2022] DELETE /identity/v3/users/426f3ba8efb1488e80572c2de05184f1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:35.917553 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4c794-b41e-4805-816a-b53787728dc0 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:35.918038 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4c794-b41e-4805-816a-b53787728dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:35.918165 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4c794-b41e-4805-816a-b53787728dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:35.937010 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-6bb4c794-b41e-4805-816a-b53787728dc0 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:35.938188 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6bb4c794-b41e-4805-816a-b53787728dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:36.011773 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1257/2544] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:46:36.022072 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63814b4-697b-40ba-a6a0-471bb9213a6f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:36.023622 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c63814b4-697b-40ba-a6a0-471bb9213a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:36.085119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63814b4-697b-40ba-a6a0-471bb9213a6f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:36.090089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e46b1-3e28-4966-8cff-55b736b3d1ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:36.090793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e46b1-3e28-4966-8cff-55b736b3d1ec service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:36.091071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e46b1-3e28-4966-8cff-55b736b3d1ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:36.091346 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e46b1-3e28-4966-8cff-55b736b3d1ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:36.101344 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e46b1-3e28-4966-8cff-55b736b3d1ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:36.103153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e46b1-3e28-4966-8cff-55b736b3d1ec service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:36.112898 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1288/2545] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:36.397135 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4c794-b41e-4805-816a-b53787728dc0 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:36.398529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6bb4c794-b41e-4805-816a-b53787728dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:36.412017 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4c794-b41e-4805-816a-b53787728dc0 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:36.418015 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c4448-0d1d-46d2-a200-7e4255b421f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:36.418939 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c4448-0d1d-46d2-a200-7e4255b421f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:36.419223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c4448-0d1d-46d2-a200-7e4255b421f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:36.419500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c4448-0d1d-46d2-a200-7e4255b421f0 admin admin] PATH_INFO: `/v3/projects/f991cc76330f492891f2a3cfd8e1a846` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:36.420723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c4448-0d1d-46d2-a200-7e4255b421f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f991cc76330f492891f2a3cfd8e1a846)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:36.422858 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c4448-0d1d-46d2-a200-7e4255b421f0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:36.465893 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:36.478791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b11c4448-0d1d-46d2-a200-7e4255b421f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f991cc76330f492891f2a3cfd8e1a846', 'request_id': 'req-b11c4448-0d1d-46d2-a200-7e4255b421f0'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:36.484990 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b11c4448-0d1d-46d2-a200-7e4255b421f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f991cc76330f492891f2a3cfd8e1a846', 'request_id': 'req-b11c4448-0d1d-46d2-a200-7e4255b421f0'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:36.491353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b11c4448-0d1d-46d2-a200-7e4255b421f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f991cc76330f492891f2a3cfd8e1a846', 'request_id': 'req-b11c4448-0d1d-46d2-a200-7e4255b421f0'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:36.506752 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b11c4448-0d1d-46d2-a200-7e4255b421f0 admin admin] The token cache is being invalidate because project f991cc76330f492891f2a3cfd8e1a846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:46:36.507035 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b11c4448-0d1d-46d2-a200-7e4255b421f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:36.507667 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b11c4448-0d1d-46d2-a200-7e4255b421f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:36.509340 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1258/2546] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:46:36 2022] DELETE /identity/v3/projects/f991cc76330f492891f2a3cfd8e1a846 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:36.513732 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e46b1-3e28-4966-8cff-55b736b3d1ec service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:36.523660 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e46b1-3e28-4966-8cff-55b736b3d1ec service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:36.585171 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4b92c-b705-44b2-8484-141d479b292a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:36.586156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4b92c-b705-44b2-8484-141d479b292a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:36.586375 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4b92c-b705-44b2-8484-141d479b292a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:36.586771 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4b92c-b705-44b2-8484-141d479b292a admin admin] PATH_INFO: `/v3/users/4593c06618b042b6b79a81a220e87f17` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:36.588312 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b4b92c-b705-44b2-8484-141d479b292a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4593c06618b042b6b79a81a220e87f17)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:36.590311 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b4b92c-b705-44b2-8484-141d479b292a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:36.613540 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:36.646543 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e5b4b92c-b705-44b2-8484-141d479b292a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4593c06618b042b6b79a81a220e87f17'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:36.654962 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e5b4b92c-b705-44b2-8484-141d479b292a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4593c06618b042b6b79a81a220e87f17'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:36.655636 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e5b4b92c-b705-44b2-8484-141d479b292a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4593c06618b042b6b79a81a220e87f17'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:36.667957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e5b4b92c-b705-44b2-8484-141d479b292a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4593c06618b042b6b79a81a220e87f17'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:36.668760 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e5b4b92c-b705-44b2-8484-141d479b292a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4593c06618b042b6b79a81a220e87f17'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:36.682143 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1289/2547] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:46:36 2022] DELETE /identity/v3/users/4593c06618b042b6b79a81a220e87f17 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:36.996841 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c4448-0d1d-46d2-a200-7e4255b421f0 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:36.999263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b11c4448-0d1d-46d2-a200-7e4255b421f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:37.017959 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c4448-0d1d-46d2-a200-7e4255b421f0 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:37.088528 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b266a-0d4e-4388-99e4-8ad91a2c2609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:37.089410 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b266a-0d4e-4388-99e4-8ad91a2c2609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:37.089686 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b266a-0d4e-4388-99e4-8ad91a2c2609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:37.089956 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b266a-0d4e-4388-99e4-8ad91a2c2609 admin admin] PATH_INFO: `/v3/projects/ecfc818f7f1f46c6b0d69ae217222e86` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:37.091188 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b266a-0d4e-4388-99e4-8ad91a2c2609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecfc818f7f1f46c6b0d69ae217222e86)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:37.093199 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b266a-0d4e-4388-99e4-8ad91a2c2609 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:37.146741 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-078b266a-0d4e-4388-99e4-8ad91a2c2609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecfc818f7f1f46c6b0d69ae217222e86', 'request_id': 'req-078b266a-0d4e-4388-99e4-8ad91a2c2609'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:37.153364 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-078b266a-0d4e-4388-99e4-8ad91a2c2609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecfc818f7f1f46c6b0d69ae217222e86', 'request_id': 'req-078b266a-0d4e-4388-99e4-8ad91a2c2609'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:37.160927 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-078b266a-0d4e-4388-99e4-8ad91a2c2609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecfc818f7f1f46c6b0d69ae217222e86', 'request_id': 'req-078b266a-0d4e-4388-99e4-8ad91a2c2609'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:37.175065 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-078b266a-0d4e-4388-99e4-8ad91a2c2609 admin admin] The token cache is being invalidate because project ecfc818f7f1f46c6b0d69ae217222e86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:46:37.175350 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-078b266a-0d4e-4388-99e4-8ad91a2c2609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:37.175957 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-078b266a-0d4e-4388-99e4-8ad91a2c2609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:37.180464 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1259/2548] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:46:36 2022] DELETE /identity/v3/projects/ecfc818f7f1f46c6b0d69ae217222e86 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:37.185552 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f02a5d-5760-470b-b7ea-0057751d543e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:37.186044 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f02a5d-5760-470b-b7ea-0057751d543e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:37.186227 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f02a5d-5760-470b-b7ea-0057751d543e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:37.204399 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b3f02a5d-5760-470b-b7ea-0057751d543e None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:37.205569 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b3f02a5d-5760-470b-b7ea-0057751d543e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:37.274904 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1290/2549] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:37.282870 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f3e51-c8d5-4ec5-8132-9ab4025c433d None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:37.283156 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f3e51-c8d5-4ec5-8132-9ab4025c433d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:37.283433 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f3e51-c8d5-4ec5-8132-9ab4025c433d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:37.301845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-9c7f3e51-c8d5-4ec5-8132-9ab4025c433d None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:37.303078 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9c7f3e51-c8d5-4ec5-8132-9ab4025c433d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:37.311786 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1260/2550] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:37.316295 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f02a5d-5760-470b-b7ea-0057751d543e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:37.326249 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f02a5d-5760-470b-b7ea-0057751d543e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:37.331739 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a980d7-a60a-43da-938d-9c0e3b1cabd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:37.332454 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a980d7-a60a-43da-938d-9c0e3b1cabd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:37.332729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a980d7-a60a-43da-938d-9c0e3b1cabd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:37.332997 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a980d7-a60a-43da-938d-9c0e3b1cabd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:37.333741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a980d7-a60a-43da-938d-9c0e3b1cabd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:46:37.334037 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a980d7-a60a-43da-938d-9c0e3b1cabd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:37.335665 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a980d7-a60a-43da-938d-9c0e3b1cabd7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:37.348609 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1291/2551] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:46:37.353198 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f3e51-c8d5-4ec5-8132-9ab4025c433d None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:37.362812 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f3e51-c8d5-4ec5-8132-9ab4025c433d None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:37.367590 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e942d72-851d-4fe8-8755-83a4c60db1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:37.368301 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e942d72-851d-4fe8-8755-83a4c60db1a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:37.368701 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e942d72-851d-4fe8-8755-83a4c60db1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:37.368970 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e942d72-851d-4fe8-8755-83a4c60db1a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:37.369696 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e942d72-851d-4fe8-8755-83a4c60db1a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:37.371695 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e942d72-851d-4fe8-8755-83a4c60db1a2 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:37.402688 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1261/2552] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:46:37 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:46:37.407053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a980d7-a60a-43da-938d-9c0e3b1cabd7 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:37.417275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a980d7-a60a-43da-938d-9c0e3b1cabd7 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:37.475130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03afa3b-6725-4a2e-8911-46f1aa6b0b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:37.475805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03afa3b-6725-4a2e-8911-46f1aa6b0b8c admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:37.476090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03afa3b-6725-4a2e-8911-46f1aa6b0b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:37.476364 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03afa3b-6725-4a2e-8911-46f1aa6b0b8c admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:37.477272 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03afa3b-6725-4a2e-8911-46f1aa6b0b8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:37.479220 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03afa3b-6725-4a2e-8911-46f1aa6b0b8c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:37.501126 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1292/2553] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:46:37 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:46:37.507336 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e942d72-851d-4fe8-8755-83a4c60db1a2 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:37.522286 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e942d72-851d-4fe8-8755-83a4c60db1a2 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:37.527932 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40064b57-1ad8-47d9-80a3-89f3e84bca7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:37.528604 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40064b57-1ad8-47d9-80a3-89f3e84bca7c admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:37.529004 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40064b57-1ad8-47d9-80a3-89f3e84bca7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:37.529279 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40064b57-1ad8-47d9-80a3-89f3e84bca7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:37.529989 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40064b57-1ad8-47d9-80a3-89f3e84bca7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:37.531672 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40064b57-1ad8-47d9-80a3-89f3e84bca7c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:37.542903 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1262/2554] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:46:37.548011 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03afa3b-6725-4a2e-8911-46f1aa6b0b8c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:37.561629 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03afa3b-6725-4a2e-8911-46f1aa6b0b8c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:37.567255 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d6d87-711d-4d0c-bd5e-b78353d93a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:37.567923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d6d87-711d-4d0c-bd5e-b78353d93a4b admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:37.568201 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d6d87-711d-4d0c-bd5e-b78353d93a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:37.568468 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d6d87-711d-4d0c-bd5e-b78353d93a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:37.569197 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d6d87-711d-4d0c-bd5e-b78353d93a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:37.570928 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d6d87-711d-4d0c-bd5e-b78353d93a4b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:37.581536 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1293/2555] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:46:37.585964 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40064b57-1ad8-47d9-80a3-89f3e84bca7c admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:37.597322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40064b57-1ad8-47d9-80a3-89f3e84bca7c admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:37.603170 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01deaed6-0ba9-46a8-8aa4-d3dd02a9a5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:37.604135 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01deaed6-0ba9-46a8-8aa4-d3dd02a9a5c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:37.604416 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01deaed6-0ba9-46a8-8aa4-d3dd02a9a5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:37.604686 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01deaed6-0ba9-46a8-8aa4-d3dd02a9a5c0 admin admin] PATH_INFO: `/v3/projects/d817b3fe7272460481e7d211584b0e27/users/d6addd8b3b1e4ce4b65e42c9e518b60b/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:37.616214 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:37.620788 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01deaed6-0ba9-46a8-8aa4-d3dd02a9a5c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d817b3fe7272460481e7d211584b0e27, user_id=d6addd8b3b1e4ce4b65e42c9e518b60b, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:37.624128 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01deaed6-0ba9-46a8-8aa4-d3dd02a9a5c0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:37.640729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1263/2556] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:46:37 2022] PUT /identity/v3/projects/d817b3fe7272460481e7d211584b0e27/users/d6addd8b3b1e4ce4b65e42c9e518b60b/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:37.652372 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f744219-a9c3-4941-959d-851bdea1d916 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:37.652662 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f744219-a9c3-4941-959d-851bdea1d916 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:37.652947 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f744219-a9c3-4941-959d-851bdea1d916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:37.661005 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:37.683407 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6f744219-a9c3-4941-959d-851bdea1d916 None None] MFA Rules not processed for user `d6addd8b3b1e4ce4b65e42c9e518b60b`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:37.684618 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6f744219-a9c3-4941-959d-851bdea1d916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:37.751071 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1294/2557] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:37.755856 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01deaed6-0ba9-46a8-8aa4-d3dd02a9a5c0 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:37.822681 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01deaed6-0ba9-46a8-8aa4-d3dd02a9a5c0 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:37.827741 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba69e17-4cef-40a3-97d3-36d0a15a5e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:37.828402 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba69e17-4cef-40a3-97d3-36d0a15a5e86 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:37.828682 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba69e17-4cef-40a3-97d3-36d0a15a5e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:37.829122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba69e17-4cef-40a3-97d3-36d0a15a5e86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:37.829822 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba69e17-4cef-40a3-97d3-36d0a15a5e86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:37.831748 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba69e17-4cef-40a3-97d3-36d0a15a5e86 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:37.861642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1264/2558] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:46:37 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:46:37.865690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f744219-a9c3-4941-959d-851bdea1d916 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:37.877229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f744219-a9c3-4941-959d-851bdea1d916 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:37.937392 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cef8cd-14bf-41b1-91c0-f7cc2114264c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:37.938072 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cef8cd-14bf-41b1-91c0-f7cc2114264c admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:37.938350 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cef8cd-14bf-41b1-91c0-f7cc2114264c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:37.938654 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cef8cd-14bf-41b1-91c0-f7cc2114264c admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:37.939350 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cef8cd-14bf-41b1-91c0-f7cc2114264c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:37.941375 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cef8cd-14bf-41b1-91c0-f7cc2114264c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:37.966226 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1295/2559] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:46:37 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:46:37.967604 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba69e17-4cef-40a3-97d3-36d0a15a5e86 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:37.978725 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba69e17-4cef-40a3-97d3-36d0a15a5e86 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:37.984217 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976a8fb-4bd8-4841-adae-7de6f4e1be12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:37.984968 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976a8fb-4bd8-4841-adae-7de6f4e1be12 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:37.985311 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976a8fb-4bd8-4841-adae-7de6f4e1be12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:37.985585 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976a8fb-4bd8-4841-adae-7de6f4e1be12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:37.986311 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976a8fb-4bd8-4841-adae-7de6f4e1be12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:37.987956 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976a8fb-4bd8-4841-adae-7de6f4e1be12 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:38.000076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1265/2560] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:46:38.004417 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cef8cd-14bf-41b1-91c0-f7cc2114264c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:38.021184 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cef8cd-14bf-41b1-91c0-f7cc2114264c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:38.026502 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6aa52-1563-421a-b959-b72d61aac5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:38.027185 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6aa52-1563-421a-b959-b72d61aac5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:38.027465 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6aa52-1563-421a-b959-b72d61aac5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:38.027733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6aa52-1563-421a-b959-b72d61aac5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:38.028513 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6aa52-1563-421a-b959-b72d61aac5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:38.030091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6aa52-1563-421a-b959-b72d61aac5c5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:38.041054 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1296/2561] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:46:38.048983 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976a8fb-4bd8-4841-adae-7de6f4e1be12 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:38.056286 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976a8fb-4bd8-4841-adae-7de6f4e1be12 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:38.060879 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed09443-2194-4d5f-9ba3-77c8f33c61da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:38.061763 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed09443-2194-4d5f-9ba3-77c8f33c61da admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:38.062039 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed09443-2194-4d5f-9ba3-77c8f33c61da admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:38.062309 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed09443-2194-4d5f-9ba3-77c8f33c61da admin admin] PATH_INFO: `/v3/projects/69ced423e7a8478a80fbacb4d28bd625/users/f9bfb51d1f6645eb9882c19b06cebf3a/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:38.077812 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed09443-2194-4d5f-9ba3-77c8f33c61da admin admin] RBAC: Authorizing `identity:create_grant(project_id=69ced423e7a8478a80fbacb4d28bd625, user_id=f9bfb51d1f6645eb9882c19b06cebf3a, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:38.080658 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed09443-2194-4d5f-9ba3-77c8f33c61da admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:38.095205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1266/2562] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:46:38 2022] PUT /identity/v3/projects/69ced423e7a8478a80fbacb4d28bd625/users/f9bfb51d1f6645eb9882c19b06cebf3a/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:38.109631 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cd87f-27bd-4c4c-a256-16fb134755ea None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:38.109918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cd87f-27bd-4c4c-a256-16fb134755ea None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:38.110192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cd87f-27bd-4c4c-a256-16fb134755ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:38.138836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-225cd87f-27bd-4c4c-a256-16fb134755ea None None] MFA Rules not processed for user `f9bfb51d1f6645eb9882c19b06cebf3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:38.139975 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-225cd87f-27bd-4c4c-a256-16fb134755ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:38.210379 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1297/2563] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:38.215574 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed09443-2194-4d5f-9ba3-77c8f33c61da admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:38.284306 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed09443-2194-4d5f-9ba3-77c8f33c61da admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:38.289354 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e21a3-6fe4-4cab-a07f-5d4cc39312f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:38.290179 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e21a3-6fe4-4cab-a07f-5d4cc39312f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:38.290506 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e21a3-6fe4-4cab-a07f-5d4cc39312f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:38.290787 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e21a3-6fe4-4cab-a07f-5d4cc39312f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:38.291495 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e21a3-6fe4-4cab-a07f-5d4cc39312f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:38.293961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e21a3-6fe4-4cab-a07f-5d4cc39312f0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:38.324453 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1267/2564] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:46:38 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:46:38.325630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cd87f-27bd-4c4c-a256-16fb134755ea None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:38.331108 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:38.338599 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cd87f-27bd-4c4c-a256-16fb134755ea None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:38.397456 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc613e1-c34b-416e-a663-6e560acd4fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:38.398038 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc613e1-c34b-416e-a663-6e560acd4fcd admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:38.398327 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc613e1-c34b-416e-a663-6e560acd4fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:38.398616 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc613e1-c34b-416e-a663-6e560acd4fcd admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:38.399582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc613e1-c34b-416e-a663-6e560acd4fcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:38.401418 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc613e1-c34b-416e-a663-6e560acd4fcd admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:38.422646 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1298/2565] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:46:38 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:46:38.426786 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e21a3-6fe4-4cab-a07f-5d4cc39312f0 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:38.438263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e21a3-6fe4-4cab-a07f-5d4cc39312f0 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:38.443952 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd75038-41c7-4fbd-a43a-e2f6960711f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:38.444786 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd75038-41c7-4fbd-a43a-e2f6960711f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:38.445070 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd75038-41c7-4fbd-a43a-e2f6960711f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:38.445341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd75038-41c7-4fbd-a43a-e2f6960711f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:38.446277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd75038-41c7-4fbd-a43a-e2f6960711f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:38.448160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd75038-41c7-4fbd-a43a-e2f6960711f8 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:38.459844 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1268/2566] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:46:38.464713 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc613e1-c34b-416e-a663-6e560acd4fcd admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:38.475681 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc613e1-c34b-416e-a663-6e560acd4fcd admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:38.481015 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71562f7-7fae-4948-868a-a18ea2c90314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:38.481947 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71562f7-7fae-4948-868a-a18ea2c90314 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:38.482222 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71562f7-7fae-4948-868a-a18ea2c90314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:38.482664 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71562f7-7fae-4948-868a-a18ea2c90314 admin admin] PATH_INFO: `/v3/projects/480d8046a11640009ee1c5c7d904104d/users/b2df6d516b544913b21296b47c110030/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:38.500721 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71562f7-7fae-4948-868a-a18ea2c90314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=480d8046a11640009ee1c5c7d904104d, user_id=b2df6d516b544913b21296b47c110030, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:38.504412 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71562f7-7fae-4948-868a-a18ea2c90314 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:38.525049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1299/2567] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:46:38 2022] PUT /identity/v3/projects/480d8046a11640009ee1c5c7d904104d/users/b2df6d516b544913b21296b47c110030/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:38.529358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd75038-41c7-4fbd-a43a-e2f6960711f8 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:38.540227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd75038-41c7-4fbd-a43a-e2f6960711f8 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:38.550072 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:38.605604 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9500d2-9410-40d8-ac51-a5524fb19fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:38.606287 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9500d2-9410-40d8-ac51-a5524fb19fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:38.606586 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9500d2-9410-40d8-ac51-a5524fb19fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:38.606995 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9500d2-9410-40d8-ac51-a5524fb19fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:38.607725 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9500d2-9410-40d8-ac51-a5524fb19fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:38.609319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9500d2-9410-40d8-ac51-a5524fb19fa7 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:38.619745 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1269/2568] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:46:38.624196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71562f7-7fae-4948-868a-a18ea2c90314 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:38.637107 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71562f7-7fae-4948-868a-a18ea2c90314 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:38.643217 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47897ff0-7b24-4b1b-a6b9-869c16e01371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:38.644101 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47897ff0-7b24-4b1b-a6b9-869c16e01371 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:38.644378 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47897ff0-7b24-4b1b-a6b9-869c16e01371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:38.644646 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47897ff0-7b24-4b1b-a6b9-869c16e01371 admin admin] PATH_INFO: `/v3/projects/480d8046a11640009ee1c5c7d904104d/users/b2df6d516b544913b21296b47c110030/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:38.647095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47897ff0-7b24-4b1b-a6b9-869c16e01371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=480d8046a11640009ee1c5c7d904104d, user_id=b2df6d516b544913b21296b47c110030, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:38.650003 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47897ff0-7b24-4b1b-a6b9-869c16e01371 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:38.661503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1300/2569] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:46:38 2022] PUT /identity/v3/projects/480d8046a11640009ee1c5c7d904104d/users/b2df6d516b544913b21296b47c110030/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:38.673194 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3cf95-2f07-4ada-841c-4a76a9c89428 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:38.673505 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3cf95-2f07-4ada-841c-4a76a9c89428 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:38.673732 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3cf95-2f07-4ada-841c-4a76a9c89428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:38.700481 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-1fb3cf95-2f07-4ada-841c-4a76a9c89428 None None] MFA Rules not processed for user `b2df6d516b544913b21296b47c110030`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:38.701673 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1fb3cf95-2f07-4ada-841c-4a76a9c89428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:38.773349 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1270/2570] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:38.784483 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47897ff0-7b24-4b1b-a6b9-869c16e01371 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:38.786486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-47897ff0-7b24-4b1b-a6b9-869c16e01371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:38.850237 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47897ff0-7b24-4b1b-a6b9-869c16e01371 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:38.856085 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71face09-17b4-4666-a906-8ec9f0deb5c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:38.857026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71face09-17b4-4666-a906-8ec9f0deb5c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:38.857439 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71face09-17b4-4666-a906-8ec9f0deb5c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:38.857893 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71face09-17b4-4666-a906-8ec9f0deb5c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:38.869052 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71face09-17b4-4666-a906-8ec9f0deb5c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:38.870537 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71face09-17b4-4666-a906-8ec9f0deb5c8 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:38.880814 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1301/2571] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:38 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:38.924672 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3cf95-2f07-4ada-841c-4a76a9c89428 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:38.926253 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1fb3cf95-2f07-4ada-841c-4a76a9c89428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:38.939383 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3cf95-2f07-4ada-841c-4a76a9c89428 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:38.944339 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df3c60-6c5c-466f-a861-6aa6a38153c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:38.944339 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df3c60-6c5c-466f-a861-6aa6a38153c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:38.944604 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df3c60-6c5c-466f-a861-6aa6a38153c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:38.944847 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df3c60-6c5c-466f-a861-6aa6a38153c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:39.007255 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df3c60-6c5c-466f-a861-6aa6a38153c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:39.008845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df3c60-6c5c-466f-a861-6aa6a38153c3 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:39.018453 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1271/2572] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:42.049339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71face09-17b4-4666-a906-8ec9f0deb5c8 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:42.142538 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:42.147296 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71face09-17b4-4666-a906-8ec9f0deb5c8 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:42.154309 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79e9a9-5196-48e9-82cd-b49800c0777d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:42.155313 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79e9a9-5196-48e9-82cd-b49800c0777d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:42.155590 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79e9a9-5196-48e9-82cd-b49800c0777d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:42.155861 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79e9a9-5196-48e9-82cd-b49800c0777d admin admin] PATH_INFO: `/v3/users/d6addd8b3b1e4ce4b65e42c9e518b60b` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:42.157069 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79e9a9-5196-48e9-82cd-b49800c0777d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6addd8b3b1e4ce4b65e42c9e518b60b)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:42.159025 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79e9a9-5196-48e9-82cd-b49800c0777d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:42.208146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ec79e9a9-5196-48e9-82cd-b49800c0777d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6addd8b3b1e4ce4b65e42c9e518b60b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:42.216793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ec79e9a9-5196-48e9-82cd-b49800c0777d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6addd8b3b1e4ce4b65e42c9e518b60b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:42.217479 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ec79e9a9-5196-48e9-82cd-b49800c0777d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6addd8b3b1e4ce4b65e42c9e518b60b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:42.230364 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ec79e9a9-5196-48e9-82cd-b49800c0777d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6addd8b3b1e4ce4b65e42c9e518b60b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:42.231104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ec79e9a9-5196-48e9-82cd-b49800c0777d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6addd8b3b1e4ce4b65e42c9e518b60b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:42.243155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1302/2573] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:46:42 2022] DELETE /identity/v3/users/d6addd8b3b1e4ce4b65e42c9e518b60b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:42.248089 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c95f4-6c18-4299-a3c2-7684090b7619 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:42.248561 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c95f4-6c18-4299-a3c2-7684090b7619 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:42.248656 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c95f4-6c18-4299-a3c2-7684090b7619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:42.267222 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-1c4c95f4-6c18-4299-a3c2-7684090b7619 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:42.268412 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1c4c95f4-6c18-4299-a3c2-7684090b7619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:42.298736 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:42.330645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1272/2574] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:42.340897 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79e9a9-5196-48e9-82cd-b49800c0777d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:42.342339 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ec79e9a9-5196-48e9-82cd-b49800c0777d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:42.402381 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79e9a9-5196-48e9-82cd-b49800c0777d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:42.406927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab500b4-1f84-4201-86e5-7c59fd769028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:42.407546 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab500b4-1f84-4201-86e5-7c59fd769028 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:42.407823 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab500b4-1f84-4201-86e5-7c59fd769028 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:42.408096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab500b4-1f84-4201-86e5-7c59fd769028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:42.417837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab500b4-1f84-4201-86e5-7c59fd769028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:42.419309 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab500b4-1f84-4201-86e5-7c59fd769028 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:42.429102 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1303/2575] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:42.729108 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c95f4-6c18-4299-a3c2-7684090b7619 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:42.730958 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1c4c95f4-6c18-4299-a3c2-7684090b7619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:42.743814 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c95f4-6c18-4299-a3c2-7684090b7619 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:42.749800 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20cbe9-e524-43f5-9d39-226c72b200d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:42.750611 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20cbe9-e524-43f5-9d39-226c72b200d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:42.751108 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20cbe9-e524-43f5-9d39-226c72b200d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:42.751383 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20cbe9-e524-43f5-9d39-226c72b200d4 admin admin] PATH_INFO: `/v3/projects/d817b3fe7272460481e7d211584b0e27` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:42.752907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20cbe9-e524-43f5-9d39-226c72b200d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d817b3fe7272460481e7d211584b0e27)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:42.754886 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20cbe9-e524-43f5-9d39-226c72b200d4 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:42.809750 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-af20cbe9-e524-43f5-9d39-226c72b200d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd817b3fe7272460481e7d211584b0e27', 'request_id': 'req-af20cbe9-e524-43f5-9d39-226c72b200d4'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:42.815336 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-af20cbe9-e524-43f5-9d39-226c72b200d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd817b3fe7272460481e7d211584b0e27', 'request_id': 'req-af20cbe9-e524-43f5-9d39-226c72b200d4'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:42.821436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-af20cbe9-e524-43f5-9d39-226c72b200d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd817b3fe7272460481e7d211584b0e27', 'request_id': 'req-af20cbe9-e524-43f5-9d39-226c72b200d4'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:42.834813 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-af20cbe9-e524-43f5-9d39-226c72b200d4 admin admin] The token cache is being invalidate because project d817b3fe7272460481e7d211584b0e27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:46:42.835337 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-af20cbe9-e524-43f5-9d39-226c72b200d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:42.835956 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-af20cbe9-e524-43f5-9d39-226c72b200d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:42.837629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1273/2576] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:46:42 2022] DELETE /identity/v3/projects/d817b3fe7272460481e7d211584b0e27 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:42.841907 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab500b4-1f84-4201-86e5-7c59fd769028 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:42.851932 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab500b4-1f84-4201-86e5-7c59fd769028 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:42.914200 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bfc0f-325d-4d2b-81e5-ad5b80c03c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:42.915108 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bfc0f-325d-4d2b-81e5-ad5b80c03c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:42.915436 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bfc0f-325d-4d2b-81e5-ad5b80c03c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:42.915713 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bfc0f-325d-4d2b-81e5-ad5b80c03c3a admin admin] PATH_INFO: `/v3/users/f9bfb51d1f6645eb9882c19b06cebf3a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:42.916901 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bfc0f-325d-4d2b-81e5-ad5b80c03c3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9bfb51d1f6645eb9882c19b06cebf3a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:42.918871 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bfc0f-325d-4d2b-81e5-ad5b80c03c3a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:42.942746 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:42.973175 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-da0bfc0f-325d-4d2b-81e5-ad5b80c03c3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9bfb51d1f6645eb9882c19b06cebf3a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:42.981073 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-da0bfc0f-325d-4d2b-81e5-ad5b80c03c3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9bfb51d1f6645eb9882c19b06cebf3a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:42.981767 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-da0bfc0f-325d-4d2b-81e5-ad5b80c03c3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9bfb51d1f6645eb9882c19b06cebf3a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:42.996563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-da0bfc0f-325d-4d2b-81e5-ad5b80c03c3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9bfb51d1f6645eb9882c19b06cebf3a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:42.997296 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-da0bfc0f-325d-4d2b-81e5-ad5b80c03c3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9bfb51d1f6645eb9882c19b06cebf3a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:43.012813 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1304/2577] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:46:42 2022] DELETE /identity/v3/users/f9bfb51d1f6645eb9882c19b06cebf3a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:46:43.310528 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20cbe9-e524-43f5-9d39-226c72b200d4 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:43.312209 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-af20cbe9-e524-43f5-9d39-226c72b200d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:43.326837 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20cbe9-e524-43f5-9d39-226c72b200d4 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:43.393348 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47255b-1474-4eae-aae2-a92f9103f484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:43.394242 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47255b-1474-4eae-aae2-a92f9103f484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:43.394522 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47255b-1474-4eae-aae2-a92f9103f484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:43.394817 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47255b-1474-4eae-aae2-a92f9103f484 admin admin] PATH_INFO: `/v3/projects/69ced423e7a8478a80fbacb4d28bd625` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:43.395999 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47255b-1474-4eae-aae2-a92f9103f484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69ced423e7a8478a80fbacb4d28bd625)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:43.397913 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47255b-1474-4eae-aae2-a92f9103f484 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:43.449775 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2f47255b-1474-4eae-aae2-a92f9103f484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69ced423e7a8478a80fbacb4d28bd625', 'request_id': 'req-2f47255b-1474-4eae-aae2-a92f9103f484'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:43.456547 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2f47255b-1474-4eae-aae2-a92f9103f484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69ced423e7a8478a80fbacb4d28bd625', 'request_id': 'req-2f47255b-1474-4eae-aae2-a92f9103f484'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:43.457990 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:43.464142 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2f47255b-1474-4eae-aae2-a92f9103f484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69ced423e7a8478a80fbacb4d28bd625', 'request_id': 'req-2f47255b-1474-4eae-aae2-a92f9103f484'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:43.481814 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2f47255b-1474-4eae-aae2-a92f9103f484 admin admin] The token cache is being invalidate because project 69ced423e7a8478a80fbacb4d28bd625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:46:43.482211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2f47255b-1474-4eae-aae2-a92f9103f484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:43.482874 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2f47255b-1474-4eae-aae2-a92f9103f484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:43.487574 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1274/2578] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:46:43 2022] DELETE /identity/v3/projects/69ced423e7a8478a80fbacb4d28bd625 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:43.490219 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bfc0f-325d-4d2b-81e5-ad5b80c03c3a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:43.491733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-da0bfc0f-325d-4d2b-81e5-ad5b80c03c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:43.505358 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bfc0f-325d-4d2b-81e5-ad5b80c03c3a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:43.575899 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd87ce-8ab1-4f21-ad25-a2e088e25728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:43.577667 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd87ce-8ab1-4f21-ad25-a2e088e25728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:43.578136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd87ce-8ab1-4f21-ad25-a2e088e25728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:43.578773 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd87ce-8ab1-4f21-ad25-a2e088e25728 admin admin] PATH_INFO: `/v3/users/b2df6d516b544913b21296b47c110030` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:43.580068 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd87ce-8ab1-4f21-ad25-a2e088e25728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2df6d516b544913b21296b47c110030)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:43.581951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd87ce-8ab1-4f21-ad25-a2e088e25728 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:43.638535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-facd87ce-8ab1-4f21-ad25-a2e088e25728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2df6d516b544913b21296b47c110030'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:43.646630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-facd87ce-8ab1-4f21-ad25-a2e088e25728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2df6d516b544913b21296b47c110030'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:43.647247 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-facd87ce-8ab1-4f21-ad25-a2e088e25728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2df6d516b544913b21296b47c110030'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:43.659111 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-facd87ce-8ab1-4f21-ad25-a2e088e25728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2df6d516b544913b21296b47c110030'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:43.659773 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-facd87ce-8ab1-4f21-ad25-a2e088e25728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2df6d516b544913b21296b47c110030'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:43.671996 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1305/2579] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:46:43 2022] DELETE /identity/v3/users/b2df6d516b544913b21296b47c110030 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:43.919799 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47255b-1474-4eae-aae2-a92f9103f484 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:43.921758 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2f47255b-1474-4eae-aae2-a92f9103f484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:43.983785 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47255b-1474-4eae-aae2-a92f9103f484 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:44.000984 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd87ce-8ab1-4f21-ad25-a2e088e25728 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:44.002523 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-facd87ce-8ab1-4f21-ad25-a2e088e25728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:44.035237 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:44.045707 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e196c6-0088-451f-9b14-b228b5ae9d42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:44.046840 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e196c6-0088-451f-9b14-b228b5ae9d42 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:44.047256 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e196c6-0088-451f-9b14-b228b5ae9d42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:44.047638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e196c6-0088-451f-9b14-b228b5ae9d42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:44.049919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-63e196c6-0088-451f-9b14-b228b5ae9d42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:44.083783 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd87ce-8ab1-4f21-ad25-a2e088e25728 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:44.089226 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1aad57-6e50-4b49-ac5f-e1fc1668808b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:44.090101 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1aad57-6e50-4b49-ac5f-e1fc1668808b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:44.090374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1aad57-6e50-4b49-ac5f-e1fc1668808b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:44.090815 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1aad57-6e50-4b49-ac5f-e1fc1668808b admin admin] PATH_INFO: `/v3/projects/480d8046a11640009ee1c5c7d904104d` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:44.092116 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1aad57-6e50-4b49-ac5f-e1fc1668808b admin admin] RBAC: Authorizing `identity:delete_project(project_id=480d8046a11640009ee1c5c7d904104d)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:44.094554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1aad57-6e50-4b49-ac5f-e1fc1668808b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:44.122221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e196c6-0088-451f-9b14-b228b5ae9d42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:44.124121 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e196c6-0088-451f-9b14-b228b5ae9d42 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:44.135240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1275/2580] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:46:44.143428 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2e1aad57-6e50-4b49-ac5f-e1fc1668808b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '480d8046a11640009ee1c5c7d904104d', 'request_id': 'req-2e1aad57-6e50-4b49-ac5f-e1fc1668808b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:44.148912 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2e1aad57-6e50-4b49-ac5f-e1fc1668808b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '480d8046a11640009ee1c5c7d904104d', 'request_id': 'req-2e1aad57-6e50-4b49-ac5f-e1fc1668808b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:44.155241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2e1aad57-6e50-4b49-ac5f-e1fc1668808b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '480d8046a11640009ee1c5c7d904104d', 'request_id': 'req-2e1aad57-6e50-4b49-ac5f-e1fc1668808b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:44.171216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2e1aad57-6e50-4b49-ac5f-e1fc1668808b admin admin] The token cache is being invalidate because project 480d8046a11640009ee1c5c7d904104d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:46:44.171489 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2e1aad57-6e50-4b49-ac5f-e1fc1668808b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:44.172117 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2e1aad57-6e50-4b49-ac5f-e1fc1668808b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:44.173822 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1306/2581] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:46:43 2022] DELETE /identity/v3/projects/480d8046a11640009ee1c5c7d904104d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:46:44.179917 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49059eed-0cce-4f08-b0df-df6bf5e3c24f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:44.180213 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49059eed-0cce-4f08-b0df-df6bf5e3c24f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:44.180489 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49059eed-0cce-4f08-b0df-df6bf5e3c24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:44.200545 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-49059eed-0cce-4f08-b0df-df6bf5e3c24f None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:44.201756 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-49059eed-0cce-4f08-b0df-df6bf5e3c24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:44.252637 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:44.267326 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1276/2582] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:44.276346 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2c04a-a50e-41f1-bfd6-6c38e011aaed None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:44.276699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2c04a-a50e-41f1-bfd6-6c38e011aaed None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:44.277036 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2c04a-a50e-41f1-bfd6-6c38e011aaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:44.296314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-9ea2c04a-a50e-41f1-bfd6-6c38e011aaed None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:44.297784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9ea2c04a-a50e-41f1-bfd6-6c38e011aaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:44.305587 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1307/2583] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:44.309999 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49059eed-0cce-4f08-b0df-df6bf5e3c24f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:44.319637 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49059eed-0cce-4f08-b0df-df6bf5e3c24f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:44.324771 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5304c-ee48-4886-a0a2-13bf5b7da9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:44.325455 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5304c-ee48-4886-a0a2-13bf5b7da9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:44.325735 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5304c-ee48-4886-a0a2-13bf5b7da9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:44.325982 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5304c-ee48-4886-a0a2-13bf5b7da9c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:44.326746 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5304c-ee48-4886-a0a2-13bf5b7da9c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:46:44.327072 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5304c-ee48-4886-a0a2-13bf5b7da9c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:44.328649 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5304c-ee48-4886-a0a2-13bf5b7da9c4 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:44.341341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1277/2584] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:46:44.345695 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2c04a-a50e-41f1-bfd6-6c38e011aaed None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:44.355945 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2c04a-a50e-41f1-bfd6-6c38e011aaed None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:44.361249 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9d18d-8f5e-4825-b299-d158c57b6193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:44.361916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9d18d-8f5e-4825-b299-d158c57b6193 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:44.362194 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9d18d-8f5e-4825-b299-d158c57b6193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:44.362466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9d18d-8f5e-4825-b299-d158c57b6193 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:44.363196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9d18d-8f5e-4825-b299-d158c57b6193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:44.365092 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9d18d-8f5e-4825-b299-d158c57b6193 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:44.396408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1308/2585] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:46:44 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:46:44.397671 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5304c-ee48-4886-a0a2-13bf5b7da9c4 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:44.408261 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5304c-ee48-4886-a0a2-13bf5b7da9c4 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:44.468510 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2eff31-d0a6-4670-b0db-f5b1f8decb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:44.469113 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2eff31-d0a6-4670-b0db-f5b1f8decb7c admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:44.469396 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2eff31-d0a6-4670-b0db-f5b1f8decb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:44.469673 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2eff31-d0a6-4670-b0db-f5b1f8decb7c admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:44.470393 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2eff31-d0a6-4670-b0db-f5b1f8decb7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:44.472344 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2eff31-d0a6-4670-b0db-f5b1f8decb7c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:44.495180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1278/2586] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:46:44 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:46:44.499457 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9d18d-8f5e-4825-b299-d158c57b6193 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:44.510710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9d18d-8f5e-4825-b299-d158c57b6193 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:44.515492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16675402-d736-4032-a44a-e71c67510407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:44.516154 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16675402-d736-4032-a44a-e71c67510407 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:44.516431 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16675402-d736-4032-a44a-e71c67510407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:44.516701 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16675402-d736-4032-a44a-e71c67510407 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:44.517440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16675402-d736-4032-a44a-e71c67510407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:44.519075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16675402-d736-4032-a44a-e71c67510407 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:44.532734 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1309/2587] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:46:44.534130 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2eff31-d0a6-4670-b0db-f5b1f8decb7c admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:44.544696 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2eff31-d0a6-4670-b0db-f5b1f8decb7c admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:44.549492 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e6b74-0405-49e0-8a9a-ae60fcb8ba5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:44.550153 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e6b74-0405-49e0-8a9a-ae60fcb8ba5b admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:44.550554 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e6b74-0405-49e0-8a9a-ae60fcb8ba5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:44.550980 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e6b74-0405-49e0-8a9a-ae60fcb8ba5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:44.551742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e6b74-0405-49e0-8a9a-ae60fcb8ba5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:44.553321 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e6b74-0405-49e0-8a9a-ae60fcb8ba5b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:44.564803 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1279/2588] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:46:44.569164 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16675402-d736-4032-a44a-e71c67510407 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:44.582031 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16675402-d736-4032-a44a-e71c67510407 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:44.588934 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f81fbe-9cea-4bed-a98c-188c6a667c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:44.590316 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f81fbe-9cea-4bed-a98c-188c6a667c0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:44.590316 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f81fbe-9cea-4bed-a98c-188c6a667c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:44.590547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f81fbe-9cea-4bed-a98c-188c6a667c0a admin admin] PATH_INFO: `/v3/projects/19985942bfd94387a61496240fdb957a/users/0e42ecc70b5743d2bf40c0441203ff1e/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:44.607546 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f81fbe-9cea-4bed-a98c-188c6a667c0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=19985942bfd94387a61496240fdb957a, user_id=0e42ecc70b5743d2bf40c0441203ff1e, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:44.610549 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f81fbe-9cea-4bed-a98c-188c6a667c0a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:44.626957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1310/2589] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:46:44 2022] PUT /identity/v3/projects/19985942bfd94387a61496240fdb957a/users/0e42ecc70b5743d2bf40c0441203ff1e/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:44.638806 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee08dc3-8961-4029-96c3-49e354b94655 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:44.639593 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee08dc3-8961-4029-96c3-49e354b94655 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:44.640554 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee08dc3-8961-4029-96c3-49e354b94655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:44.674906 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-7ee08dc3-8961-4029-96c3-49e354b94655 None None] MFA Rules not processed for user `0e42ecc70b5743d2bf40c0441203ff1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:44.676117 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7ee08dc3-8961-4029-96c3-49e354b94655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:44.757706 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1280/2590] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:44.770341 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f81fbe-9cea-4bed-a98c-188c6a667c0a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:44.772044 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-50f81fbe-9cea-4bed-a98c-188c6a667c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:44.821805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:44.834666 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f81fbe-9cea-4bed-a98c-188c6a667c0a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:44.840158 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0994d-0570-4508-a828-7c3febe92f6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:44.840885 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0994d-0570-4508-a828-7c3febe92f6a service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:44.841162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0994d-0570-4508-a828-7c3febe92f6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:44.841428 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0994d-0570-4508-a828-7c3febe92f6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:44.850187 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0994d-0570-4508-a828-7c3febe92f6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:44.851664 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0994d-0570-4508-a828-7c3febe92f6a service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:44.860593 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1311/2591] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:47.261979 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee08dc3-8961-4029-96c3-49e354b94655 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:47.264544 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7ee08dc3-8961-4029-96c3-49e354b94655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:47.361921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:47.376906 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0994d-0570-4508-a828-7c3febe92f6a service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:47.379874 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-16a0994d-0570-4508-a828-7c3febe92f6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:47.419943 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee08dc3-8961-4029-96c3-49e354b94655 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:47.432623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d345fb7-cc8a-4319-a785-27e81f301303 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f7ea9741a5d409d87b8ebb4390a74ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:47.433411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d345fb7-cc8a-4319-a785-27e81f301303 service placement] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:47.433731 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d345fb7-cc8a-4319-a785-27e81f301303 service placement] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:47.434067 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d345fb7-cc8a-4319-a785-27e81f301303 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:47.436076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6d345fb7-cc8a-4319-a785-27e81f301303 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:47.463101 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d345fb7-cc8a-4319-a785-27e81f301303 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:47.464818 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d345fb7-cc8a-4319-a785-27e81f301303 service placement] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:47.483547 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1281/2592] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:47.503174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0994d-0570-4508-a828-7c3febe92f6a service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:47.513985 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853b14e-a4e1-4763-8b58-a3924c10fa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:47.515563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853b14e-a4e1-4763-8b58-a3924c10fa38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:47.516004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853b14e-a4e1-4763-8b58-a3924c10fa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:47.516916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853b14e-a4e1-4763-8b58-a3924c10fa38 admin admin] PATH_INFO: `/v3/users/78290c0b02cd4cf2844decf6e7569535` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:47.518922 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853b14e-a4e1-4763-8b58-a3924c10fa38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78290c0b02cd4cf2844decf6e7569535)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:47.522201 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853b14e-a4e1-4763-8b58-a3924c10fa38 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:47.576631 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7853b14e-a4e1-4763-8b58-a3924c10fa38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78290c0b02cd4cf2844decf6e7569535'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:47.585173 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7853b14e-a4e1-4763-8b58-a3924c10fa38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78290c0b02cd4cf2844decf6e7569535'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:47.586139 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7853b14e-a4e1-4763-8b58-a3924c10fa38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78290c0b02cd4cf2844decf6e7569535'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:47.600068 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7853b14e-a4e1-4763-8b58-a3924c10fa38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78290c0b02cd4cf2844decf6e7569535'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:47.600894 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7853b14e-a4e1-4763-8b58-a3924c10fa38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78290c0b02cd4cf2844decf6e7569535'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:47.615247 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1312/2593] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:46:47 2022] DELETE /identity/v3/users/78290c0b02cd4cf2844decf6e7569535 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:47.808404 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d345fb7-cc8a-4319-a785-27e81f301303 service placement] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:47.820860 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d345fb7-cc8a-4319-a785-27e81f301303 service placement] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:47.880213 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e99de-2725-4ca4-943b-d99b6f14b26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:47.881096 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e99de-2725-4ca4-943b-d99b6f14b26c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:47.881371 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e99de-2725-4ca4-943b-d99b6f14b26c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:47.881639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e99de-2725-4ca4-943b-d99b6f14b26c admin admin] PATH_INFO: `/v3/projects/f2b2788f013842c188657c8bcb59d869` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:47.882872 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e99de-2725-4ca4-943b-d99b6f14b26c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2b2788f013842c188657c8bcb59d869)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:47.885226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e99de-2725-4ca4-943b-d99b6f14b26c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:47.936220 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-967e99de-2725-4ca4-943b-d99b6f14b26c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2b2788f013842c188657c8bcb59d869', 'request_id': 'req-967e99de-2725-4ca4-943b-d99b6f14b26c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:47.942034 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-967e99de-2725-4ca4-943b-d99b6f14b26c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2b2788f013842c188657c8bcb59d869', 'request_id': 'req-967e99de-2725-4ca4-943b-d99b6f14b26c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:47.954945 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-967e99de-2725-4ca4-943b-d99b6f14b26c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2b2788f013842c188657c8bcb59d869', 'request_id': 'req-967e99de-2725-4ca4-943b-d99b6f14b26c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:47.971347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-967e99de-2725-4ca4-943b-d99b6f14b26c admin admin] The token cache is being invalidate because project f2b2788f013842c188657c8bcb59d869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:46:47.971635 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-967e99de-2725-4ca4-943b-d99b6f14b26c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:47.972418 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-967e99de-2725-4ca4-943b-d99b6f14b26c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:47.974007 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1282/2594] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:46:47 2022] DELETE /identity/v3/projects/f2b2788f013842c188657c8bcb59d869 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:47.979166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807423f-7cd4-4828-9861-dc5712546613 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:47.979447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807423f-7cd4-4828-9861-dc5712546613 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:47.979714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807423f-7cd4-4828-9861-dc5712546613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:47.998598 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b807423f-7cd4-4828-9861-dc5712546613 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:48.000040 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b807423f-7cd4-4828-9861-dc5712546613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:48.087609 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1313/2595] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:48.096721 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ceb0f-06b6-45ee-8f02-92c9edb795d7 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:48.096998 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ceb0f-06b6-45ee-8f02-92c9edb795d7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:48.097276 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ceb0f-06b6-45ee-8f02-92c9edb795d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:48.119398 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-ab2ceb0f-06b6-45ee-8f02-92c9edb795d7 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:48.120536 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ab2ceb0f-06b6-45ee-8f02-92c9edb795d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:48.132497 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1283/2596] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:46:48.137532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807423f-7cd4-4828-9861-dc5712546613 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:48.148582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807423f-7cd4-4828-9861-dc5712546613 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:48.155855 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01589736-685f-479d-96e7-803bda8d1322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:48.156540 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01589736-685f-479d-96e7-803bda8d1322 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:48.156821 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01589736-685f-479d-96e7-803bda8d1322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:48.157095 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01589736-685f-479d-96e7-803bda8d1322 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:48.157832 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01589736-685f-479d-96e7-803bda8d1322 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:46:48.158146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01589736-685f-479d-96e7-803bda8d1322 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:48.159765 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01589736-685f-479d-96e7-803bda8d1322 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:48.161525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:48.177605 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1314/2597] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:46:48.182345 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ceb0f-06b6-45ee-8f02-92c9edb795d7 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:48.192779 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ceb0f-06b6-45ee-8f02-92c9edb795d7 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:48.197619 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4166c-32cb-4073-81f5-0b7e7790aa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:48.198302 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4166c-32cb-4073-81f5-0b7e7790aa3b admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:48.198615 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4166c-32cb-4073-81f5-0b7e7790aa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:48.198876 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4166c-32cb-4073-81f5-0b7e7790aa3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:48.199594 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4166c-32cb-4073-81f5-0b7e7790aa3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:48.201471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4166c-32cb-4073-81f5-0b7e7790aa3b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:48.227726 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1284/2598] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:46:48 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:46:48.231723 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01589736-685f-479d-96e7-803bda8d1322 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:48.243005 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01589736-685f-479d-96e7-803bda8d1322 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:48.303326 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1302d3e-674f-472c-a9ca-4b4c6b74a748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:48.303940 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1302d3e-674f-472c-a9ca-4b4c6b74a748 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:48.304213 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1302d3e-674f-472c-a9ca-4b4c6b74a748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:48.304479 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1302d3e-674f-472c-a9ca-4b4c6b74a748 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:48.305337 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1302d3e-674f-472c-a9ca-4b4c6b74a748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:48.307557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1302d3e-674f-472c-a9ca-4b4c6b74a748 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:48.329236 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1315/2599] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:46:48 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:46:48.333913 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4166c-32cb-4073-81f5-0b7e7790aa3b admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:48.345010 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4166c-32cb-4073-81f5-0b7e7790aa3b admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:48.350857 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463198b-207b-4c23-9f54-113c1760100a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:48.351559 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463198b-207b-4c23-9f54-113c1760100a admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:48.351837 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463198b-207b-4c23-9f54-113c1760100a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:48.352103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463198b-207b-4c23-9f54-113c1760100a admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:48.353023 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463198b-207b-4c23-9f54-113c1760100a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:48.354796 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463198b-207b-4c23-9f54-113c1760100a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:48.366742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1285/2600] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:46:48.371936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1302d3e-674f-472c-a9ca-4b4c6b74a748 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:48.382299 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1302d3e-674f-472c-a9ca-4b4c6b74a748 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:48.387847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa09850-aada-444b-b4c4-38bd3f117476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:48.388519 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa09850-aada-444b-b4c4-38bd3f117476 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:48.388814 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa09850-aada-444b-b4c4-38bd3f117476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:48.389107 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa09850-aada-444b-b4c4-38bd3f117476 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:48.389850 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa09850-aada-444b-b4c4-38bd3f117476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:48.391563 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa09850-aada-444b-b4c4-38bd3f117476 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:48.402138 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1316/2601] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:46:48.406481 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463198b-207b-4c23-9f54-113c1760100a admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:48.416798 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463198b-207b-4c23-9f54-113c1760100a admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:48.422144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb92bb-cd05-44bb-908c-719f08fb22b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:48.423069 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb92bb-cd05-44bb-908c-719f08fb22b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:48.423345 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb92bb-cd05-44bb-908c-719f08fb22b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:48.423610 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb92bb-cd05-44bb-908c-719f08fb22b9 admin admin] PATH_INFO: `/v3/projects/5a1176f63c794b9dbca24e3280216b60/users/3d43e801e85b43eda273a27bfb982bcc/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:48.439084 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb92bb-cd05-44bb-908c-719f08fb22b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a1176f63c794b9dbca24e3280216b60, user_id=3d43e801e85b43eda273a27bfb982bcc, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:48.441783 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb92bb-cd05-44bb-908c-719f08fb22b9 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:48.456027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1286/2602] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:46:48 2022] PUT /identity/v3/projects/5a1176f63c794b9dbca24e3280216b60/users/3d43e801e85b43eda273a27bfb982bcc/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:48.466614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c3f07-452b-4b02-8829-9aa1e4364209 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:48.466905 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c3f07-452b-4b02-8829-9aa1e4364209 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:48.467200 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c3f07-452b-4b02-8829-9aa1e4364209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:48.498624 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2b6c3f07-452b-4b02-8829-9aa1e4364209 None None] MFA Rules not processed for user `3d43e801e85b43eda273a27bfb982bcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:48.499880 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2b6c3f07-452b-4b02-8829-9aa1e4364209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:48.575702 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1317/2603] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:46:48.586455 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb92bb-cd05-44bb-908c-719f08fb22b9 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:48.588455 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6bdb92bb-cd05-44bb-908c-719f08fb22b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:48.595592 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:48.652394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb92bb-cd05-44bb-908c-719f08fb22b9 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:48.659303 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12981f-b0a2-49b5-8c36-d78d9db76a46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:48.660415 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12981f-b0a2-49b5-8c36-d78d9db76a46 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:48.660931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12981f-b0a2-49b5-8c36-d78d9db76a46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:48.661272 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12981f-b0a2-49b5-8c36-d78d9db76a46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:48.674064 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12981f-b0a2-49b5-8c36-d78d9db76a46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:48.675859 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12981f-b0a2-49b5-8c36-d78d9db76a46 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:48.686101 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1287/2604] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:50.321302 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c3f07-452b-4b02-8829-9aa1e4364209 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:50.323199 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2b6c3f07-452b-4b02-8829-9aa1e4364209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:50.409059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c3f07-452b-4b02-8829-9aa1e4364209 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:50.413604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48e945-b933-4afe-a3b2-c584f0dd28d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:50.414528 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48e945-b933-4afe-a3b2-c584f0dd28d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:50.414834 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48e945-b933-4afe-a3b2-c584f0dd28d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:50.415105 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48e945-b933-4afe-a3b2-c584f0dd28d0 admin admin] PATH_INFO: `/v3/users/0e42ecc70b5743d2bf40c0441203ff1e` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:50.416401 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48e945-b933-4afe-a3b2-c584f0dd28d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e42ecc70b5743d2bf40c0441203ff1e)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:50.418310 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48e945-b933-4afe-a3b2-c584f0dd28d0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:50.420842 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:50.466644 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cd48e945-b933-4afe-a3b2-c584f0dd28d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e42ecc70b5743d2bf40c0441203ff1e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:50.474434 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cd48e945-b933-4afe-a3b2-c584f0dd28d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e42ecc70b5743d2bf40c0441203ff1e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:50.475064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cd48e945-b933-4afe-a3b2-c584f0dd28d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e42ecc70b5743d2bf40c0441203ff1e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:50.487343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cd48e945-b933-4afe-a3b2-c584f0dd28d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e42ecc70b5743d2bf40c0441203ff1e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:50.488078 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cd48e945-b933-4afe-a3b2-c584f0dd28d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e42ecc70b5743d2bf40c0441203ff1e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:50.500283 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1318/2605] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:46:50 2022] DELETE /identity/v3/users/0e42ecc70b5743d2bf40c0441203ff1e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:50.504987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74da27-9637-4134-b79a-a6b079dd15d3 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:50.505471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74da27-9637-4134-b79a-a6b079dd15d3 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:50.505610 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74da27-9637-4134-b79a-a6b079dd15d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:50.523825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-1c74da27-9637-4134-b79a-a6b079dd15d3 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:50.525428 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1c74da27-9637-4134-b79a-a6b079dd15d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:50.594622 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1288/2606] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:50.604745 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48e945-b933-4afe-a3b2-c584f0dd28d0 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:50.606420 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cd48e945-b933-4afe-a3b2-c584f0dd28d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:50.676273 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48e945-b933-4afe-a3b2-c584f0dd28d0 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:50.680224 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab75df5-cbd5-48be-bce7-148bad577f9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:50.681032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab75df5-cbd5-48be-bce7-148bad577f9d service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:50.681432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab75df5-cbd5-48be-bce7-148bad577f9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:50.681707 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab75df5-cbd5-48be-bce7-148bad577f9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:50.691520 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab75df5-cbd5-48be-bce7-148bad577f9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:50.692978 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab75df5-cbd5-48be-bce7-148bad577f9d service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:50.703133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1319/2607] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:51.024594 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74da27-9637-4134-b79a-a6b079dd15d3 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:51.026404 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1c74da27-9637-4134-b79a-a6b079dd15d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:51.040591 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74da27-9637-4134-b79a-a6b079dd15d3 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:51.046719 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc344a-fbb2-40ce-9f41-26b4eaf1c7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:51.047642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc344a-fbb2-40ce-9f41-26b4eaf1c7bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:51.047980 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc344a-fbb2-40ce-9f41-26b4eaf1c7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:51.048259 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc344a-fbb2-40ce-9f41-26b4eaf1c7bb admin admin] PATH_INFO: `/v3/projects/19985942bfd94387a61496240fdb957a` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:51.049508 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc344a-fbb2-40ce-9f41-26b4eaf1c7bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=19985942bfd94387a61496240fdb957a)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:51.052953 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc344a-fbb2-40ce-9f41-26b4eaf1c7bb admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:51.104319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3ffc344a-fbb2-40ce-9f41-26b4eaf1c7bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19985942bfd94387a61496240fdb957a', 'request_id': 'req-3ffc344a-fbb2-40ce-9f41-26b4eaf1c7bb'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:51.109933 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3ffc344a-fbb2-40ce-9f41-26b4eaf1c7bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19985942bfd94387a61496240fdb957a', 'request_id': 'req-3ffc344a-fbb2-40ce-9f41-26b4eaf1c7bb'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:51.117003 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3ffc344a-fbb2-40ce-9f41-26b4eaf1c7bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19985942bfd94387a61496240fdb957a', 'request_id': 'req-3ffc344a-fbb2-40ce-9f41-26b4eaf1c7bb'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:51.136017 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3ffc344a-fbb2-40ce-9f41-26b4eaf1c7bb admin admin] The token cache is being invalidate because project 19985942bfd94387a61496240fdb957a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:46:51.136446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3ffc344a-fbb2-40ce-9f41-26b4eaf1c7bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:51.137325 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3ffc344a-fbb2-40ce-9f41-26b4eaf1c7bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:51.139709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1289/2608] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:46:51 2022] DELETE /identity/v3/projects/19985942bfd94387a61496240fdb957a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:51.145070 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcd2c1-6c24-4fab-b61a-676c96f04f91 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:51.145358 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcd2c1-6c24-4fab-b61a-676c96f04f91 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:51.145636 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcd2c1-6c24-4fab-b61a-676c96f04f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:51.165347 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-eddcd2c1-6c24-4fab-b61a-676c96f04f91 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:51.167239 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-eddcd2c1-6c24-4fab-b61a-676c96f04f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:51.232729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1320/2609] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:51.241479 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c018b-717a-4dce-abbb-4d3bd9ae0633 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:51.241766 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c018b-717a-4dce-abbb-4d3bd9ae0633 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:51.242038 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c018b-717a-4dce-abbb-4d3bd9ae0633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:51.261289 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-c73c018b-717a-4dce-abbb-4d3bd9ae0633 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:51.262489 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c73c018b-717a-4dce-abbb-4d3bd9ae0633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:51.270628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1290/2610] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:51.275111 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcd2c1-6c24-4fab-b61a-676c96f04f91 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:51.285820 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcd2c1-6c24-4fab-b61a-676c96f04f91 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:51.292442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1ff03-b3c8-488a-aeed-4373c793f473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:51.293197 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1ff03-b3c8-488a-aeed-4373c793f473 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:51.293478 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1ff03-b3c8-488a-aeed-4373c793f473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:51.293753 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1ff03-b3c8-488a-aeed-4373c793f473 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:51.294511 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1ff03-b3c8-488a-aeed-4373c793f473 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:46:51.294856 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1ff03-b3c8-488a-aeed-4373c793f473 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:51.296521 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1ff03-b3c8-488a-aeed-4373c793f473 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:51.309632 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1321/2611] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:46:51.314418 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c018b-717a-4dce-abbb-4d3bd9ae0633 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:51.324416 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c018b-717a-4dce-abbb-4d3bd9ae0633 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:51.329522 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e20cd-22ed-42da-b36d-4bcafef36bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:51.330178 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e20cd-22ed-42da-b36d-4bcafef36bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:51.330458 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e20cd-22ed-42da-b36d-4bcafef36bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:51.330772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e20cd-22ed-42da-b36d-4bcafef36bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:51.331465 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e20cd-22ed-42da-b36d-4bcafef36bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:51.333371 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e20cd-22ed-42da-b36d-4bcafef36bd4 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:51.361764 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1291/2612] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:46:51 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:46:51.365964 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1ff03-b3c8-488a-aeed-4373c793f473 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:51.376970 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1ff03-b3c8-488a-aeed-4373c793f473 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:51.386346 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:51.441455 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01db74e-afb5-4564-9a7e-9c583613ce88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:51.442141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01db74e-afb5-4564-9a7e-9c583613ce88 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:51.442421 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01db74e-afb5-4564-9a7e-9c583613ce88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:51.442758 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01db74e-afb5-4564-9a7e-9c583613ce88 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:51.443465 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01db74e-afb5-4564-9a7e-9c583613ce88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:51.445374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01db74e-afb5-4564-9a7e-9c583613ce88 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:51.470912 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1322/2613] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:46:51 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:46:51.475165 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e20cd-22ed-42da-b36d-4bcafef36bd4 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:51.480950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:51.487076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e20cd-22ed-42da-b36d-4bcafef36bd4 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:51.496457 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b4908-777b-4b06-9b1e-f42b74e7c108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:51.497547 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b4908-777b-4b06-9b1e-f42b74e7c108 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:51.498538 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b4908-777b-4b06-9b1e-f42b74e7c108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:51.499578 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b4908-777b-4b06-9b1e-f42b74e7c108 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:51.500395 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b4908-777b-4b06-9b1e-f42b74e7c108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:51.502523 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b4908-777b-4b06-9b1e-f42b74e7c108 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:51.514729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1292/2614] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:46:51.519036 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01db74e-afb5-4564-9a7e-9c583613ce88 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:51.529982 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01db74e-afb5-4564-9a7e-9c583613ce88 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:51.535175 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66a0a3-e56d-440b-af7c-dc317813f1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:51.535852 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66a0a3-e56d-440b-af7c-dc317813f1dd admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:51.536127 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66a0a3-e56d-440b-af7c-dc317813f1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:51.536394 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66a0a3-e56d-440b-af7c-dc317813f1dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:51.537119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66a0a3-e56d-440b-af7c-dc317813f1dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:51.538755 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66a0a3-e56d-440b-af7c-dc317813f1dd admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:51.549943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1323/2615] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:46:51.554294 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b4908-777b-4b06-9b1e-f42b74e7c108 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:51.566110 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b4908-777b-4b06-9b1e-f42b74e7c108 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:51.571290 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5c156-5588-4fba-8235-94ac2800dc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:51.572792 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5c156-5588-4fba-8235-94ac2800dc64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:51.573086 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5c156-5588-4fba-8235-94ac2800dc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:51.573358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5c156-5588-4fba-8235-94ac2800dc64 admin admin] PATH_INFO: `/v3/projects/a82579dab0ed4933bb5f667d9da50a92/users/2c724ca36aaf4c579be2039a826a6d46/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:51.592161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5c156-5588-4fba-8235-94ac2800dc64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a82579dab0ed4933bb5f667d9da50a92, user_id=2c724ca36aaf4c579be2039a826a6d46, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:51.595161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5c156-5588-4fba-8235-94ac2800dc64 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:51.609327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1293/2616] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:46:51 2022] PUT /identity/v3/projects/a82579dab0ed4933bb5f667d9da50a92/users/2c724ca36aaf4c579be2039a826a6d46/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:51.620363 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00814d-3054-44f5-b0f1-444daf5c9ea4 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:51.620648 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00814d-3054-44f5-b0f1-444daf5c9ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:51.620953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00814d-3054-44f5-b0f1-444daf5c9ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:51.651133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-9a00814d-3054-44f5-b0f1-444daf5c9ea4 None None] MFA Rules not processed for user `2c724ca36aaf4c579be2039a826a6d46`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:51.652484 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9a00814d-3054-44f5-b0f1-444daf5c9ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:51.719281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1324/2617] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:51.724269 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5c156-5588-4fba-8235-94ac2800dc64 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:51.802636 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5c156-5588-4fba-8235-94ac2800dc64 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:51.813099 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d173e-e10d-4350-87cf-688e7fd2c1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:51.813099 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d173e-e10d-4350-87cf-688e7fd2c1b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:51.813099 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d173e-e10d-4350-87cf-688e7fd2c1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:51.813099 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d173e-e10d-4350-87cf-688e7fd2c1b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:51.813523 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d173e-e10d-4350-87cf-688e7fd2c1b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:51.813523 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d173e-e10d-4350-87cf-688e7fd2c1b7 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:51.841186 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1294/2618] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:46:51 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:46:51.846494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00814d-3054-44f5-b0f1-444daf5c9ea4 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:51.858477 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00814d-3054-44f5-b0f1-444daf5c9ea4 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:51.921469 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb8326-145e-4fe4-ad49-fe7392afed54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:51.922155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb8326-145e-4fe4-ad49-fe7392afed54 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:51.922438 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb8326-145e-4fe4-ad49-fe7392afed54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:51.922747 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb8326-145e-4fe4-ad49-fe7392afed54 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:51.923440 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb8326-145e-4fe4-ad49-fe7392afed54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:51.925387 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb8326-145e-4fe4-ad49-fe7392afed54 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:51.949508 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1325/2619] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:46:51 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:46:51.953791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d173e-e10d-4350-87cf-688e7fd2c1b7 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:51.964675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d173e-e10d-4350-87cf-688e7fd2c1b7 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:51.969942 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733f044-11b2-41c8-b8d9-664704ee4e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:51.970636 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733f044-11b2-41c8-b8d9-664704ee4e58 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:51.970920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733f044-11b2-41c8-b8d9-664704ee4e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:51.971194 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733f044-11b2-41c8-b8d9-664704ee4e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:51.971924 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733f044-11b2-41c8-b8d9-664704ee4e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:51.973513 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733f044-11b2-41c8-b8d9-664704ee4e58 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:51.985954 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1295/2620] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:46:51.990235 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb8326-145e-4fe4-ad49-fe7392afed54 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:52.001511 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb8326-145e-4fe4-ad49-fe7392afed54 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:52.006707 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc04f1e-7186-4b78-846d-cee86ee15fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:52.007483 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc04f1e-7186-4b78-846d-cee86ee15fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:52.007666 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc04f1e-7186-4b78-846d-cee86ee15fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:52.007933 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc04f1e-7186-4b78-846d-cee86ee15fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:52.008641 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc04f1e-7186-4b78-846d-cee86ee15fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:52.011330 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc04f1e-7186-4b78-846d-cee86ee15fe2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:52.014133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:52.023877 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1326/2621] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:46:52.028068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733f044-11b2-41c8-b8d9-664704ee4e58 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:52.041741 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733f044-11b2-41c8-b8d9-664704ee4e58 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:52.046241 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb848e6-69b0-4d89-8a0c-a955746857a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:52.047170 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb848e6-69b0-4d89-8a0c-a955746857a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:52.047452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb848e6-69b0-4d89-8a0c-a955746857a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:52.047781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb848e6-69b0-4d89-8a0c-a955746857a5 admin admin] PATH_INFO: `/v3/projects/ba5032dea08148e09ad8fb1c8dfe0fc3/users/1a5fbfed728d46bbb10aa5f9f0efeaf6/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:52.063026 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb848e6-69b0-4d89-8a0c-a955746857a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba5032dea08148e09ad8fb1c8dfe0fc3, user_id=1a5fbfed728d46bbb10aa5f9f0efeaf6, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:52.065720 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb848e6-69b0-4d89-8a0c-a955746857a5 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:52.083143 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1296/2622] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:46:52 2022] PUT /identity/v3/projects/ba5032dea08148e09ad8fb1c8dfe0fc3/users/1a5fbfed728d46bbb10aa5f9f0efeaf6/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:52.095719 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d9c3a-ec1f-458c-a442-40c882265d86 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:52.096800 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d9c3a-ec1f-458c-a442-40c882265d86 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:52.097168 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d9c3a-ec1f-458c-a442-40c882265d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:52.125651 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-250d9c3a-ec1f-458c-a442-40c882265d86 None None] MFA Rules not processed for user `1a5fbfed728d46bbb10aa5f9f0efeaf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:52.127006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-250d9c3a-ec1f-458c-a442-40c882265d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:52.206466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1327/2623] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:52.210981 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb848e6-69b0-4d89-8a0c-a955746857a5 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:52.275028 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb848e6-69b0-4d89-8a0c-a955746857a5 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:52.279973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fefe0-7ded-4197-9400-780320fd92b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:52.280651 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fefe0-7ded-4197-9400-780320fd92b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:52.280988 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fefe0-7ded-4197-9400-780320fd92b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:52.281235 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fefe0-7ded-4197-9400-780320fd92b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:52.282460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fefe0-7ded-4197-9400-780320fd92b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:52.284477 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fefe0-7ded-4197-9400-780320fd92b9 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:52.314282 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1297/2624] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:46:52 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:46:52.318637 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d9c3a-ec1f-458c-a442-40c882265d86 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:52.329418 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d9c3a-ec1f-458c-a442-40c882265d86 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:52.388081 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad2efd-069b-4c17-b5b3-a9c3d48b41ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:52.388769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad2efd-069b-4c17-b5b3-a9c3d48b41ab admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:52.389146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad2efd-069b-4c17-b5b3-a9c3d48b41ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:52.389418 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad2efd-069b-4c17-b5b3-a9c3d48b41ab admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:52.390142 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad2efd-069b-4c17-b5b3-a9c3d48b41ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:52.392073 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad2efd-069b-4c17-b5b3-a9c3d48b41ab admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:52.413656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1328/2625] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:46:52 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:46:52.418118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fefe0-7ded-4197-9400-780320fd92b9 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:52.423673 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:52.429183 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fefe0-7ded-4197-9400-780320fd92b9 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:52.436365 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4450b-bb11-462a-b12c-1d40815565b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:52.437119 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4450b-bb11-462a-b12c-1d40815565b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:52.437301 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4450b-bb11-462a-b12c-1d40815565b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:52.437569 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4450b-bb11-462a-b12c-1d40815565b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:52.438437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4450b-bb11-462a-b12c-1d40815565b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:52.440068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4450b-bb11-462a-b12c-1d40815565b0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:52.450985 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1298/2626] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:46:52.455301 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad2efd-069b-4c17-b5b3-a9c3d48b41ab admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:52.465687 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad2efd-069b-4c17-b5b3-a9c3d48b41ab admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:52.470368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9415d-6762-4a55-837a-ef6a243021e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:52.471303 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9415d-6762-4a55-837a-ef6a243021e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:52.471582 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9415d-6762-4a55-837a-ef6a243021e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:52.471886 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9415d-6762-4a55-837a-ef6a243021e2 admin admin] PATH_INFO: `/v3/projects/b5833d5ec88d42b0a360c806553f3da0/users/10c94d14c92e4cdcae9017062ff64e34/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:52.486966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9415d-6762-4a55-837a-ef6a243021e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5833d5ec88d42b0a360c806553f3da0, user_id=10c94d14c92e4cdcae9017062ff64e34, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:52.489808 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9415d-6762-4a55-837a-ef6a243021e2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:52.508800 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1329/2627] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:46:52 2022] PUT /identity/v3/projects/b5833d5ec88d42b0a360c806553f3da0/users/10c94d14c92e4cdcae9017062ff64e34/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:52.513463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4450b-bb11-462a-b12c-1d40815565b0 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:52.525477 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4450b-bb11-462a-b12c-1d40815565b0 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:52.591425 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca142c0-9531-4eef-8317-71c737fc8d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:52.591923 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca142c0-9531-4eef-8317-71c737fc8d6b admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:52.592206 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca142c0-9531-4eef-8317-71c737fc8d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:52.592558 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca142c0-9531-4eef-8317-71c737fc8d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:52.593385 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca142c0-9531-4eef-8317-71c737fc8d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:52.595079 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca142c0-9531-4eef-8317-71c737fc8d6b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:52.606074 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1299/2628] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:46:52.610314 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9415d-6762-4a55-837a-ef6a243021e2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:52.621898 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9415d-6762-4a55-837a-ef6a243021e2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:52.627484 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6ff3c-45f8-4008-9588-0475b0df4644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:52.628449 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6ff3c-45f8-4008-9588-0475b0df4644 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:52.628733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6ff3c-45f8-4008-9588-0475b0df4644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:52.629210 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6ff3c-45f8-4008-9588-0475b0df4644 admin admin] PATH_INFO: `/v3/projects/b5833d5ec88d42b0a360c806553f3da0/users/10c94d14c92e4cdcae9017062ff64e34/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:52.632781 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6ff3c-45f8-4008-9588-0475b0df4644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5833d5ec88d42b0a360c806553f3da0, user_id=10c94d14c92e4cdcae9017062ff64e34, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:52.635459 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6ff3c-45f8-4008-9588-0475b0df4644 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:52.648193 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1330/2629] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:46:52 2022] PUT /identity/v3/projects/b5833d5ec88d42b0a360c806553f3da0/users/10c94d14c92e4cdcae9017062ff64e34/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:52.714967 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee599be-6b84-4214-8e1f-ec7e47e51251 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:52.715289 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee599be-6b84-4214-8e1f-ec7e47e51251 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:52.715565 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee599be-6b84-4214-8e1f-ec7e47e51251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:52.741916 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-5ee599be-6b84-4214-8e1f-ec7e47e51251 None None] MFA Rules not processed for user `10c94d14c92e4cdcae9017062ff64e34`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:52.743156 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5ee599be-6b84-4214-8e1f-ec7e47e51251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:52.825380 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1300/2630] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:52 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:52.837576 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6ff3c-45f8-4008-9588-0475b0df4644 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:52.839527 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-04f6ff3c-45f8-4008-9588-0475b0df4644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:52.887175 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:52.902593 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6ff3c-45f8-4008-9588-0475b0df4644 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:52.906174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bd984-089c-423c-b1bb-6b6393f49c7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:52.906869 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bd984-089c-423c-b1bb-6b6393f49c7e service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:52.907145 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bd984-089c-423c-b1bb-6b6393f49c7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:52.907403 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bd984-089c-423c-b1bb-6b6393f49c7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:52.964608 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bd984-089c-423c-b1bb-6b6393f49c7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:52.966045 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bd984-089c-423c-b1bb-6b6393f49c7e service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:52.975016 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1331/2631] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:54.672778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee599be-6b84-4214-8e1f-ec7e47e51251 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:54.683263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee599be-6b84-4214-8e1f-ec7e47e51251 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:54.687487 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b2af1-d217-4f52-ad24-8ed98982e9f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:54.688133 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b2af1-d217-4f52-ad24-8ed98982e9f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:54.688413 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b2af1-d217-4f52-ad24-8ed98982e9f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:54.688679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b2af1-d217-4f52-ad24-8ed98982e9f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:54.754933 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b2af1-d217-4f52-ad24-8ed98982e9f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:54.756633 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b2af1-d217-4f52-ad24-8ed98982e9f9 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:54.767867 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1301/2632] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:55.380854 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bd984-089c-423c-b1bb-6b6393f49c7e service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:55.390912 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bd984-089c-423c-b1bb-6b6393f49c7e service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:55.394819 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb38000-97bf-4334-8d4e-a4236a77a072 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:55.395637 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb38000-97bf-4334-8d4e-a4236a77a072 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:55.395905 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb38000-97bf-4334-8d4e-a4236a77a072 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:55.396168 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb38000-97bf-4334-8d4e-a4236a77a072 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:55.406859 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb38000-97bf-4334-8d4e-a4236a77a072 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:55.408274 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb38000-97bf-4334-8d4e-a4236a77a072 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:55.418455 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1332/2633] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:57.405897 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b2af1-d217-4f52-ad24-8ed98982e9f9 service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:57.408164 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-435b2af1-d217-4f52-ad24-8ed98982e9f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:57.426244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:57.481478 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b2af1-d217-4f52-ad24-8ed98982e9f9 service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:57.486535 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb166b-886e-46e3-8c25-f9dfe2f8fcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:57.487485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb166b-886e-46e3-8c25-f9dfe2f8fcf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:57.487764 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb166b-886e-46e3-8c25-f9dfe2f8fcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:57.488033 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb166b-886e-46e3-8c25-f9dfe2f8fcf9 admin admin] PATH_INFO: `/v3/users/3d43e801e85b43eda273a27bfb982bcc` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:57.489254 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb166b-886e-46e3-8c25-f9dfe2f8fcf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d43e801e85b43eda273a27bfb982bcc)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:57.491198 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb166b-886e-46e3-8c25-f9dfe2f8fcf9 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:57.548537 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2deb166b-886e-46e3-8c25-f9dfe2f8fcf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d43e801e85b43eda273a27bfb982bcc'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:57.557159 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2deb166b-886e-46e3-8c25-f9dfe2f8fcf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d43e801e85b43eda273a27bfb982bcc'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:57.558032 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2deb166b-886e-46e3-8c25-f9dfe2f8fcf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d43e801e85b43eda273a27bfb982bcc'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:57.567319 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2deb166b-886e-46e3-8c25-f9dfe2f8fcf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d43e801e85b43eda273a27bfb982bcc'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:57.581058 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2deb166b-886e-46e3-8c25-f9dfe2f8fcf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d43e801e85b43eda273a27bfb982bcc'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:57.587390 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1302/2634] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:46:57 2022] DELETE /identity/v3/users/3d43e801e85b43eda273a27bfb982bcc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:57.592452 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc502c5-176f-401a-a37b-aaf864353a94 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:57.592971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc502c5-176f-401a-a37b-aaf864353a94 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:57.592971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc502c5-176f-401a-a37b-aaf864353a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:57.609967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-cfc502c5-176f-401a-a37b-aaf864353a94 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:57.611302 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cfc502c5-176f-401a-a37b-aaf864353a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:57.677610 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1333/2635] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:57.687860 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb166b-886e-46e3-8c25-f9dfe2f8fcf9 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:57.689410 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2deb166b-886e-46e3-8c25-f9dfe2f8fcf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:57.749161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb166b-886e-46e3-8c25-f9dfe2f8fcf9 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:57.753026 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e42c5c-0933-4aa4-9aa0-4e51cd47c9ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:57.753687 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e42c5c-0933-4aa4-9aa0-4e51cd47c9ee service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:57.753964 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e42c5c-0933-4aa4-9aa0-4e51cd47c9ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:57.754236 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e42c5c-0933-4aa4-9aa0-4e51cd47c9ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:57.764711 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e42c5c-0933-4aa4-9aa0-4e51cd47c9ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:57.766161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e42c5c-0933-4aa4-9aa0-4e51cd47c9ee service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:57.778467 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1303/2636] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:58.355655 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc502c5-176f-401a-a37b-aaf864353a94 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:58.358875 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cfc502c5-176f-401a-a37b-aaf864353a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:58.393836 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc502c5-176f-401a-a37b-aaf864353a94 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:58.399667 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d329c-ce1c-416b-ab34-8d03fe2f0104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:58.400555 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d329c-ce1c-416b-ab34-8d03fe2f0104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:58.400884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d329c-ce1c-416b-ab34-8d03fe2f0104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:58.401372 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d329c-ce1c-416b-ab34-8d03fe2f0104 admin admin] PATH_INFO: `/v3/projects/5a1176f63c794b9dbca24e3280216b60` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:58.403077 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d329c-ce1c-416b-ab34-8d03fe2f0104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a1176f63c794b9dbca24e3280216b60)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:58.405003 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d329c-ce1c-416b-ab34-8d03fe2f0104 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:58.456689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-728d329c-ce1c-416b-ab34-8d03fe2f0104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a1176f63c794b9dbca24e3280216b60', 'request_id': 'req-728d329c-ce1c-416b-ab34-8d03fe2f0104'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:58.464458 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-728d329c-ce1c-416b-ab34-8d03fe2f0104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a1176f63c794b9dbca24e3280216b60', 'request_id': 'req-728d329c-ce1c-416b-ab34-8d03fe2f0104'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:58.472968 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-728d329c-ce1c-416b-ab34-8d03fe2f0104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a1176f63c794b9dbca24e3280216b60', 'request_id': 'req-728d329c-ce1c-416b-ab34-8d03fe2f0104'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:58.490531 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-728d329c-ce1c-416b-ab34-8d03fe2f0104 admin admin] The token cache is being invalidate because project 5a1176f63c794b9dbca24e3280216b60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:46:58.490841 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-728d329c-ce1c-416b-ab34-8d03fe2f0104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:58.491568 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-728d329c-ce1c-416b-ab34-8d03fe2f0104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:58.493517 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1334/2637] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:46:58 2022] DELETE /identity/v3/projects/5a1176f63c794b9dbca24e3280216b60 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:58.499400 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555227f-8028-41ba-8f0f-684d05e4fc37 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:58.499921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555227f-8028-41ba-8f0f-684d05e4fc37 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:58.499921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555227f-8028-41ba-8f0f-684d05e4fc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:58.519456 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-4555227f-8028-41ba-8f0f-684d05e4fc37 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:58.520766 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4555227f-8028-41ba-8f0f-684d05e4fc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:58.551321 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:58.586417 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1304/2638] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:58.595673 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a71ef-c82d-4a6d-9241-026ed55d9dd3 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:58.596241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a71ef-c82d-4a6d-9241-026ed55d9dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:58.596241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a71ef-c82d-4a6d-9241-026ed55d9dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:58.603662 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:58.616704 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4f8a71ef-c82d-4a6d-9241-026ed55d9dd3 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:58.618363 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4f8a71ef-c82d-4a6d-9241-026ed55d9dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:58.629951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1335/2639] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:58.632178 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555227f-8028-41ba-8f0f-684d05e4fc37 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:58.643576 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555227f-8028-41ba-8f0f-684d05e4fc37 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:58.648528 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167abff7-c0a5-49ba-81da-d7b12e99cc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:58.649227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167abff7-c0a5-49ba-81da-d7b12e99cc11 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:58.649510 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167abff7-c0a5-49ba-81da-d7b12e99cc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:58.649776 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167abff7-c0a5-49ba-81da-d7b12e99cc11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:58.650496 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167abff7-c0a5-49ba-81da-d7b12e99cc11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:46:58.650836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167abff7-c0a5-49ba-81da-d7b12e99cc11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:58.652474 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167abff7-c0a5-49ba-81da-d7b12e99cc11 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:58.664709 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1305/2640] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:46:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:46:58.669697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a71ef-c82d-4a6d-9241-026ed55d9dd3 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:58.679981 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a71ef-c82d-4a6d-9241-026ed55d9dd3 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:58.685189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93ea23-9934-446c-8bb2-9a485d30bb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:58.685872 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93ea23-9934-446c-8bb2-9a485d30bb36 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:58.686144 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93ea23-9934-446c-8bb2-9a485d30bb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:58.686411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93ea23-9934-446c-8bb2-9a485d30bb36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:58.687168 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93ea23-9934-446c-8bb2-9a485d30bb36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:58.689097 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93ea23-9934-446c-8bb2-9a485d30bb36 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:58.716377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1336/2641] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:46:58 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:46:58.720738 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167abff7-c0a5-49ba-81da-d7b12e99cc11 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:58.732679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167abff7-c0a5-49ba-81da-d7b12e99cc11 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:58.798602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45483e-ce10-44a3-a73a-2d5b931b1522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:58.799365 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45483e-ce10-44a3-a73a-2d5b931b1522 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:58.799743 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45483e-ce10-44a3-a73a-2d5b931b1522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:58.800055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45483e-ce10-44a3-a73a-2d5b931b1522 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:58.800770 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45483e-ce10-44a3-a73a-2d5b931b1522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:58.802733 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45483e-ce10-44a3-a73a-2d5b931b1522 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:58.831489 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1306/2642] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:46:58 2022] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:46:58.835607 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93ea23-9934-446c-8bb2-9a485d30bb36 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:58.850351 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93ea23-9934-446c-8bb2-9a485d30bb36 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:58.857446 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92001ff-f373-4c99-bea6-25ef68d05ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:58.858513 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92001ff-f373-4c99-bea6-25ef68d05ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:58.858798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92001ff-f373-4c99-bea6-25ef68d05ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:58.859077 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92001ff-f373-4c99-bea6-25ef68d05ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:58.859857 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92001ff-f373-4c99-bea6-25ef68d05ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:58.861666 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92001ff-f373-4c99-bea6-25ef68d05ac8 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:58.875546 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1337/2643] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:46:58.880241 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45483e-ce10-44a3-a73a-2d5b931b1522 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:58.892437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45483e-ce10-44a3-a73a-2d5b931b1522 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:58.897825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3652c6e-c668-430c-b00a-a2da54c58934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:58.898524 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3652c6e-c668-430c-b00a-a2da54c58934 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:58.898907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3652c6e-c668-430c-b00a-a2da54c58934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:58.899250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3652c6e-c668-430c-b00a-a2da54c58934 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:58.900207 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3652c6e-c668-430c-b00a-a2da54c58934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:58.902054 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3652c6e-c668-430c-b00a-a2da54c58934 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:58.913228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1307/2644] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:46:58.917649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92001ff-f373-4c99-bea6-25ef68d05ac8 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:58.928075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92001ff-f373-4c99-bea6-25ef68d05ac8 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:58.933195 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd505c-18ca-4e96-9efb-07913b90955f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:58.934090 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd505c-18ca-4e96-9efb-07913b90955f admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:58.934366 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd505c-18ca-4e96-9efb-07913b90955f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:58.934793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd505c-18ca-4e96-9efb-07913b90955f admin admin] PATH_INFO: `/v3/projects/19dfbd46e52d42cda677581f20ea3bb3/users/f481b44095734e70a6f76a3558d0233b/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:58.951172 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd505c-18ca-4e96-9efb-07913b90955f admin admin] RBAC: Authorizing `identity:create_grant(project_id=19dfbd46e52d42cda677581f20ea3bb3, user_id=f481b44095734e70a6f76a3558d0233b, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:58.953793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd505c-18ca-4e96-9efb-07913b90955f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:58.969953 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1338/2645] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:46:58 2022] PUT /identity/v3/projects/19dfbd46e52d42cda677581f20ea3bb3/users/f481b44095734e70a6f76a3558d0233b/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:58.980904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d347b99-7402-4920-865a-c2304197dcdb None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:58.981194 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d347b99-7402-4920-865a-c2304197dcdb None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:58.981473 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d347b99-7402-4920-865a-c2304197dcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:59.009101 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-8d347b99-7402-4920-865a-c2304197dcdb None None] MFA Rules not processed for user `f481b44095734e70a6f76a3558d0233b`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:59.010788 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8d347b99-7402-4920-865a-c2304197dcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:59.085628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1308/2646] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:59.090492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd505c-18ca-4e96-9efb-07913b90955f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:59.157290 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd505c-18ca-4e96-9efb-07913b90955f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:59.161971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386d40b-0daa-4da3-b1da-68ce77abc4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:59.162724 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386d40b-0daa-4da3-b1da-68ce77abc4cc admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:59.163019 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386d40b-0daa-4da3-b1da-68ce77abc4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:59.163316 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386d40b-0daa-4da3-b1da-68ce77abc4cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:59.164009 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386d40b-0daa-4da3-b1da-68ce77abc4cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:59.166686 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386d40b-0daa-4da3-b1da-68ce77abc4cc admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:59.198410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1339/2647] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:46:59 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:46:59.199791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d347b99-7402-4920-865a-c2304197dcdb None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:59.211715 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d347b99-7402-4920-865a-c2304197dcdb None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:59.239253 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:59.278350 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b40b49-eb83-4719-a76b-bc87e3fb0247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:59.279215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b40b49-eb83-4719-a76b-bc87e3fb0247 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:59.279215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b40b49-eb83-4719-a76b-bc87e3fb0247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:59.279754 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b40b49-eb83-4719-a76b-bc87e3fb0247 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:59.280769 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b40b49-eb83-4719-a76b-bc87e3fb0247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:59.283170 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b40b49-eb83-4719-a76b-bc87e3fb0247 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:59.317442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1309/2648] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:46:59 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:46:59.317564 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386d40b-0daa-4da3-b1da-68ce77abc4cc admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:59.328918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386d40b-0daa-4da3-b1da-68ce77abc4cc admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:59.334629 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ff582-ca65-48b6-9b6d-0ff91ff8be2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:59.335335 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ff582-ca65-48b6-9b6d-0ff91ff8be2c admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:59.335612 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ff582-ca65-48b6-9b6d-0ff91ff8be2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:59.335879 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ff582-ca65-48b6-9b6d-0ff91ff8be2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:59.336604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ff582-ca65-48b6-9b6d-0ff91ff8be2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:59.338259 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ff582-ca65-48b6-9b6d-0ff91ff8be2c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:59.343521 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b40b49-eb83-4719-a76b-bc87e3fb0247 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:59.345559 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-32b40b49-eb83-4719-a76b-bc87e3fb0247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:59.356551 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1340/2649] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:46:59.357960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ff582-ca65-48b6-9b6d-0ff91ff8be2c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:59.360397 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b40b49-eb83-4719-a76b-bc87e3fb0247 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:59.367174 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c63b9-f383-4a0d-802d-1c49ab0ae32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:59.368043 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ff582-ca65-48b6-9b6d-0ff91ff8be2c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:59.368186 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c63b9-f383-4a0d-802d-1c49ab0ae32d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:59.368347 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c63b9-f383-4a0d-802d-1c49ab0ae32d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:59.368613 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c63b9-f383-4a0d-802d-1c49ab0ae32d admin admin] PATH_INFO: `/v3/users/2c724ca36aaf4c579be2039a826a6d46` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:59.370151 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c63b9-f383-4a0d-802d-1c49ab0ae32d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c724ca36aaf4c579be2039a826a6d46)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:59.372267 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c63b9-f383-4a0d-802d-1c49ab0ae32d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:59.373272 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bd2b0-4145-4fc0-af94-63dfd3567d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:59.374220 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bd2b0-4145-4fc0-af94-63dfd3567d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:59.374495 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bd2b0-4145-4fc0-af94-63dfd3567d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:59.374787 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bd2b0-4145-4fc0-af94-63dfd3567d33 admin admin] PATH_INFO: `/v3/projects/0efe17a1c26d4e5c957924d66bc94893/users/d9bec498876543f6b6582374ef23c008/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:59.392102 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861bd2b0-4145-4fc0-af94-63dfd3567d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0efe17a1c26d4e5c957924d66bc94893, user_id=d9bec498876543f6b6582374ef23c008, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:59.394803 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861bd2b0-4145-4fc0-af94-63dfd3567d33 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:59.411439 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1341/2650] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:46:59 2022] PUT /identity/v3/projects/0efe17a1c26d4e5c957924d66bc94893/users/d9bec498876543f6b6582374ef23c008/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:46:59.415466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bd2b0-4145-4fc0-af94-63dfd3567d33 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:59.425675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-da8c63b9-f383-4a0d-802d-1c49ab0ae32d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c724ca36aaf4c579be2039a826a6d46'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:59.434323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-da8c63b9-f383-4a0d-802d-1c49ab0ae32d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c724ca36aaf4c579be2039a826a6d46'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:59.434993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-da8c63b9-f383-4a0d-802d-1c49ab0ae32d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c724ca36aaf4c579be2039a826a6d46'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:59.442220 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-da8c63b9-f383-4a0d-802d-1c49ab0ae32d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c724ca36aaf4c579be2039a826a6d46'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:59.454849 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-da8c63b9-f383-4a0d-802d-1c49ab0ae32d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c724ca36aaf4c579be2039a826a6d46'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:59.461064 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1310/2651] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:46:59 2022] DELETE /identity/v3/users/2c724ca36aaf4c579be2039a826a6d46 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:59.465517 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d434f96-5036-4df3-8e9e-72fa543cd20e None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:59.465798 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d434f96-5036-4df3-8e9e-72fa543cd20e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:59.466072 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d434f96-5036-4df3-8e9e-72fa543cd20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:59.471862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:59.484321 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bd2b0-4145-4fc0-af94-63dfd3567d33 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:59.484847 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-3d434f96-5036-4df3-8e9e-72fa543cd20e None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:59.486066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3d434f96-5036-4df3-8e9e-72fa543cd20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:59.542266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9050525-4972-4e6a-84ee-e1baa0390436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:59.542936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9050525-4972-4e6a-84ee-e1baa0390436 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:59.543217 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9050525-4972-4e6a-84ee-e1baa0390436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:59.543481 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9050525-4972-4e6a-84ee-e1baa0390436 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:59.544203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9050525-4972-4e6a-84ee-e1baa0390436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:59.545887 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9050525-4972-4e6a-84ee-e1baa0390436 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:59.547821 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1311/2652] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:59.556381 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1342/2653] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:46:59.557665 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d434f96-5036-4df3-8e9e-72fa543cd20e None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:59.559472 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3d434f96-5036-4df3-8e9e-72fa543cd20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:59.560430 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9050525-4972-4e6a-84ee-e1baa0390436 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:59.562915 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c9050525-4972-4e6a-84ee-e1baa0390436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:59.576503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9050525-4972-4e6a-84ee-e1baa0390436 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:59.581594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc9a6c-ed8e-4e7e-b846-2cb38deb419b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:59.582490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc9a6c-ed8e-4e7e-b846-2cb38deb419b admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:59.582817 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc9a6c-ed8e-4e7e-b846-2cb38deb419b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:59.583088 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc9a6c-ed8e-4e7e-b846-2cb38deb419b admin admin] PATH_INFO: `/v3/projects/0efe17a1c26d4e5c957924d66bc94893/users/d9bec498876543f6b6582374ef23c008/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:59.585170 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc9a6c-ed8e-4e7e-b846-2cb38deb419b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0efe17a1c26d4e5c957924d66bc94893, user_id=d9bec498876543f6b6582374ef23c008, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:59.587842 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc9a6c-ed8e-4e7e-b846-2cb38deb419b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:59.598973 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1343/2654] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:46:59 2022] PUT /identity/v3/projects/0efe17a1c26d4e5c957924d66bc94893/users/d9bec498876543f6b6582374ef23c008/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:46:59.599723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:59.609481 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d5803-a21d-491e-b072-723d93a7456b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:59.609767 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d5803-a21d-491e-b072-723d93a7456b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:59.610044 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d5803-a21d-491e-b072-723d93a7456b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:59.626183 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d434f96-5036-4df3-8e9e-72fa543cd20e None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:59.637969 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-035d5803-a21d-491e-b072-723d93a7456b None None] MFA Rules not processed for user `d9bec498876543f6b6582374ef23c008`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:59.639184 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-035d5803-a21d-491e-b072-723d93a7456b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:59.676791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce9f1e-61ca-44b7-ac7b-9da62cd44a24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:59.677452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce9f1e-61ca-44b7-ac7b-9da62cd44a24 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:59.677729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce9f1e-61ca-44b7-ac7b-9da62cd44a24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:59.677998 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce9f1e-61ca-44b7-ac7b-9da62cd44a24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:59.706894 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1344/2655] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:46:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:59.718040 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d5803-a21d-491e-b072-723d93a7456b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:59.719514 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-035d5803-a21d-491e-b072-723d93a7456b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:59.738223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce9f1e-61ca-44b7-ac7b-9da62cd44a24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:59.739737 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce9f1e-61ca-44b7-ac7b-9da62cd44a24 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:59.749951 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1312/2656] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:59.777418 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d5803-a21d-491e-b072-723d93a7456b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:59.781292 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449282e-90a6-42fb-953f-b367f6822b82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:59.781959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449282e-90a6-42fb-953f-b367f6822b82 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:59.782468 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449282e-90a6-42fb-953f-b367f6822b82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:59.782773 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449282e-90a6-42fb-953f-b367f6822b82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:59.792069 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449282e-90a6-42fb-953f-b367f6822b82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:59.793508 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449282e-90a6-42fb-953f-b367f6822b82 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:59.803516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1345/2657] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:46:59.880742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce9f1e-61ca-44b7-ac7b-9da62cd44a24 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:59.891245 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce9f1e-61ca-44b7-ac7b-9da62cd44a24 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:59.895588 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a1970-62b2-4578-aeb4-c529fd2d7906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:59.896469 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a1970-62b2-4578-aeb4-c529fd2d7906 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:59.896469 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a1970-62b2-4578-aeb4-c529fd2d7906 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:59.896765 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a1970-62b2-4578-aeb4-c529fd2d7906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:59.898653 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9d5a1970-62b2-4578-aeb4-c529fd2d7906 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:59.960952 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a1970-62b2-4578-aeb4-c529fd2d7906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:59.962421 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a1970-62b2-4578-aeb4-c529fd2d7906 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:59.972078 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1313/2658] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:59 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:00.031203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449282e-90a6-42fb-953f-b367f6822b82 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:00.032610 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8449282e-90a6-42fb-953f-b367f6822b82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:00.048614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449282e-90a6-42fb-953f-b367f6822b82 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:00.053481 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d190d2f-1276-4c91-9af7-f61b05d9cab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:00.054355 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d190d2f-1276-4c91-9af7-f61b05d9cab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:00.054675 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d190d2f-1276-4c91-9af7-f61b05d9cab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:00.054949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d190d2f-1276-4c91-9af7-f61b05d9cab5 admin admin] PATH_INFO: `/v3/projects/a82579dab0ed4933bb5f667d9da50a92` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:00.056129 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d190d2f-1276-4c91-9af7-f61b05d9cab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a82579dab0ed4933bb5f667d9da50a92)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:00.058261 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d190d2f-1276-4c91-9af7-f61b05d9cab5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:00.061512 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:00.120739 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2d190d2f-1276-4c91-9af7-f61b05d9cab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a82579dab0ed4933bb5f667d9da50a92', 'request_id': 'req-2d190d2f-1276-4c91-9af7-f61b05d9cab5'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:00.126636 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2d190d2f-1276-4c91-9af7-f61b05d9cab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a82579dab0ed4933bb5f667d9da50a92', 'request_id': 'req-2d190d2f-1276-4c91-9af7-f61b05d9cab5'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:00.133469 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2d190d2f-1276-4c91-9af7-f61b05d9cab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a82579dab0ed4933bb5f667d9da50a92', 'request_id': 'req-2d190d2f-1276-4c91-9af7-f61b05d9cab5'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:00.147492 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2d190d2f-1276-4c91-9af7-f61b05d9cab5 admin admin] The token cache is being invalidate because project a82579dab0ed4933bb5f667d9da50a92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:47:00.147781 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2d190d2f-1276-4c91-9af7-f61b05d9cab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:00.148432 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2d190d2f-1276-4c91-9af7-f61b05d9cab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:00.150058 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1346/2659] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:47:00 2022] DELETE /identity/v3/projects/a82579dab0ed4933bb5f667d9da50a92 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:00.154094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a1970-62b2-4578-aeb4-c529fd2d7906 service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:00.171640 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a1970-62b2-4578-aeb4-c529fd2d7906 service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:00.211623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:00.238603 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd43c9-0d27-43cf-981e-5db31dd4f5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:00.239497 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd43c9-0d27-43cf-981e-5db31dd4f5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:00.239892 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd43c9-0d27-43cf-981e-5db31dd4f5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:00.240049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd43c9-0d27-43cf-981e-5db31dd4f5a7 admin admin] PATH_INFO: `/v3/users/1a5fbfed728d46bbb10aa5f9f0efeaf6` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:00.241206 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd43c9-0d27-43cf-981e-5db31dd4f5a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a5fbfed728d46bbb10aa5f9f0efeaf6)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:00.243136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd43c9-0d27-43cf-981e-5db31dd4f5a7 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:00.291552 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bcbd43c9-0d27-43cf-981e-5db31dd4f5a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a5fbfed728d46bbb10aa5f9f0efeaf6'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:00.299768 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bcbd43c9-0d27-43cf-981e-5db31dd4f5a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a5fbfed728d46bbb10aa5f9f0efeaf6'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:00.300378 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bcbd43c9-0d27-43cf-981e-5db31dd4f5a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a5fbfed728d46bbb10aa5f9f0efeaf6'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:00.313470 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bcbd43c9-0d27-43cf-981e-5db31dd4f5a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a5fbfed728d46bbb10aa5f9f0efeaf6'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:00.327493 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bcbd43c9-0d27-43cf-981e-5db31dd4f5a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a5fbfed728d46bbb10aa5f9f0efeaf6'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:00.337361 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1314/2660] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:47:00 2022] DELETE /identity/v3/users/1a5fbfed728d46bbb10aa5f9f0efeaf6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:47:00.527747 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d190d2f-1276-4c91-9af7-f61b05d9cab5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:00.529243 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2d190d2f-1276-4c91-9af7-f61b05d9cab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:00.542413 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d190d2f-1276-4c91-9af7-f61b05d9cab5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:00.608787 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4c8f1-a227-4a8a-9f01-00c5124091e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:00.608787 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4c8f1-a227-4a8a-9f01-00c5124091e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:00.608787 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4c8f1-a227-4a8a-9f01-00c5124091e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:00.608787 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4c8f1-a227-4a8a-9f01-00c5124091e3 admin admin] PATH_INFO: `/v3/users/adb887da93534a9cb682034b8945cf7b` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:00.609981 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4c8f1-a227-4a8a-9f01-00c5124091e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adb887da93534a9cb682034b8945cf7b)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:00.612009 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4c8f1-a227-4a8a-9f01-00c5124091e3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:00.633040 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd43c9-0d27-43cf-981e-5db31dd4f5a7 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:00.635293 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-bcbd43c9-0d27-43cf-981e-5db31dd4f5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:00.652371 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd43c9-0d27-43cf-981e-5db31dd4f5a7 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:00.659296 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73725091-db8f-4a0a-a1c1-8e498b3c2e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:00.660492 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73725091-db8f-4a0a-a1c1-8e498b3c2e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:00.660920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73725091-db8f-4a0a-a1c1-8e498b3c2e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:00.661345 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73725091-db8f-4a0a-a1c1-8e498b3c2e99 admin admin] PATH_INFO: `/v3/projects/ba5032dea08148e09ad8fb1c8dfe0fc3` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:00.663167 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73725091-db8f-4a0a-a1c1-8e498b3c2e99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba5032dea08148e09ad8fb1c8dfe0fc3)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:00.666143 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73725091-db8f-4a0a-a1c1-8e498b3c2e99 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:00.672532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0ed4c8f1-a227-4a8a-9f01-00c5124091e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adb887da93534a9cb682034b8945cf7b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:00.682943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0ed4c8f1-a227-4a8a-9f01-00c5124091e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adb887da93534a9cb682034b8945cf7b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:00.684026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0ed4c8f1-a227-4a8a-9f01-00c5124091e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adb887da93534a9cb682034b8945cf7b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:00.697177 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0ed4c8f1-a227-4a8a-9f01-00c5124091e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adb887da93534a9cb682034b8945cf7b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:00.697907 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0ed4c8f1-a227-4a8a-9f01-00c5124091e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adb887da93534a9cb682034b8945cf7b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:00.712033 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1347/2661] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:47:00 2022] DELETE /identity/v3/users/adb887da93534a9cb682034b8945cf7b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:47:00.716717 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776195b-70fb-47bd-9285-734557e60f88 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:00.717004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776195b-70fb-47bd-9285-734557e60f88 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:00.717279 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776195b-70fb-47bd-9285-734557e60f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:00.720329 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-73725091-db8f-4a0a-a1c1-8e498b3c2e99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba5032dea08148e09ad8fb1c8dfe0fc3', 'request_id': 'req-73725091-db8f-4a0a-a1c1-8e498b3c2e99'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:00.725882 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-73725091-db8f-4a0a-a1c1-8e498b3c2e99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba5032dea08148e09ad8fb1c8dfe0fc3', 'request_id': 'req-73725091-db8f-4a0a-a1c1-8e498b3c2e99'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:00.732134 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-73725091-db8f-4a0a-a1c1-8e498b3c2e99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba5032dea08148e09ad8fb1c8dfe0fc3', 'request_id': 'req-73725091-db8f-4a0a-a1c1-8e498b3c2e99'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:00.734370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a776195b-70fb-47bd-9285-734557e60f88 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:00.735611 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a776195b-70fb-47bd-9285-734557e60f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:00.741550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:00.745568 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-73725091-db8f-4a0a-a1c1-8e498b3c2e99 admin admin] The token cache is being invalidate because project ba5032dea08148e09ad8fb1c8dfe0fc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:47:00.745866 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-73725091-db8f-4a0a-a1c1-8e498b3c2e99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:00.746488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-73725091-db8f-4a0a-a1c1-8e498b3c2e99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:00.748070 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1315/2662] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:47:00 2022] DELETE /identity/v3/projects/ba5032dea08148e09ad8fb1c8dfe0fc3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:47:00.752343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73725091-db8f-4a0a-a1c1-8e498b3c2e99 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:00.753739 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-73725091-db8f-4a0a-a1c1-8e498b3c2e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:00.795023 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:00.802621 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1348/2663] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:00.813059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776195b-70fb-47bd-9285-734557e60f88 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:00.814516 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a776195b-70fb-47bd-9285-734557e60f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:00.823057 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73725091-db8f-4a0a-a1c1-8e498b3c2e99 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:00.828987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b2959-4582-4a48-b338-1ebd4731de73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:00.829981 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b2959-4582-4a48-b338-1ebd4731de73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:00.830264 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b2959-4582-4a48-b338-1ebd4731de73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:00.830538 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b2959-4582-4a48-b338-1ebd4731de73 admin admin] PATH_INFO: `/v3/users/10c94d14c92e4cdcae9017062ff64e34` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:00.831822 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b2959-4582-4a48-b338-1ebd4731de73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c94d14c92e4cdcae9017062ff64e34)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:00.833909 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b2959-4582-4a48-b338-1ebd4731de73 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:00.872127 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776195b-70fb-47bd-9285-734557e60f88 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:00.875877 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762db59-1bf7-4ead-b154-811f970205b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:00.876530 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762db59-1bf7-4ead-b154-811f970205b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:00.876808 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762db59-1bf7-4ead-b154-811f970205b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:00.877076 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762db59-1bf7-4ead-b154-811f970205b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:00.883134 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-033b2959-4582-4a48-b338-1ebd4731de73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c94d14c92e4cdcae9017062ff64e34'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:00.886769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762db59-1bf7-4ead-b154-811f970205b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:00.888190 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762db59-1bf7-4ead-b154-811f970205b4 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:00.891862 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-033b2959-4582-4a48-b338-1ebd4731de73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c94d14c92e4cdcae9017062ff64e34'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:00.892510 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-033b2959-4582-4a48-b338-1ebd4731de73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c94d14c92e4cdcae9017062ff64e34'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:00.898118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1349/2664] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:00.904193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-033b2959-4582-4a48-b338-1ebd4731de73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c94d14c92e4cdcae9017062ff64e34'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:00.916993 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-033b2959-4582-4a48-b338-1ebd4731de73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c94d14c92e4cdcae9017062ff64e34'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:00.923392 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1316/2665] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:47:00 2022] DELETE /identity/v3/users/10c94d14c92e4cdcae9017062ff64e34 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:47:01.297044 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762db59-1bf7-4ead-b154-811f970205b4 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:01.298990 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5762db59-1bf7-4ead-b154-811f970205b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:01.316986 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762db59-1bf7-4ead-b154-811f970205b4 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:01.356466 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b2959-4582-4a48-b338-1ebd4731de73 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:01.358228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-033b2959-4582-4a48-b338-1ebd4731de73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:01.392485 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391be57e-fbab-4c56-8b5d-913af7500cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:01.393757 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391be57e-fbab-4c56-8b5d-913af7500cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:01.394179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391be57e-fbab-4c56-8b5d-913af7500cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:01.394491 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391be57e-fbab-4c56-8b5d-913af7500cc8 admin admin] PATH_INFO: `/v3/projects/357b81c098e04662a4b794cae3a3d181` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:01.395900 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391be57e-fbab-4c56-8b5d-913af7500cc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=357b81c098e04662a4b794cae3a3d181)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:01.398303 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391be57e-fbab-4c56-8b5d-913af7500cc8 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:01.453388 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b2959-4582-4a48-b338-1ebd4731de73 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:01.454908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-391be57e-fbab-4c56-8b5d-913af7500cc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '357b81c098e04662a4b794cae3a3d181', 'request_id': 'req-391be57e-fbab-4c56-8b5d-913af7500cc8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:01.465520 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:01.465520 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-391be57e-fbab-4c56-8b5d-913af7500cc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '357b81c098e04662a4b794cae3a3d181', 'request_id': 'req-391be57e-fbab-4c56-8b5d-913af7500cc8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:01.473154 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-391be57e-fbab-4c56-8b5d-913af7500cc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '357b81c098e04662a4b794cae3a3d181', 'request_id': 'req-391be57e-fbab-4c56-8b5d-913af7500cc8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:01.486984 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-391be57e-fbab-4c56-8b5d-913af7500cc8 admin admin] The token cache is being invalidate because project 357b81c098e04662a4b794cae3a3d181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:47:01.487417 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-391be57e-fbab-4c56-8b5d-913af7500cc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:01.488059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-391be57e-fbab-4c56-8b5d-913af7500cc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:01.490284 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1350/2666] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:47:01 2022] DELETE /identity/v3/projects/357b81c098e04662a4b794cae3a3d181 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:01.493689 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391be57e-fbab-4c56-8b5d-913af7500cc8 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:01.495089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-391be57e-fbab-4c56-8b5d-913af7500cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:01.516120 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9ad54-4936-4723-9aa0-f4594f922e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:01.517005 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9ad54-4936-4723-9aa0-f4594f922e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:01.517288 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9ad54-4936-4723-9aa0-f4594f922e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:01.517558 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9ad54-4936-4723-9aa0-f4594f922e04 admin admin] PATH_INFO: `/v3/projects/b5833d5ec88d42b0a360c806553f3da0` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:01.518914 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9ad54-4936-4723-9aa0-f4594f922e04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5833d5ec88d42b0a360c806553f3da0)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:01.520816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9ad54-4936-4723-9aa0-f4594f922e04 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:01.528962 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:01.572930 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391be57e-fbab-4c56-8b5d-913af7500cc8 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:01.577155 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6db9ad54-4936-4723-9aa0-f4594f922e04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5833d5ec88d42b0a360c806553f3da0', 'request_id': 'req-6db9ad54-4936-4723-9aa0-f4594f922e04'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:01.583566 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6db9ad54-4936-4723-9aa0-f4594f922e04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5833d5ec88d42b0a360c806553f3da0', 'request_id': 'req-6db9ad54-4936-4723-9aa0-f4594f922e04'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:01.591050 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6db9ad54-4936-4723-9aa0-f4594f922e04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5833d5ec88d42b0a360c806553f3da0', 'request_id': 'req-6db9ad54-4936-4723-9aa0-f4594f922e04'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:01.606969 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6db9ad54-4936-4723-9aa0-f4594f922e04 admin admin] The token cache is being invalidate because project b5833d5ec88d42b0a360c806553f3da0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:47:01.607388 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6db9ad54-4936-4723-9aa0-f4594f922e04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:01.608097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6db9ad54-4936-4723-9aa0-f4594f922e04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:01.609822 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1317/2667] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:47:01 2022] DELETE /identity/v3/projects/b5833d5ec88d42b0a360c806553f3da0 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:47:01.614277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bb68a-6034-446e-bfb5-b97c5c91e5a4 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:01.615524 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bb68a-6034-446e-bfb5-b97c5c91e5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:01.615524 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bb68a-6034-446e-bfb5-b97c5c91e5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:01.644473 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef495dc3-b383-4964-92a2-75a26c6a5109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:01.645368 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef495dc3-b383-4964-92a2-75a26c6a5109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:01.645642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef495dc3-b383-4964-92a2-75a26c6a5109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:01.645754 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-430bb68a-6034-446e-bfb5-b97c5c91e5a4 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:01.646172 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef495dc3-b383-4964-92a2-75a26c6a5109 admin admin] PATH_INFO: `/v3/users/a1d804efd18b40f1bbf99d9798afe8c9` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:01.647265 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-430bb68a-6034-446e-bfb5-b97c5c91e5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:01.651466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef495dc3-b383-4964-92a2-75a26c6a5109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1d804efd18b40f1bbf99d9798afe8c9)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:01.653725 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef495dc3-b383-4964-92a2-75a26c6a5109 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:01.658103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1318/2668] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:01.667166 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff433ca-c3d0-4120-9621-3bb93241eabf None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:01.667449 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff433ca-c3d0-4120-9621-3bb93241eabf None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:01.667912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff433ca-c3d0-4120-9621-3bb93241eabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:01.686155 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-fff433ca-c3d0-4120-9621-3bb93241eabf None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:01.687509 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-fff433ca-c3d0-4120-9621-3bb93241eabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:01.696127 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1319/2669] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:01.700726 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff433ca-c3d0-4120-9621-3bb93241eabf None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:01.704087 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ef495dc3-b383-4964-92a2-75a26c6a5109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1d804efd18b40f1bbf99d9798afe8c9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:01.710926 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff433ca-c3d0-4120-9621-3bb93241eabf None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:01.711400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ef495dc3-b383-4964-92a2-75a26c6a5109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1d804efd18b40f1bbf99d9798afe8c9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:01.712091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ef495dc3-b383-4964-92a2-75a26c6a5109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1d804efd18b40f1bbf99d9798afe8c9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:01.715886 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c55b8-71ac-4d17-9958-79471012899b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:01.716545 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c55b8-71ac-4d17-9958-79471012899b admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:01.716826 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c55b8-71ac-4d17-9958-79471012899b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:01.717094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c55b8-71ac-4d17-9958-79471012899b admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:01.717816 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c55b8-71ac-4d17-9958-79471012899b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:47:01.718145 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c55b8-71ac-4d17-9958-79471012899b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:01.719729 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c55b8-71ac-4d17-9958-79471012899b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:01.724741 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ef495dc3-b383-4964-92a2-75a26c6a5109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1d804efd18b40f1bbf99d9798afe8c9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:01.725409 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ef495dc3-b383-4964-92a2-75a26c6a5109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1d804efd18b40f1bbf99d9798afe8c9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:01.731500 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1320/2670] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:47:01.735667 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c55b8-71ac-4d17-9958-79471012899b admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:01.737277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9d2c55b8-71ac-4d17-9958-79471012899b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:01.738094 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1351/2671] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:47:01 2022] DELETE /identity/v3/users/a1d804efd18b40f1bbf99d9798afe8c9 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:47:01.749989 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c55b8-71ac-4d17-9958-79471012899b admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:01.814067 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f4530-864b-4213-a1cf-fe6012bb80bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:01.814685 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f4530-864b-4213-a1cf-fe6012bb80bc admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:01.815111 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f4530-864b-4213-a1cf-fe6012bb80bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:01.815411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f4530-864b-4213-a1cf-fe6012bb80bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:01.816101 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f4530-864b-4213-a1cf-fe6012bb80bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:01.818291 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f4530-864b-4213-a1cf-fe6012bb80bc admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:01.847384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1321/2672] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:47:01 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:47:01.851933 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef495dc3-b383-4964-92a2-75a26c6a5109 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:01.862659 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef495dc3-b383-4964-92a2-75a26c6a5109 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:01.870641 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:01.930225 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec69d3-3537-49ea-b0bd-a5d732cdabb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:01.930939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec69d3-3537-49ea-b0bd-a5d732cdabb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:01.931217 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec69d3-3537-49ea-b0bd-a5d732cdabb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:01.931482 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec69d3-3537-49ea-b0bd-a5d732cdabb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:01.932423 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec69d3-3537-49ea-b0bd-a5d732cdabb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:01.934168 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec69d3-3537-49ea-b0bd-a5d732cdabb3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:01.958074 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1352/2673] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:47:01 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:47:01.959302 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f4530-864b-4213-a1cf-fe6012bb80bc admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:01.969891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f4530-864b-4213-a1cf-fe6012bb80bc admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:01.974605 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b15a5a-88e5-470a-9c1a-0ca55dbe96ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:01.975304 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b15a5a-88e5-470a-9c1a-0ca55dbe96ac admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:01.975604 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b15a5a-88e5-470a-9c1a-0ca55dbe96ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:01.975844 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b15a5a-88e5-470a-9c1a-0ca55dbe96ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:01.976569 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b15a5a-88e5-470a-9c1a-0ca55dbe96ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:01.978227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b15a5a-88e5-470a-9c1a-0ca55dbe96ac admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:01.989091 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1322/2674] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:47:01.993252 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec69d3-3537-49ea-b0bd-a5d732cdabb3 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:02.004007 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec69d3-3537-49ea-b0bd-a5d732cdabb3 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:02.008694 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad053581-8817-4fbf-90a9-2feb63f98c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:02.009656 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad053581-8817-4fbf-90a9-2feb63f98c8e admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:02.009922 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad053581-8817-4fbf-90a9-2feb63f98c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:02.010207 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad053581-8817-4fbf-90a9-2feb63f98c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:02.011504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad053581-8817-4fbf-90a9-2feb63f98c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:02.013453 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad053581-8817-4fbf-90a9-2feb63f98c8e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:02.025814 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1353/2675] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:47:02.030077 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b15a5a-88e5-470a-9c1a-0ca55dbe96ac admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:02.035887 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad053581-8817-4fbf-90a9-2feb63f98c8e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:02.038521 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ad053581-8817-4fbf-90a9-2feb63f98c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:02.041579 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b15a5a-88e5-470a-9c1a-0ca55dbe96ac admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:02.046591 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc83ec-f4c9-44e1-97a5-6bedabbc9a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:02.047659 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc83ec-f4c9-44e1-97a5-6bedabbc9a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:02.048038 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc83ec-f4c9-44e1-97a5-6bedabbc9a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:02.048382 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc83ec-f4c9-44e1-97a5-6bedabbc9a09 admin admin] PATH_INFO: `/v3/projects/4406c01d83014a6d8fadc26f762826e7/users/db1bfb98df6041f1ba1a6ac5723e948a/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:02.054759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad053581-8817-4fbf-90a9-2feb63f98c8e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:02.061654 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22668048-fd5b-471f-b715-b124f96a6af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:02.062742 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22668048-fd5b-471f-b715-b124f96a6af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:02.063122 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22668048-fd5b-471f-b715-b124f96a6af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:02.063357 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22668048-fd5b-471f-b715-b124f96a6af0 admin admin] PATH_INFO: `/v3/projects/d3927d14cd464ffa867870b44cafbe1e` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:02.064652 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22668048-fd5b-471f-b715-b124f96a6af0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3927d14cd464ffa867870b44cafbe1e)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:02.066677 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22668048-fd5b-471f-b715-b124f96a6af0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:02.067908 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc83ec-f4c9-44e1-97a5-6bedabbc9a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4406c01d83014a6d8fadc26f762826e7, user_id=db1bfb98df6041f1ba1a6ac5723e948a, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:02.070705 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc83ec-f4c9-44e1-97a5-6bedabbc9a09 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:02.091759 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1323/2676] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:47:02 2022] PUT /identity/v3/projects/4406c01d83014a6d8fadc26f762826e7/users/db1bfb98df6041f1ba1a6ac5723e948a/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:02.103416 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da79f4-e2e8-40e1-a5a2-26847d8cfa24 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:02.103728 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da79f4-e2e8-40e1-a5a2-26847d8cfa24 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:02.104001 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da79f4-e2e8-40e1-a5a2-26847d8cfa24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:02.121731 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-22668048-fd5b-471f-b715-b124f96a6af0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3927d14cd464ffa867870b44cafbe1e', 'request_id': 'req-22668048-fd5b-471f-b715-b124f96a6af0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:02.127526 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-22668048-fd5b-471f-b715-b124f96a6af0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3927d14cd464ffa867870b44cafbe1e', 'request_id': 'req-22668048-fd5b-471f-b715-b124f96a6af0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:02.130448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-c2da79f4-e2e8-40e1-a5a2-26847d8cfa24 None None] MFA Rules not processed for user `db1bfb98df6041f1ba1a6ac5723e948a`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:02.131679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c2da79f4-e2e8-40e1-a5a2-26847d8cfa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:02.134300 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-22668048-fd5b-471f-b715-b124f96a6af0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3927d14cd464ffa867870b44cafbe1e', 'request_id': 'req-22668048-fd5b-471f-b715-b124f96a6af0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:02.137383 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:02.150174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-22668048-fd5b-471f-b715-b124f96a6af0 admin admin] The token cache is being invalidate because project d3927d14cd464ffa867870b44cafbe1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:47:02.150471 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-22668048-fd5b-471f-b715-b124f96a6af0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:02.151219 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-22668048-fd5b-471f-b715-b124f96a6af0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:02.153231 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1354/2677] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:47:02 2022] DELETE /identity/v3/projects/d3927d14cd464ffa867870b44cafbe1e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:02.158873 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17697f-ffeb-4521-bd2e-bc01d300c912 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:02.159150 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17697f-ffeb-4521-bd2e-bc01d300c912 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:02.159421 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17697f-ffeb-4521-bd2e-bc01d300c912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:02.178258 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4d17697f-ffeb-4521-bd2e-bc01d300c912 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:02.179493 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4d17697f-ffeb-4521-bd2e-bc01d300c912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:02.205240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1324/2678] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:47:02.209797 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da79f4-e2e8-40e1-a5a2-26847d8cfa24 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:02.211268 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c2da79f4-e2e8-40e1-a5a2-26847d8cfa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:02.239270 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1355/2679] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:47:02.249141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf5f5d-e8d7-45ec-9bef-4fa6c943e535 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:02.249430 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf5f5d-e8d7-45ec-9bef-4fa6c943e535 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:02.249701 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf5f5d-e8d7-45ec-9bef-4fa6c943e535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:02.270135 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c4cf5f5d-e8d7-45ec-9bef-4fa6c943e535 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:02.271364 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c4cf5f5d-e8d7-45ec-9bef-4fa6c943e535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:02.277786 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da79f4-e2e8-40e1-a5a2-26847d8cfa24 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:02.279196 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1356/2680] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:47:02.283165 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dde5bc-3031-42d3-94d5-560a9576fc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:02.283315 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf5f5d-e8d7-45ec-9bef-4fa6c943e535 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:02.283969 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dde5bc-3031-42d3-94d5-560a9576fc97 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:02.284315 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dde5bc-3031-42d3-94d5-560a9576fc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:02.284652 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dde5bc-3031-42d3-94d5-560a9576fc97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:02.285408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dde5bc-3031-42d3-94d5-560a9576fc97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:02.287387 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dde5bc-3031-42d3-94d5-560a9576fc97 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:02.292677 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf5f5d-e8d7-45ec-9bef-4fa6c943e535 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:02.297217 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc530d4-e9e3-468b-aa7a-9d0600ad8dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:02.297866 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc530d4-e9e3-468b-aa7a-9d0600ad8dfb admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:02.298146 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc530d4-e9e3-468b-aa7a-9d0600ad8dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:02.298419 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc530d4-e9e3-468b-aa7a-9d0600ad8dfb admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:02.299198 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc530d4-e9e3-468b-aa7a-9d0600ad8dfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:47:02.299500 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc530d4-e9e3-468b-aa7a-9d0600ad8dfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:02.301089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc530d4-e9e3-468b-aa7a-9d0600ad8dfb admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:02.302682 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:02.318671 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1357/2681] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:47:02.321359 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc530d4-e9e3-468b-aa7a-9d0600ad8dfb admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:02.321757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1325/2682] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:47:02 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:47:02.325553 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dde5bc-3031-42d3-94d5-560a9576fc97 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:02.332734 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc530d4-e9e3-468b-aa7a-9d0600ad8dfb admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:02.390073 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0df926-da39-4f7b-aa72-e5104aee412b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:02.390943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0df926-da39-4f7b-aa72-e5104aee412b admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:02.391429 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0df926-da39-4f7b-aa72-e5104aee412b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:02.391624 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dde5bc-3031-42d3-94d5-560a9576fc97 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:02.391908 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0df926-da39-4f7b-aa72-e5104aee412b admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:02.392692 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0df926-da39-4f7b-aa72-e5104aee412b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:02.394815 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0df926-da39-4f7b-aa72-e5104aee412b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:02.396210 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48624858-78a6-4201-944c-f0a342d77ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:02.396876 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48624858-78a6-4201-944c-f0a342d77ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:02.397154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48624858-78a6-4201-944c-f0a342d77ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:02.397425 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48624858-78a6-4201-944c-f0a342d77ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:02.398097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48624858-78a6-4201-944c-f0a342d77ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:02.399996 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48624858-78a6-4201-944c-f0a342d77ee0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:02.423224 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1326/2683] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:47:02 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:47:02.425121 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1358/2684] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:47:02 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:47:02.427492 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48624858-78a6-4201-944c-f0a342d77ee0 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:02.429218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0df926-da39-4f7b-aa72-e5104aee412b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:02.437936 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48624858-78a6-4201-944c-f0a342d77ee0 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:02.459091 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:02.489745 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0df926-da39-4f7b-aa72-e5104aee412b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:02.494944 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb278df-b235-42da-b884-8ba622afbcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:02.495884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb278df-b235-42da-b884-8ba622afbcf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:02.496400 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb278df-b235-42da-b884-8ba622afbcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:02.496744 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb278df-b235-42da-b884-8ba622afbcf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:02.497535 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb278df-b235-42da-b884-8ba622afbcf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:02.499583 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb278df-b235-42da-b884-8ba622afbcf3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:02.501327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a9309-835d-43d6-ab4a-e3d38e7975d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:02.502157 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a9309-835d-43d6-ab4a-e3d38e7975d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:02.502446 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a9309-835d-43d6-ab4a-e3d38e7975d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:02.502753 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a9309-835d-43d6-ab4a-e3d38e7975d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:02.503475 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a9309-835d-43d6-ab4a-e3d38e7975d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:02.505070 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a9309-835d-43d6-ab4a-e3d38e7975d0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:02.518536 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1327/2685] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:47:02.522510 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a9309-835d-43d6-ab4a-e3d38e7975d0 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:02.527793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1359/2686] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:47:02 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:47:02.531930 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb278df-b235-42da-b884-8ba622afbcf3 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:02.532213 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a9309-835d-43d6-ab4a-e3d38e7975d0 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:02.536694 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0086b11-2c64-45df-9999-32433019d072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:02.537348 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0086b11-2c64-45df-9999-32433019d072 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:02.537626 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0086b11-2c64-45df-9999-32433019d072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:02.537891 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0086b11-2c64-45df-9999-32433019d072 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:02.538646 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0086b11-2c64-45df-9999-32433019d072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:02.540215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0086b11-2c64-45df-9999-32433019d072 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:02.541838 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb278df-b235-42da-b884-8ba622afbcf3 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:02.546561 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8be64f-5706-44cb-9662-8fec5fe507ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:02.547280 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8be64f-5706-44cb-9662-8fec5fe507ac admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:02.547559 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8be64f-5706-44cb-9662-8fec5fe507ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:02.547830 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8be64f-5706-44cb-9662-8fec5fe507ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:02.548555 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8be64f-5706-44cb-9662-8fec5fe507ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:02.550125 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8be64f-5706-44cb-9662-8fec5fe507ac admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:02.550750 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1328/2687] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:47:02.554949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0086b11-2c64-45df-9999-32433019d072 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:02.564449 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1360/2688] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:47:02.567107 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0086b11-2c64-45df-9999-32433019d072 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:02.568414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8be64f-5706-44cb-9662-8fec5fe507ac admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:02.572403 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66efaa2-a338-4b46-a7ad-45dd479af4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:02.573341 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66efaa2-a338-4b46-a7ad-45dd479af4d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:02.573788 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66efaa2-a338-4b46-a7ad-45dd479af4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:02.574068 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66efaa2-a338-4b46-a7ad-45dd479af4d0 admin admin] PATH_INFO: `/v3/projects/5bd7af9c7d6241feacd20090122984c0/users/8507c339dc184a6391feb05dd836ae9b/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:02.578664 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8be64f-5706-44cb-9662-8fec5fe507ac admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:02.583155 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270757b3-5918-4469-b815-83d5fff0f608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:02.583808 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270757b3-5918-4469-b815-83d5fff0f608 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:02.584089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270757b3-5918-4469-b815-83d5fff0f608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:02.584365 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270757b3-5918-4469-b815-83d5fff0f608 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:02.585111 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270757b3-5918-4469-b815-83d5fff0f608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:02.586733 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270757b3-5918-4469-b815-83d5fff0f608 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:02.590565 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66efaa2-a338-4b46-a7ad-45dd479af4d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd7af9c7d6241feacd20090122984c0, user_id=8507c339dc184a6391feb05dd836ae9b, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:02.593274 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66efaa2-a338-4b46-a7ad-45dd479af4d0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:02.597404 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1361/2689] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:47:02.602949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270757b3-5918-4469-b815-83d5fff0f608 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:02.607912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1329/2690] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:47:02 2022] PUT /identity/v3/projects/5bd7af9c7d6241feacd20090122984c0/users/8507c339dc184a6391feb05dd836ae9b/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:47:02.613566 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270757b3-5918-4469-b815-83d5fff0f608 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:02.618088 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8e81b-38d0-4c54-b4f3-c9e828f7d402 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:02.618377 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8e81b-38d0-4c54-b4f3-c9e828f7d402 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:02.618762 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8e81b-38d0-4c54-b4f3-c9e828f7d402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:02.646979 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-a1a8e81b-38d0-4c54-b4f3-c9e828f7d402 None None] MFA Rules not processed for user `8507c339dc184a6391feb05dd836ae9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:02.648214 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a1a8e81b-38d0-4c54-b4f3-c9e828f7d402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:02.661159 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:02.675759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53af714-0637-4d2d-867a-45733295af3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:02.676699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53af714-0637-4d2d-867a-45733295af3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:02.676980 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53af714-0637-4d2d-867a-45733295af3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:02.677256 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53af714-0637-4d2d-867a-45733295af3c admin admin] PATH_INFO: `/v3/projects/f64e06ded9b74b9fbb13817a221bea0b/users/b8228f20f4354277843c481662aba77a/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:02.694026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53af714-0637-4d2d-867a-45733295af3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f64e06ded9b74b9fbb13817a221bea0b, user_id=b8228f20f4354277843c481662aba77a, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:02.696703 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53af714-0637-4d2d-867a-45733295af3c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:02.722927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1362/2691] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:47:02 2022] PUT /identity/v3/projects/f64e06ded9b74b9fbb13817a221bea0b/users/b8228f20f4354277843c481662aba77a/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:02.727436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1330/2692] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:47:02.728736 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53af714-0637-4d2d-867a-45733295af3c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:02.734370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ac73e-fb22-4ec7-83f9-b9f84a33d0dd None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:02.734735 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ac73e-fb22-4ec7-83f9-b9f84a33d0dd None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:02.735063 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ac73e-fb22-4ec7-83f9-b9f84a33d0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:02.765314 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-615ac73e-fb22-4ec7-83f9-b9f84a33d0dd None None] MFA Rules not processed for user `b8228f20f4354277843c481662aba77a`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:02.766512 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-615ac73e-fb22-4ec7-83f9-b9f84a33d0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:02.811334 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53af714-0637-4d2d-867a-45733295af3c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:02.815967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8ea6e-f87c-4482-9ef2-9ec028f3e28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:02.816650 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8ea6e-f87c-4482-9ef2-9ec028f3e28e admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:02.816929 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8ea6e-f87c-4482-9ef2-9ec028f3e28e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:02.817300 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8ea6e-f87c-4482-9ef2-9ec028f3e28e admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:02.818022 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8ea6e-f87c-4482-9ef2-9ec028f3e28e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:02.819931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8ea6e-f87c-4482-9ef2-9ec028f3e28e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:02.837147 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1331/2693] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:47:02.838082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ac73e-fb22-4ec7-83f9-b9f84a33d0dd None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:02.839590 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-615ac73e-fb22-4ec7-83f9-b9f84a33d0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:02.851487 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1363/2694] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:47:02 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:47:02.852422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8ea6e-f87c-4482-9ef2-9ec028f3e28e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:02.856880 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:02.863244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ac73e-fb22-4ec7-83f9-b9f84a33d0dd None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:02.915697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8ea6e-f87c-4482-9ef2-9ec028f3e28e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:02.920385 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a8ce3-3a1d-45a9-8777-f5089473098f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:02.921046 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a8ce3-3a1d-45a9-8777-f5089473098f admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:02.921322 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a8ce3-3a1d-45a9-8777-f5089473098f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:02.921600 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a8ce3-3a1d-45a9-8777-f5089473098f admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:02.922164 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbebc8d-0f22-4612-886c-cced08dee485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:02.922301 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a8ce3-3a1d-45a9-8777-f5089473098f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:02.923098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbebc8d-0f22-4612-886c-cced08dee485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:02.923376 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbebc8d-0f22-4612-886c-cced08dee485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:02.923650 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbebc8d-0f22-4612-886c-cced08dee485 admin admin] PATH_INFO: `/v3/users/f481b44095734e70a6f76a3558d0233b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:02.924189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a8ce3-3a1d-45a9-8777-f5089473098f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:02.924969 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbebc8d-0f22-4612-886c-cced08dee485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f481b44095734e70a6f76a3558d0233b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:02.926944 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbebc8d-0f22-4612-886c-cced08dee485 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:02.954754 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1364/2695] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:47:02 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:47:02.954754 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a8ce3-3a1d-45a9-8777-f5089473098f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:02.978126 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-cfbebc8d-0f22-4612-886c-cced08dee485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f481b44095734e70a6f76a3558d0233b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:02.986290 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-cfbebc8d-0f22-4612-886c-cced08dee485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f481b44095734e70a6f76a3558d0233b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:02.987121 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-cfbebc8d-0f22-4612-886c-cced08dee485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f481b44095734e70a6f76a3558d0233b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:02.994879 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-cfbebc8d-0f22-4612-886c-cced08dee485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f481b44095734e70a6f76a3558d0233b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:02.997135 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:03.008122 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-cfbebc8d-0f22-4612-886c-cced08dee485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f481b44095734e70a6f76a3558d0233b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:03.014871 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1332/2696] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:47:02 2022] DELETE /identity/v3/users/f481b44095734e70a6f76a3558d0233b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:03.015660 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbebc8d-0f22-4612-886c-cced08dee485 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:03.017042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-cfbebc8d-0f22-4612-886c-cced08dee485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:03.018860 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a8ce3-3a1d-45a9-8777-f5089473098f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:03.076386 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228cca60-4e24-49d6-9451-02ed827fa9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:03.077059 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cca60-4e24-49d6-9451-02ed827fa9a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:03.077332 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cca60-4e24-49d6-9451-02ed827fa9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:03.077586 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cca60-4e24-49d6-9451-02ed827fa9a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:03.078261 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228cca60-4e24-49d6-9451-02ed827fa9a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:03.080205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228cca60-4e24-49d6-9451-02ed827fa9a2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:03.082353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbebc8d-0f22-4612-886c-cced08dee485 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:03.087056 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc595b-f806-4daf-98e4-53fe99cdbf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:03.087840 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc595b-f806-4daf-98e4-53fe99cdbf8d admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:03.088180 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc595b-f806-4daf-98e4-53fe99cdbf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:03.088453 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc595b-f806-4daf-98e4-53fe99cdbf8d admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:03.089221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc595b-f806-4daf-98e4-53fe99cdbf8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:03.091357 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc595b-f806-4daf-98e4-53fe99cdbf8d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:03.104192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1365/2697] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:47:02 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:47:03.104192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2af55-7814-49b5-be3b-2e059ecd70fb None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:03.104192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2af55-7814-49b5-be3b-2e059ecd70fb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:03.104192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2af55-7814-49b5-be3b-2e059ecd70fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:03.116972 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1333/2698] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:47:03 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:47:03.117640 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc595b-f806-4daf-98e4-53fe99cdbf8d admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:03.119478 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f5dc595b-f806-4daf-98e4-53fe99cdbf8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:03.123899 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3fd2af55-7814-49b5-be3b-2e059ecd70fb None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:03.125126 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3fd2af55-7814-49b5-be3b-2e059ecd70fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:03.131613 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc595b-f806-4daf-98e4-53fe99cdbf8d admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:03.133302 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1366/2699] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:03.134865 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2af55-7814-49b5-be3b-2e059ecd70fb None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:03.140149 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5784bf5-8f3f-4936-b461-2eb69f5d9748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:03.140806 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5784bf5-8f3f-4936-b461-2eb69f5d9748 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:03.141085 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5784bf5-8f3f-4936-b461-2eb69f5d9748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:03.141353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5784bf5-8f3f-4936-b461-2eb69f5d9748 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:03.142083 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5784bf5-8f3f-4936-b461-2eb69f5d9748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:03.143715 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5784bf5-8f3f-4936-b461-2eb69f5d9748 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:03.144920 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2af55-7814-49b5-be3b-2e059ecd70fb None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:03.149705 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:03.150170 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee1777-5bdc-4182-8f1a-0dd5bd987a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:03.151260 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee1777-5bdc-4182-8f1a-0dd5bd987a34 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:03.151398 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee1777-5bdc-4182-8f1a-0dd5bd987a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:03.151612 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee1777-5bdc-4182-8f1a-0dd5bd987a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:03.152357 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee1777-5bdc-4182-8f1a-0dd5bd987a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:03.154044 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee1777-5bdc-4182-8f1a-0dd5bd987a34 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:03.156608 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1334/2700] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:47:03.158134 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5784bf5-8f3f-4936-b461-2eb69f5d9748 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:03.161403 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c5784bf5-8f3f-4936-b461-2eb69f5d9748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:03.170611 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1367/2701] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:47:03.170611 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee1777-5bdc-4182-8f1a-0dd5bd987a34 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:03.180086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee1777-5bdc-4182-8f1a-0dd5bd987a34 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:03.185098 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9ef04-2f06-495c-a765-9956fa24c8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:03.185999 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9ef04-2f06-495c-a765-9956fa24c8ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:03.186277 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9ef04-2f06-495c-a765-9956fa24c8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:03.186544 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9ef04-2f06-495c-a765-9956fa24c8ea admin admin] PATH_INFO: `/v3/projects/099163b6179141b48766f7ca8c281976/users/b8b750fa15aa4b1987eded1e8c93bccd/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:03.202099 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9ef04-2f06-495c-a765-9956fa24c8ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=099163b6179141b48766f7ca8c281976, user_id=b8b750fa15aa4b1987eded1e8c93bccd, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:03.204810 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9ef04-2f06-495c-a765-9956fa24c8ea admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:03.219588 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1368/2702] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:47:03 2022] PUT /identity/v3/projects/099163b6179141b48766f7ca8c281976/users/b8b750fa15aa4b1987eded1e8c93bccd/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:03.220463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9ef04-2f06-495c-a765-9956fa24c8ea admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:03.226795 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5784bf5-8f3f-4936-b461-2eb69f5d9748 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:03.278170 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06d4e8-5270-4425-892d-29f92f1fc5b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:03.278874 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06d4e8-5270-4425-892d-29f92f1fc5b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:03.279198 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06d4e8-5270-4425-892d-29f92f1fc5b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:03.279546 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06d4e8-5270-4425-892d-29f92f1fc5b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:03.284987 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9ef04-2f06-495c-a765-9956fa24c8ea admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:03.288596 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06d4e8-5270-4425-892d-29f92f1fc5b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:03.289631 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0df88-91d0-4faa-8c8b-2925068b54d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:03.290232 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06d4e8-5270-4425-892d-29f92f1fc5b7 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:03.290512 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0df88-91d0-4faa-8c8b-2925068b54d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:03.290819 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0df88-91d0-4faa-8c8b-2925068b54d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:03.291086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0df88-91d0-4faa-8c8b-2925068b54d5 admin admin] PATH_INFO: `/v3/projects/d1bb771e2dba41fda4f8c4b94c40d7bf/users/f67f2063eae342298bac48bbfb549de9/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:03.301262 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1335/2703] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:03.302084 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06d4e8-5270-4425-892d-29f92f1fc5b7 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:03.306091 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0df88-91d0-4faa-8c8b-2925068b54d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1bb771e2dba41fda4f8c4b94c40d7bf, user_id=f67f2063eae342298bac48bbfb549de9, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:03.309302 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0df88-91d0-4faa-8c8b-2925068b54d5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:03.311893 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06d4e8-5270-4425-892d-29f92f1fc5b7 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:03.318263 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa75aaa-b9fb-4100-ba1d-7b4cd98935b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:03.319053 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa75aaa-b9fb-4100-ba1d-7b4cd98935b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:03.319336 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa75aaa-b9fb-4100-ba1d-7b4cd98935b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:03.319627 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa75aaa-b9fb-4100-ba1d-7b4cd98935b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:03.320473 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa75aaa-b9fb-4100-ba1d-7b4cd98935b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:03.322250 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa75aaa-b9fb-4100-ba1d-7b4cd98935b6 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:03.328292 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1369/2704] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:47:03 2022] PUT /identity/v3/projects/d1bb771e2dba41fda4f8c4b94c40d7bf/users/f67f2063eae342298bac48bbfb549de9/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:03.332521 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0df88-91d0-4faa-8c8b-2925068b54d5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:03.336208 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1336/2705] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:47:03.341209 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa75aaa-b9fb-4100-ba1d-7b4cd98935b6 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:03.353464 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa75aaa-b9fb-4100-ba1d-7b4cd98935b6 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:03.357704 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:03.420054 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0df88-91d0-4faa-8c8b-2925068b54d5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:03.425888 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e27833-219d-4b3b-9ebf-decc2047fd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:03.426604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e27833-219d-4b3b-9ebf-decc2047fd48 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:03.427056 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e27833-219d-4b3b-9ebf-decc2047fd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:03.427376 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e27833-219d-4b3b-9ebf-decc2047fd48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:03.428086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e27833-219d-4b3b-9ebf-decc2047fd48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:03.429698 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e27833-219d-4b3b-9ebf-decc2047fd48 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:03.432024 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95a880-7bfc-4175-a9c3-860fffa2310d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:03.433451 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95a880-7bfc-4175-a9c3-860fffa2310d admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:03.434010 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95a880-7bfc-4175-a9c3-860fffa2310d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:03.434433 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95a880-7bfc-4175-a9c3-860fffa2310d admin admin] PATH_INFO: `/v3/projects/099163b6179141b48766f7ca8c281976/users/b8b750fa15aa4b1987eded1e8c93bccd/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:03.437899 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95a880-7bfc-4175-a9c3-860fffa2310d admin admin] RBAC: Authorizing `identity:create_grant(project_id=099163b6179141b48766f7ca8c281976, user_id=b8b750fa15aa4b1987eded1e8c93bccd, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:03.440988 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1370/2706] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:47:03.442845 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95a880-7bfc-4175-a9c3-860fffa2310d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:03.444857 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e27833-219d-4b3b-9ebf-decc2047fd48 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:03.455629 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e27833-219d-4b3b-9ebf-decc2047fd48 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:03.461320 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1337/2707] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:47:03 2022] PUT /identity/v3/projects/099163b6179141b48766f7ca8c281976/users/b8b750fa15aa4b1987eded1e8c93bccd/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:03.476234 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd9672-23c1-4837-9c26-563387cc9665 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:03.476508 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd9672-23c1-4837-9c26-563387cc9665 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:03.476785 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd9672-23c1-4837-9c26-563387cc9665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:03.511671 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-b2fd9672-23c1-4837-9c26-563387cc9665 None None] MFA Rules not processed for user `b8b750fa15aa4b1987eded1e8c93bccd`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:03.513003 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b2fd9672-23c1-4837-9c26-563387cc9665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:03.525215 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65717e4-436a-46f9-9e2f-86b4122f6f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:03.528754 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65717e4-436a-46f9-9e2f-86b4122f6f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:03.529046 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65717e4-436a-46f9-9e2f-86b4122f6f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:03.529328 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65717e4-436a-46f9-9e2f-86b4122f6f4e admin admin] PATH_INFO: `/v3/projects/d1bb771e2dba41fda4f8c4b94c40d7bf/users/f67f2063eae342298bac48bbfb549de9/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:03.531514 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65717e4-436a-46f9-9e2f-86b4122f6f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1bb771e2dba41fda4f8c4b94c40d7bf, user_id=f67f2063eae342298bac48bbfb549de9, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:03.534169 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65717e4-436a-46f9-9e2f-86b4122f6f4e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:03.545697 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:03.548505 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1371/2708] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:47:03 2022] PUT /identity/v3/projects/d1bb771e2dba41fda4f8c4b94c40d7bf/users/f67f2063eae342298bac48bbfb549de9/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:47:03.559249 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee7841-f18c-469e-b877-2f7e927f21e6 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:03.559649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee7841-f18c-469e-b877-2f7e927f21e6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:03.559821 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee7841-f18c-469e-b877-2f7e927f21e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:03.588128 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-29ee7841-f18c-469e-b877-2f7e927f21e6 None None] MFA Rules not processed for user `f67f2063eae342298bac48bbfb549de9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:03.589599 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-29ee7841-f18c-469e-b877-2f7e927f21e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:03.601962 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1338/2709] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:03.614074 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd9672-23c1-4837-9c26-563387cc9665 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:03.615475 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b2fd9672-23c1-4837-9c26-563387cc9665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:03.673469 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1372/2710] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:03 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:03.674463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee7841-f18c-469e-b877-2f7e927f21e6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:03.676004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-29ee7841-f18c-469e-b877-2f7e927f21e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:03.682904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd9672-23c1-4837-9c26-563387cc9665 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:03.711215 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:03.736324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee7244-9e38-476c-ad89-e0d7f947ed6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:03.737101 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee7244-9e38-476c-ad89-e0d7f947ed6f service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:03.737437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee7244-9e38-476c-ad89-e0d7f947ed6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:03.737778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee7244-9e38-476c-ad89-e0d7f947ed6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:03.739933 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3aee7244-9e38-476c-ad89-e0d7f947ed6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:03.744222 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee7841-f18c-469e-b877-2f7e927f21e6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:03.750219 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3e433-7ff8-45e2-beda-b546f87c7cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:03.751273 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3e433-7ff8-45e2-beda-b546f87c7cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:03.751552 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3e433-7ff8-45e2-beda-b546f87c7cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:03.751820 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3e433-7ff8-45e2-beda-b546f87c7cca admin admin] PATH_INFO: `/v3/projects/19dfbd46e52d42cda677581f20ea3bb3` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:03.753040 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3e433-7ff8-45e2-beda-b546f87c7cca admin admin] RBAC: Authorizing `identity:delete_project(project_id=19dfbd46e52d42cda677581f20ea3bb3)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:03.755056 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3e433-7ff8-45e2-beda-b546f87c7cca admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:03.803120 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-94b3e433-7ff8-45e2-beda-b546f87c7cca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19dfbd46e52d42cda677581f20ea3bb3', 'request_id': 'req-94b3e433-7ff8-45e2-beda-b546f87c7cca'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:03.805113 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee7244-9e38-476c-ad89-e0d7f947ed6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:03.806702 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee7244-9e38-476c-ad89-e0d7f947ed6f service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:03.809465 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-94b3e433-7ff8-45e2-beda-b546f87c7cca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19dfbd46e52d42cda677581f20ea3bb3', 'request_id': 'req-94b3e433-7ff8-45e2-beda-b546f87c7cca'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:03.816544 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-94b3e433-7ff8-45e2-beda-b546f87c7cca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19dfbd46e52d42cda677581f20ea3bb3', 'request_id': 'req-94b3e433-7ff8-45e2-beda-b546f87c7cca'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:03.816707 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1339/2711] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:47:03.817406 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee7244-9e38-476c-ad89-e0d7f947ed6f service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:03.818691 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3aee7244-9e38-476c-ad89-e0d7f947ed6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:03.830300 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee7244-9e38-476c-ad89-e0d7f947ed6f service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:03.832066 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-94b3e433-7ff8-45e2-beda-b546f87c7cca admin admin] The token cache is being invalidate because project 19dfbd46e52d42cda677581f20ea3bb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:47:03.832500 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-94b3e433-7ff8-45e2-beda-b546f87c7cca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:03.833148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-94b3e433-7ff8-45e2-beda-b546f87c7cca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:03.835133 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1373/2712] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:47:03 2022] DELETE /identity/v3/projects/19dfbd46e52d42cda677581f20ea3bb3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:03.838817 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3e433-7ff8-45e2-beda-b546f87c7cca admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:03.840253 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-94b3e433-7ff8-45e2-beda-b546f87c7cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:03.866682 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:03.887589 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1ad1f-4b65-4537-b8b3-fdfee971b556 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:03.888243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1ad1f-4b65-4537-b8b3-fdfee971b556 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:03.888526 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1ad1f-4b65-4537-b8b3-fdfee971b556 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:03.889076 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1ad1f-4b65-4537-b8b3-fdfee971b556 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:03.891169 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-22f1ad1f-4b65-4537-b8b3-fdfee971b556 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:03.921319 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3e433-7ff8-45e2-beda-b546f87c7cca admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:03.926712 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc8a22-aa5d-4d77-9466-101f61db0c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:03.927597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc8a22-aa5d-4d77-9466-101f61db0c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:03.927871 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc8a22-aa5d-4d77-9466-101f61db0c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:03.928176 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc8a22-aa5d-4d77-9466-101f61db0c9b admin admin] PATH_INFO: `/v3/users/d9bec498876543f6b6582374ef23c008` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:03.929336 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc8a22-aa5d-4d77-9466-101f61db0c9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9bec498876543f6b6582374ef23c008)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:03.931357 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc8a22-aa5d-4d77-9466-101f61db0c9b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:03.966650 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1ad1f-4b65-4537-b8b3-fdfee971b556 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:03.968160 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1ad1f-4b65-4537-b8b3-fdfee971b556 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:03.978683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1340/2713] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:03 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:03.985259 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d8fc8a22-aa5d-4d77-9466-101f61db0c9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9bec498876543f6b6582374ef23c008'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:03.993316 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d8fc8a22-aa5d-4d77-9466-101f61db0c9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9bec498876543f6b6582374ef23c008'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:03.993964 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d8fc8a22-aa5d-4d77-9466-101f61db0c9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9bec498876543f6b6582374ef23c008'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:04.003323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:04.008925 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d8fc8a22-aa5d-4d77-9466-101f61db0c9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9bec498876543f6b6582374ef23c008'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:04.010735 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d8fc8a22-aa5d-4d77-9466-101f61db0c9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9bec498876543f6b6582374ef23c008'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:04.026755 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1374/2714] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:47:03 2022] DELETE /identity/v3/users/d9bec498876543f6b6582374ef23c008 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:47:04.354397 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1ad1f-4b65-4537-b8b3-fdfee971b556 service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:04.367151 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1ad1f-4b65-4537-b8b3-fdfee971b556 service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:04.430042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa354a-d67e-4f21-88aa-c67d65fe35af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:04.430960 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa354a-d67e-4f21-88aa-c67d65fe35af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:04.431240 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa354a-d67e-4f21-88aa-c67d65fe35af admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:04.431511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa354a-d67e-4f21-88aa-c67d65fe35af admin admin] PATH_INFO: `/v3/projects/0efe17a1c26d4e5c957924d66bc94893` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:04.433262 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa354a-d67e-4f21-88aa-c67d65fe35af admin admin] RBAC: Authorizing `identity:delete_project(project_id=0efe17a1c26d4e5c957924d66bc94893)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:04.435516 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa354a-d67e-4f21-88aa-c67d65fe35af admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:04.490310 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-45aa354a-d67e-4f21-88aa-c67d65fe35af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0efe17a1c26d4e5c957924d66bc94893', 'request_id': 'req-45aa354a-d67e-4f21-88aa-c67d65fe35af'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:04.495967 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-45aa354a-d67e-4f21-88aa-c67d65fe35af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0efe17a1c26d4e5c957924d66bc94893', 'request_id': 'req-45aa354a-d67e-4f21-88aa-c67d65fe35af'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:04.502326 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-45aa354a-d67e-4f21-88aa-c67d65fe35af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0efe17a1c26d4e5c957924d66bc94893', 'request_id': 'req-45aa354a-d67e-4f21-88aa-c67d65fe35af'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:04.518035 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-45aa354a-d67e-4f21-88aa-c67d65fe35af admin admin] The token cache is being invalidate because project 0efe17a1c26d4e5c957924d66bc94893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:47:04.518326 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-45aa354a-d67e-4f21-88aa-c67d65fe35af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:04.519014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-45aa354a-d67e-4f21-88aa-c67d65fe35af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:04.520755 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1341/2715] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:47:04 2022] DELETE /identity/v3/projects/0efe17a1c26d4e5c957924d66bc94893 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:04.525534 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c1374-a107-404b-9538-f3a79024a415 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:04.526560 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c1374-a107-404b-9538-f3a79024a415 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:04.526560 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c1374-a107-404b-9538-f3a79024a415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:04.544687 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-683c1374-a107-404b-9538-f3a79024a415 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:04.546054 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-683c1374-a107-404b-9538-f3a79024a415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:04.612159 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1375/2716] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:04.620309 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00b7e4-ebcf-40bf-832c-647f5abfb767 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:04.620608 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00b7e4-ebcf-40bf-832c-647f5abfb767 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:04.620870 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00b7e4-ebcf-40bf-832c-647f5abfb767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:04.644442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-da00b7e4-ebcf-40bf-832c-647f5abfb767 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:04.645740 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-da00b7e4-ebcf-40bf-832c-647f5abfb767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:04.654126 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1342/2717] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:47:04.658896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c1374-a107-404b-9538-f3a79024a415 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:04.668558 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c1374-a107-404b-9538-f3a79024a415 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:04.673373 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ba3d1-8c5f-475d-a6f1-39337c85ba79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:04.674065 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ba3d1-8c5f-475d-a6f1-39337c85ba79 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:04.674798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ba3d1-8c5f-475d-a6f1-39337c85ba79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:04.674798 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ba3d1-8c5f-475d-a6f1-39337c85ba79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:04.675353 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ba3d1-8c5f-475d-a6f1-39337c85ba79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:47:04.675688 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ba3d1-8c5f-475d-a6f1-39337c85ba79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:04.677310 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ba3d1-8c5f-475d-a6f1-39337c85ba79 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:04.689934 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1376/2718] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:47:04.694128 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00b7e4-ebcf-40bf-832c-647f5abfb767 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:04.703568 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00b7e4-ebcf-40bf-832c-647f5abfb767 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:04.708492 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604278a-c1f4-48db-9a5a-d0cfd49bc1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:04.709169 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604278a-c1f4-48db-9a5a-d0cfd49bc1d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:04.709451 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604278a-c1f4-48db-9a5a-d0cfd49bc1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:04.709725 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604278a-c1f4-48db-9a5a-d0cfd49bc1d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:04.710477 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604278a-c1f4-48db-9a5a-d0cfd49bc1d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:04.712521 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604278a-c1f4-48db-9a5a-d0cfd49bc1d6 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:04.721653 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:04.745154 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1343/2719] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:47:04 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:47:04.749645 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ba3d1-8c5f-475d-a6f1-39337c85ba79 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:04.761238 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ba3d1-8c5f-475d-a6f1-39337c85ba79 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:04.826994 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de264a71-7b15-4398-be25-ae4d648727a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:04.830062 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de264a71-7b15-4398-be25-ae4d648727a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:04.830361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de264a71-7b15-4398-be25-ae4d648727a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:04.832453 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de264a71-7b15-4398-be25-ae4d648727a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:04.833174 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de264a71-7b15-4398-be25-ae4d648727a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:04.835570 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de264a71-7b15-4398-be25-ae4d648727a3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:04.860837 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1377/2720] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:47:04 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:47:04.861846 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604278a-c1f4-48db-9a5a-d0cfd49bc1d6 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:04.874803 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604278a-c1f4-48db-9a5a-d0cfd49bc1d6 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:04.879665 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed725a-7e40-4428-9fef-fc70880c26d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:04.880342 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed725a-7e40-4428-9fef-fc70880c26d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:04.880623 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed725a-7e40-4428-9fef-fc70880c26d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:04.886664 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed725a-7e40-4428-9fef-fc70880c26d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:04.887651 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed725a-7e40-4428-9fef-fc70880c26d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:04.889601 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed725a-7e40-4428-9fef-fc70880c26d9 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:04.900843 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1344/2721] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:47:04.904999 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de264a71-7b15-4398-be25-ae4d648727a3 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:04.915490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de264a71-7b15-4398-be25-ae4d648727a3 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:04.920372 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6525c8-9a20-4eff-84fb-928e808fa2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:04.921047 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6525c8-9a20-4eff-84fb-928e808fa2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:04.921319 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6525c8-9a20-4eff-84fb-928e808fa2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:04.921586 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6525c8-9a20-4eff-84fb-928e808fa2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:04.922309 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6525c8-9a20-4eff-84fb-928e808fa2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:04.924011 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6525c8-9a20-4eff-84fb-928e808fa2b9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:04.938603 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1378/2722] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:47:04.940460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed725a-7e40-4428-9fef-fc70880c26d9 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:04.951244 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed725a-7e40-4428-9fef-fc70880c26d9 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:04.957091 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47186b-09a7-4f06-8c56-29a7807b5ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:04.957975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47186b-09a7-4f06-8c56-29a7807b5ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:04.958220 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47186b-09a7-4f06-8c56-29a7807b5ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:04.958511 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47186b-09a7-4f06-8c56-29a7807b5ef4 admin admin] PATH_INFO: `/v3/projects/43acab2f145c46639029913875208cae/users/a1d702d7f1ba4fdbb0d4286ec5e7ab94/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:04.976131 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47186b-09a7-4f06-8c56-29a7807b5ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43acab2f145c46639029913875208cae, user_id=a1d702d7f1ba4fdbb0d4286ec5e7ab94, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:04.979005 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47186b-09a7-4f06-8c56-29a7807b5ef4 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:04.994045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1345/2723] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:47:04 2022] PUT /identity/v3/projects/43acab2f145c46639029913875208cae/users/a1d702d7f1ba4fdbb0d4286ec5e7ab94/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:47:05.004484 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c3b1e-8c01-4cd2-b455-22509548e5f6 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:05.009668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c3b1e-8c01-4cd2-b455-22509548e5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:05.009668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c3b1e-8c01-4cd2-b455-22509548e5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:05.033284 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-915c3b1e-8c01-4cd2-b455-22509548e5f6 None None] MFA Rules not processed for user `a1d702d7f1ba4fdbb0d4286ec5e7ab94`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:05.034380 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-915c3b1e-8c01-4cd2-b455-22509548e5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:05.076532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:05.107566 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1379/2724] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:05.112038 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47186b-09a7-4f06-8c56-29a7807b5ef4 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:05.180083 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47186b-09a7-4f06-8c56-29a7807b5ef4 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:05.185036 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74a7ed-9b6a-41dc-833d-9c6a77ed5b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:05.185778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74a7ed-9b6a-41dc-833d-9c6a77ed5b65 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:05.186125 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74a7ed-9b6a-41dc-833d-9c6a77ed5b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:05.186398 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74a7ed-9b6a-41dc-833d-9c6a77ed5b65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:05.187266 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74a7ed-9b6a-41dc-833d-9c6a77ed5b65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:05.189146 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74a7ed-9b6a-41dc-833d-9c6a77ed5b65 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:05.226005 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1346/2725] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:47:05 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:47:05.230105 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c3b1e-8c01-4cd2-b455-22509548e5f6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:05.242937 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c3b1e-8c01-4cd2-b455-22509548e5f6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:05.322925 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478c6b4-686e-4782-9395-8c348f283bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:05.323971 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478c6b4-686e-4782-9395-8c348f283bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:05.324257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478c6b4-686e-4782-9395-8c348f283bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:05.324537 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478c6b4-686e-4782-9395-8c348f283bd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:05.325301 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478c6b4-686e-4782-9395-8c348f283bd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:05.327379 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478c6b4-686e-4782-9395-8c348f283bd2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:05.351975 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1380/2726] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:47:05 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:47:05.356128 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74a7ed-9b6a-41dc-833d-9c6a77ed5b65 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:05.369089 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74a7ed-9b6a-41dc-833d-9c6a77ed5b65 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:05.371114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478c6b4-686e-4782-9395-8c348f283bd2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:05.373529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a478c6b4-686e-4782-9395-8c348f283bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:05.374701 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db79de-d3a3-4d8f-bf2a-95e7cfc20ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:05.375383 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db79de-d3a3-4d8f-bf2a-95e7cfc20ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:05.375706 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db79de-d3a3-4d8f-bf2a-95e7cfc20ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:05.375922 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db79de-d3a3-4d8f-bf2a-95e7cfc20ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:05.376654 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db79de-d3a3-4d8f-bf2a-95e7cfc20ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:05.378225 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db79de-d3a3-4d8f-bf2a-95e7cfc20ac2 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:05.393838 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1347/2727] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:47:05.398009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db79de-d3a3-4d8f-bf2a-95e7cfc20ac2 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:05.411297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db79de-d3a3-4d8f-bf2a-95e7cfc20ac2 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:05.417974 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9924b-ea8c-46b4-ac25-2b252647c812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:05.418932 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9924b-ea8c-46b4-ac25-2b252647c812 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:05.419211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9924b-ea8c-46b4-ac25-2b252647c812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:05.419488 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9924b-ea8c-46b4-ac25-2b252647c812 admin admin] PATH_INFO: `/v3/projects/0ac50b3b3c43461bbb3224b405f9525d/users/03fe7640172743efb68a70872f9ba892/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:05.437049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9924b-ea8c-46b4-ac25-2b252647c812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ac50b3b3c43461bbb3224b405f9525d, user_id=03fe7640172743efb68a70872f9ba892, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:05.439716 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9924b-ea8c-46b4-ac25-2b252647c812 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:05.441111 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478c6b4-686e-4782-9395-8c348f283bd2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:05.445584 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2e473-073c-460c-81dd-8969a4f4e0c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:05.446424 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2e473-073c-460c-81dd-8969a4f4e0c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:05.446738 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2e473-073c-460c-81dd-8969a4f4e0c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:05.447007 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2e473-073c-460c-81dd-8969a4f4e0c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:05.453376 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-51c2e473-073c-460c-81dd-8969a4f4e0c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:05.456082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1348/2728] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:47:05 2022] PUT /identity/v3/projects/0ac50b3b3c43461bbb3224b405f9525d/users/03fe7640172743efb68a70872f9ba892/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:47:05.460831 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9924b-ea8c-46b4-ac25-2b252647c812 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:05.519263 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2e473-073c-460c-81dd-8969a4f4e0c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:05.520697 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2e473-073c-460c-81dd-8969a4f4e0c3 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:05.530130 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1381/2729] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:47:05.531031 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2e473-073c-460c-81dd-8969a4f4e0c3 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:05.532325 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-51c2e473-073c-460c-81dd-8969a4f4e0c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:05.535059 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9924b-ea8c-46b4-ac25-2b252647c812 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:05.540150 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8db545-4d85-4fd1-be5b-df70d0603d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:05.540912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8db545-4d85-4fd1-be5b-df70d0603d13 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:05.541298 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8db545-4d85-4fd1-be5b-df70d0603d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:05.541734 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8db545-4d85-4fd1-be5b-df70d0603d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:05.542978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8db545-4d85-4fd1-be5b-df70d0603d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:05.544683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8db545-4d85-4fd1-be5b-df70d0603d13 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:05.546271 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2e473-073c-460c-81dd-8969a4f4e0c3 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:05.551299 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802cc85-d9ec-4978-a5ad-695913794147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:05.552172 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802cc85-d9ec-4978-a5ad-695913794147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:05.552450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802cc85-d9ec-4978-a5ad-695913794147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:05.552723 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802cc85-d9ec-4978-a5ad-695913794147 admin admin] PATH_INFO: `/v3/users/b8228f20f4354277843c481662aba77a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:05.553037 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:05.553930 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802cc85-d9ec-4978-a5ad-695913794147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8228f20f4354277843c481662aba77a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:05.555883 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802cc85-d9ec-4978-a5ad-695913794147 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:05.562746 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1349/2730] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:47:05.567133 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8db545-4d85-4fd1-be5b-df70d0603d13 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:05.579002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8db545-4d85-4fd1-be5b-df70d0603d13 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:05.579195 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:05.585007 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103b0b1-7619-49bf-8d2c-3cf4ea7ac367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:05.586115 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103b0b1-7619-49bf-8d2c-3cf4ea7ac367 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:05.586748 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103b0b1-7619-49bf-8d2c-3cf4ea7ac367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:05.587037 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103b0b1-7619-49bf-8d2c-3cf4ea7ac367 admin admin] PATH_INFO: `/v3/projects/0ac50b3b3c43461bbb3224b405f9525d/users/03fe7640172743efb68a70872f9ba892/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:05.590020 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103b0b1-7619-49bf-8d2c-3cf4ea7ac367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ac50b3b3c43461bbb3224b405f9525d, user_id=03fe7640172743efb68a70872f9ba892, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:05.593155 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103b0b1-7619-49bf-8d2c-3cf4ea7ac367 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:05.606306 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1350/2731] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:47:05 2022] PUT /identity/v3/projects/0ac50b3b3c43461bbb3224b405f9525d/users/03fe7640172743efb68a70872f9ba892/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:05.616393 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab4b1e-105b-4325-a495-def3935f5908 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:05.616573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab4b1e-105b-4325-a495-def3935f5908 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:05.616832 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab4b1e-105b-4325-a495-def3935f5908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:05.617541 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2802cc85-d9ec-4978-a5ad-695913794147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8228f20f4354277843c481662aba77a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:05.628433 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2802cc85-d9ec-4978-a5ad-695913794147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8228f20f4354277843c481662aba77a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:05.629613 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2802cc85-d9ec-4978-a5ad-695913794147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8228f20f4354277843c481662aba77a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:05.649531 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2802cc85-d9ec-4978-a5ad-695913794147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8228f20f4354277843c481662aba77a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:05.650407 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2802cc85-d9ec-4978-a5ad-695913794147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8228f20f4354277843c481662aba77a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:05.654100 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d8ab4b1e-105b-4325-a495-def3935f5908 None None] MFA Rules not processed for user `03fe7640172743efb68a70872f9ba892`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:05.655514 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d8ab4b1e-105b-4325-a495-def3935f5908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:05.666252 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1382/2732] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:47:05 2022] DELETE /identity/v3/users/b8228f20f4354277843c481662aba77a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:05.671632 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b9fbd-098a-4a2d-9ee9-f942c11d9668 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:05.671919 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b9fbd-098a-4a2d-9ee9-f942c11d9668 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:05.672191 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b9fbd-098a-4a2d-9ee9-f942c11d9668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:05.689102 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-217b9fbd-098a-4a2d-9ee9-f942c11d9668 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:05.690333 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-217b9fbd-098a-4a2d-9ee9-f942c11d9668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:05.729804 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1351/2733] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:47:05.742406 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab4b1e-105b-4325-a495-def3935f5908 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:05.744938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d8ab4b1e-105b-4325-a495-def3935f5908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:05.755884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1383/2734] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:05.768666 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b9fbd-098a-4a2d-9ee9-f942c11d9668 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:05.770275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-217b9fbd-098a-4a2d-9ee9-f942c11d9668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:05.819700 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab4b1e-105b-4325-a495-def3935f5908 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:05.831443 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b9fbd-098a-4a2d-9ee9-f942c11d9668 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:05.835166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9886667-4dea-411e-9faa-fe9d707bf906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:05.835841 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9886667-4dea-411e-9faa-fe9d707bf906 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:05.836123 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9886667-4dea-411e-9faa-fe9d707bf906 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:05.836393 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9886667-4dea-411e-9faa-fe9d707bf906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:05.845845 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9886667-4dea-411e-9faa-fe9d707bf906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:05.847315 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9886667-4dea-411e-9faa-fe9d707bf906 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:05.857514 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1384/2735] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:05.875820 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd1cc5-5685-460d-ac8b-855517af7d94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:05.876362 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd1cc5-5685-460d-ac8b-855517af7d94 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:05.876650 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd1cc5-5685-460d-ac8b-855517af7d94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:05.876940 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd1cc5-5685-460d-ac8b-855517af7d94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:05.879555 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-77cd1cc5-5685-460d-ac8b-855517af7d94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:05.930439 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:05.952772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd1cc5-5685-460d-ac8b-855517af7d94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:05.954219 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd1cc5-5685-460d-ac8b-855517af7d94 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:05.971315 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1352/2736] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:47:06.125766 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9886667-4dea-411e-9faa-fe9d707bf906 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:06.128030 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d9886667-4dea-411e-9faa-fe9d707bf906 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:06.144419 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9886667-4dea-411e-9faa-fe9d707bf906 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:06.149667 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d34248-f704-4568-baa8-513f617d4976 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:06.150431 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d34248-f704-4568-baa8-513f617d4976 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:06.150762 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d34248-f704-4568-baa8-513f617d4976 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:06.151640 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d34248-f704-4568-baa8-513f617d4976 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:06.154638 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d9d34248-f704-4568-baa8-513f617d4976 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:06.157735 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd1cc5-5685-460d-ac8b-855517af7d94 service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:06.159422 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-77cd1cc5-5685-460d-ac8b-855517af7d94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:06.180420 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd1cc5-5685-460d-ac8b-855517af7d94 service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:06.186742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3bd1b-7580-4ca7-9e84-666cfa9aa841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:06.188473 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3bd1b-7580-4ca7-9e84-666cfa9aa841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:06.188936 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3bd1b-7580-4ca7-9e84-666cfa9aa841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:06.189409 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3bd1b-7580-4ca7-9e84-666cfa9aa841 admin admin] PATH_INFO: `/v3/projects/f64e06ded9b74b9fbb13817a221bea0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:06.190888 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3bd1b-7580-4ca7-9e84-666cfa9aa841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f64e06ded9b74b9fbb13817a221bea0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:06.193913 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3bd1b-7580-4ca7-9e84-666cfa9aa841 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:06.215306 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:06.254228 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d34248-f704-4568-baa8-513f617d4976 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:06.255743 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d34248-f704-4568-baa8-513f617d4976 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:06.263995 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-26c3bd1b-7580-4ca7-9e84-666cfa9aa841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f64e06ded9b74b9fbb13817a221bea0b', 'request_id': 'req-26c3bd1b-7580-4ca7-9e84-666cfa9aa841'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:06.269335 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1385/2737] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:06.283008 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-26c3bd1b-7580-4ca7-9e84-666cfa9aa841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f64e06ded9b74b9fbb13817a221bea0b', 'request_id': 'req-26c3bd1b-7580-4ca7-9e84-666cfa9aa841'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:06.289912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-26c3bd1b-7580-4ca7-9e84-666cfa9aa841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f64e06ded9b74b9fbb13817a221bea0b', 'request_id': 'req-26c3bd1b-7580-4ca7-9e84-666cfa9aa841'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:06.309012 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-26c3bd1b-7580-4ca7-9e84-666cfa9aa841 admin admin] The token cache is being invalidate because project f64e06ded9b74b9fbb13817a221bea0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:47:06.309324 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-26c3bd1b-7580-4ca7-9e84-666cfa9aa841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:06.311107 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-26c3bd1b-7580-4ca7-9e84-666cfa9aa841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:06.314536 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1353/2738] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:47:06 2022] DELETE /identity/v3/projects/f64e06ded9b74b9fbb13817a221bea0b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:47:06.318371 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d34248-f704-4568-baa8-513f617d4976 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:06.335172 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d34248-f704-4568-baa8-513f617d4976 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:06.414028 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b969a5-28f5-4d22-9acc-39c5b79de7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:06.414945 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b969a5-28f5-4d22-9acc-39c5b79de7ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:06.415216 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b969a5-28f5-4d22-9acc-39c5b79de7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:06.415479 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b969a5-28f5-4d22-9acc-39c5b79de7ba admin admin] PATH_INFO: `/v3/users/f67f2063eae342298bac48bbfb549de9` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:06.416924 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b969a5-28f5-4d22-9acc-39c5b79de7ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=f67f2063eae342298bac48bbfb549de9)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:06.418948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b969a5-28f5-4d22-9acc-39c5b79de7ba admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:06.466630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-14b969a5-28f5-4d22-9acc-39c5b79de7ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f67f2063eae342298bac48bbfb549de9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:06.475701 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-14b969a5-28f5-4d22-9acc-39c5b79de7ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f67f2063eae342298bac48bbfb549de9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:06.476332 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-14b969a5-28f5-4d22-9acc-39c5b79de7ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f67f2063eae342298bac48bbfb549de9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:06.493655 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-14b969a5-28f5-4d22-9acc-39c5b79de7ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f67f2063eae342298bac48bbfb549de9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:06.494455 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-14b969a5-28f5-4d22-9acc-39c5b79de7ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f67f2063eae342298bac48bbfb549de9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:06.514017 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1386/2739] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:47:06 2022] DELETE /identity/v3/users/f67f2063eae342298bac48bbfb549de9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:47:06.836611 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3bd1b-7580-4ca7-9e84-666cfa9aa841 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:06.838174 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-26c3bd1b-7580-4ca7-9e84-666cfa9aa841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:06.853051 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3bd1b-7580-4ca7-9e84-666cfa9aa841 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:06.923423 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81061ee0-9da8-4a03-a084-1d9a721513ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:06.924313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81061ee0-9da8-4a03-a084-1d9a721513ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:06.924592 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81061ee0-9da8-4a03-a084-1d9a721513ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:06.924865 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81061ee0-9da8-4a03-a084-1d9a721513ea admin admin] PATH_INFO: `/v3/projects/d1bb771e2dba41fda4f8c4b94c40d7bf` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:06.926109 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81061ee0-9da8-4a03-a084-1d9a721513ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1bb771e2dba41fda4f8c4b94c40d7bf)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:06.928055 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81061ee0-9da8-4a03-a084-1d9a721513ea admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:06.984602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-81061ee0-9da8-4a03-a084-1d9a721513ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1bb771e2dba41fda4f8c4b94c40d7bf', 'request_id': 'req-81061ee0-9da8-4a03-a084-1d9a721513ea'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:06.990339 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-81061ee0-9da8-4a03-a084-1d9a721513ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1bb771e2dba41fda4f8c4b94c40d7bf', 'request_id': 'req-81061ee0-9da8-4a03-a084-1d9a721513ea'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:06.997044 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-81061ee0-9da8-4a03-a084-1d9a721513ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1bb771e2dba41fda4f8c4b94c40d7bf', 'request_id': 'req-81061ee0-9da8-4a03-a084-1d9a721513ea'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:07.000791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:07.014622 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-81061ee0-9da8-4a03-a084-1d9a721513ea admin admin] The token cache is being invalidate because project d1bb771e2dba41fda4f8c4b94c40d7bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:47:07.014915 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-81061ee0-9da8-4a03-a084-1d9a721513ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:07.015557 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-81061ee0-9da8-4a03-a084-1d9a721513ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:07.017390 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1354/2740] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:47:06 2022] DELETE /identity/v3/projects/d1bb771e2dba41fda4f8c4b94c40d7bf => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:07.022434 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f3671-4d43-4950-a401-f19852d7aa8f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:07.023003 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f3671-4d43-4950-a401-f19852d7aa8f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:07.023003 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f3671-4d43-4950-a401-f19852d7aa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:07.041750 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-249f3671-4d43-4950-a401-f19852d7aa8f None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:07.043114 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-249f3671-4d43-4950-a401-f19852d7aa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:07.093030 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:07.113748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1387/2741] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:07.124694 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1596405-8b44-4f1a-b143-de22b4c77cfc None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:07.125000 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1596405-8b44-4f1a-b143-de22b4c77cfc None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:07.125280 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1596405-8b44-4f1a-b143-de22b4c77cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:07.149537 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-e1596405-8b44-4f1a-b143-de22b4c77cfc None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:07.151120 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e1596405-8b44-4f1a-b143-de22b4c77cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:07.163628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1355/2742] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:07.168607 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f3671-4d43-4950-a401-f19852d7aa8f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:07.179104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f3671-4d43-4950-a401-f19852d7aa8f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:07.184243 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b84420-48ab-416e-b112-100bd929a1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:07.184917 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b84420-48ab-416e-b112-100bd929a1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:07.185187 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b84420-48ab-416e-b112-100bd929a1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:07.185451 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b84420-48ab-416e-b112-100bd929a1d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:07.186166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b84420-48ab-416e-b112-100bd929a1d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:47:07.186463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b84420-48ab-416e-b112-100bd929a1d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:07.188078 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b84420-48ab-416e-b112-100bd929a1d8 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:07.200861 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1388/2743] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:47:07.205527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1596405-8b44-4f1a-b143-de22b4c77cfc None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:07.215150 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1596405-8b44-4f1a-b143-de22b4c77cfc None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:07.220357 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfed9a2-d5ad-437e-84fb-2a26d7f0afbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:07.221013 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfed9a2-d5ad-437e-84fb-2a26d7f0afbb admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:07.221297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfed9a2-d5ad-437e-84fb-2a26d7f0afbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:07.221559 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfed9a2-d5ad-437e-84fb-2a26d7f0afbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:07.222255 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfed9a2-d5ad-437e-84fb-2a26d7f0afbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:07.224216 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfed9a2-d5ad-437e-84fb-2a26d7f0afbb admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:07.253130 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1356/2744] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:47:07 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:47:07.257531 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b84420-48ab-416e-b112-100bd929a1d8 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:07.268820 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b84420-48ab-416e-b112-100bd929a1d8 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:07.325052 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d6a5a-4b05-425c-97c8-a60e2ffe68e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:07.325722 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d6a5a-4b05-425c-97c8-a60e2ffe68e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:07.326001 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d6a5a-4b05-425c-97c8-a60e2ffe68e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:07.326283 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d6a5a-4b05-425c-97c8-a60e2ffe68e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:07.326975 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d6a5a-4b05-425c-97c8-a60e2ffe68e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:07.328876 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d6a5a-4b05-425c-97c8-a60e2ffe68e5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:07.350936 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1389/2745] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:47:07 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:47:07.355360 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfed9a2-d5ad-437e-84fb-2a26d7f0afbb admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:07.365404 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfed9a2-d5ad-437e-84fb-2a26d7f0afbb admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:07.370949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818560e-1447-45d5-b36d-dc9f2b77d9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:07.371633 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818560e-1447-45d5-b36d-dc9f2b77d9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:07.371913 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818560e-1447-45d5-b36d-dc9f2b77d9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:07.372175 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818560e-1447-45d5-b36d-dc9f2b77d9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:07.372902 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818560e-1447-45d5-b36d-dc9f2b77d9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:07.374482 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818560e-1447-45d5-b36d-dc9f2b77d9e5 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:07.387914 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1357/2746] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:47:07.392068 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d6a5a-4b05-425c-97c8-a60e2ffe68e5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:07.402821 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d6a5a-4b05-425c-97c8-a60e2ffe68e5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:07.404439 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818560e-1447-45d5-b36d-dc9f2b77d9e5 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:07.406740 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a818560e-1447-45d5-b36d-dc9f2b77d9e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:07.409416 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cb19d-7a9a-4fe3-995f-d27487eac7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:07.410098 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cb19d-7a9a-4fe3-995f-d27487eac7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:07.410374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cb19d-7a9a-4fe3-995f-d27487eac7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:07.410714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cb19d-7a9a-4fe3-995f-d27487eac7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:07.411391 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3cb19d-7a9a-4fe3-995f-d27487eac7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:07.412987 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3cb19d-7a9a-4fe3-995f-d27487eac7b9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:07.425183 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1390/2747] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:47:07.429487 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cb19d-7a9a-4fe3-995f-d27487eac7b9 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:07.441954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cb19d-7a9a-4fe3-995f-d27487eac7b9 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:07.446867 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14777905-8d2d-427c-9f4c-5f0046437069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:07.447782 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14777905-8d2d-427c-9f4c-5f0046437069 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:07.448063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14777905-8d2d-427c-9f4c-5f0046437069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:07.448331 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14777905-8d2d-427c-9f4c-5f0046437069 admin admin] PATH_INFO: `/v3/projects/c1b1b37f3d114b0ba66867f9ec350eb2/users/29458cb7c5f8439fba10a79b32388d7b/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:07.464320 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14777905-8d2d-427c-9f4c-5f0046437069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b1b37f3d114b0ba66867f9ec350eb2, user_id=29458cb7c5f8439fba10a79b32388d7b, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:07.467124 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14777905-8d2d-427c-9f4c-5f0046437069 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:07.471803 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818560e-1447-45d5-b36d-dc9f2b77d9e5 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:07.477277 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef02b40-840e-4252-a886-9840b744bb80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:07.478097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef02b40-840e-4252-a886-9840b744bb80 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:07.478452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef02b40-840e-4252-a886-9840b744bb80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:07.478798 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef02b40-840e-4252-a886-9840b744bb80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:07.481205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5ef02b40-840e-4252-a886-9840b744bb80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:07.483584 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1391/2748] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:47:07 2022] PUT /identity/v3/projects/c1b1b37f3d114b0ba66867f9ec350eb2/users/29458cb7c5f8439fba10a79b32388d7b/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:07.493608 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e6991-3b47-41ca-a1d9-2bad62f8ef0c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:07.493970 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e6991-3b47-41ca-a1d9-2bad62f8ef0c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:07.494305 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e6991-3b47-41ca-a1d9-2bad62f8ef0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:07.538327 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d33e6991-3b47-41ca-a1d9-2bad62f8ef0c None None] MFA Rules not processed for user `29458cb7c5f8439fba10a79b32388d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:07.539702 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d33e6991-3b47-41ca-a1d9-2bad62f8ef0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:07.567197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef02b40-840e-4252-a886-9840b744bb80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:07.568772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef02b40-840e-4252-a886-9840b744bb80 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:07.584821 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1358/2749] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:47:07.616031 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1392/2750] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:07.640882 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef02b40-840e-4252-a886-9840b744bb80 service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:07.647452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef02b40-840e-4252-a886-9840b744bb80 service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:07.714283 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e24aca-d9ba-48f3-81c3-a80810561bba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:07.715177 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e24aca-d9ba-48f3-81c3-a80810561bba service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:07.715481 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e24aca-d9ba-48f3-81c3-a80810561bba service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:07.715781 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e24aca-d9ba-48f3-81c3-a80810561bba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:07.725377 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e24aca-d9ba-48f3-81c3-a80810561bba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:07.726923 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e24aca-d9ba-48f3-81c3-a80810561bba service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:07.741191 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1359/2751] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:10.301245 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e6991-3b47-41ca-a1d9-2bad62f8ef0c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:10.302850 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d33e6991-3b47-41ca-a1d9-2bad62f8ef0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:10.332335 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:10.378463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e6991-3b47-41ca-a1d9-2bad62f8ef0c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:10.383042 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10191fc4-1643-4f9e-ba23-4d3fe4bf4f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:10.383905 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10191fc4-1643-4f9e-ba23-4d3fe4bf4f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:10.386899 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10191fc4-1643-4f9e-ba23-4d3fe4bf4f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:10.387189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10191fc4-1643-4f9e-ba23-4d3fe4bf4f55 admin admin] PATH_INFO: `/v3/users/db1bfb98df6041f1ba1a6ac5723e948a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:10.388676 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10191fc4-1643-4f9e-ba23-4d3fe4bf4f55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db1bfb98df6041f1ba1a6ac5723e948a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:10.390634 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10191fc4-1643-4f9e-ba23-4d3fe4bf4f55 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:10.443184 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-10191fc4-1643-4f9e-ba23-4d3fe4bf4f55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db1bfb98df6041f1ba1a6ac5723e948a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:10.452148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-10191fc4-1643-4f9e-ba23-4d3fe4bf4f55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db1bfb98df6041f1ba1a6ac5723e948a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:10.452778 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-10191fc4-1643-4f9e-ba23-4d3fe4bf4f55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db1bfb98df6041f1ba1a6ac5723e948a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:10.464946 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-10191fc4-1643-4f9e-ba23-4d3fe4bf4f55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db1bfb98df6041f1ba1a6ac5723e948a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:10.465560 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-10191fc4-1643-4f9e-ba23-4d3fe4bf4f55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db1bfb98df6041f1ba1a6ac5723e948a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:10.478553 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1393/2752] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:47:10 2022] DELETE /identity/v3/users/db1bfb98df6041f1ba1a6ac5723e948a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:10.483299 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b8cf1-1750-4e18-b4cc-ebf09d475967 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:10.483766 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b8cf1-1750-4e18-b4cc-ebf09d475967 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:10.483871 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b8cf1-1750-4e18-b4cc-ebf09d475967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:10.501888 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-9d8b8cf1-1750-4e18-b4cc-ebf09d475967 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:10.503245 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9d8b8cf1-1750-4e18-b4cc-ebf09d475967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:10.507323 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:10.569190 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1360/2753] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:47:10.579522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10191fc4-1643-4f9e-ba23-4d3fe4bf4f55 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:10.581143 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-10191fc4-1643-4f9e-ba23-4d3fe4bf4f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:10.641948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10191fc4-1643-4f9e-ba23-4d3fe4bf4f55 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:10.646606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19f397-2c0a-4e10-bc2a-a414596911f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:10.647270 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19f397-2c0a-4e10-bc2a-a414596911f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:10.647545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19f397-2c0a-4e10-bc2a-a414596911f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:10.647810 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19f397-2c0a-4e10-bc2a-a414596911f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:10.657773 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19f397-2c0a-4e10-bc2a-a414596911f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:10.659262 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19f397-2c0a-4e10-bc2a-a414596911f8 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:10.670512 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1394/2754] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:10.864124 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b8cf1-1750-4e18-b4cc-ebf09d475967 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:10.865746 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9d8b8cf1-1750-4e18-b4cc-ebf09d475967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:10.877514 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b8cf1-1750-4e18-b4cc-ebf09d475967 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:10.882478 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7f29f-c9b2-4b9d-be03-e01008efa30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:10.883384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7f29f-c9b2-4b9d-be03-e01008efa30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:10.883657 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7f29f-c9b2-4b9d-be03-e01008efa30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:10.883924 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7f29f-c9b2-4b9d-be03-e01008efa30e admin admin] PATH_INFO: `/v3/users/29458cb7c5f8439fba10a79b32388d7b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:10.885537 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d7f29f-c9b2-4b9d-be03-e01008efa30e admin admin] RBAC: Authorizing `identity:delete_user(user_id=29458cb7c5f8439fba10a79b32388d7b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:10.887675 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d7f29f-c9b2-4b9d-be03-e01008efa30e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:10.939751 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-87d7f29f-c9b2-4b9d-be03-e01008efa30e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29458cb7c5f8439fba10a79b32388d7b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:10.948012 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-87d7f29f-c9b2-4b9d-be03-e01008efa30e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29458cb7c5f8439fba10a79b32388d7b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:10.948863 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-87d7f29f-c9b2-4b9d-be03-e01008efa30e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29458cb7c5f8439fba10a79b32388d7b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:10.954591 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19f397-2c0a-4e10-bc2a-a414596911f8 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:10.956092 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6f19f397-2c0a-4e10-bc2a-a414596911f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:10.962152 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-87d7f29f-c9b2-4b9d-be03-e01008efa30e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29458cb7c5f8439fba10a79b32388d7b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:10.972124 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19f397-2c0a-4e10-bc2a-a414596911f8 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:10.976880 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-87d7f29f-c9b2-4b9d-be03-e01008efa30e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29458cb7c5f8439fba10a79b32388d7b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:10.977808 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe41b5-f345-48cd-9a41-0619c88f222f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:10.978844 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe41b5-f345-48cd-9a41-0619c88f222f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:10.979089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe41b5-f345-48cd-9a41-0619c88f222f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:10.979420 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe41b5-f345-48cd-9a41-0619c88f222f admin admin] PATH_INFO: `/v3/projects/4406c01d83014a6d8fadc26f762826e7` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:10.982495 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe41b5-f345-48cd-9a41-0619c88f222f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4406c01d83014a6d8fadc26f762826e7)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:10.984831 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe41b5-f345-48cd-9a41-0619c88f222f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:10.989582 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1361/2755] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:47:10 2022] DELETE /identity/v3/users/29458cb7c5f8439fba10a79b32388d7b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:10.994527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e95f90-b29f-417e-b133-bbcdfabf5dc9 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:10.994867 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e95f90-b29f-417e-b133-bbcdfabf5dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:10.995170 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e95f90-b29f-417e-b133-bbcdfabf5dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:11.014118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-87e95f90-b29f-417e-b133-bbcdfabf5dc9 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:11.015437 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-87e95f90-b29f-417e-b133-bbcdfabf5dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:11.025700 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:11.033893 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3dbe41b5-f345-48cd-9a41-0619c88f222f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4406c01d83014a6d8fadc26f762826e7', 'request_id': 'req-3dbe41b5-f345-48cd-9a41-0619c88f222f'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:11.040388 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3dbe41b5-f345-48cd-9a41-0619c88f222f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4406c01d83014a6d8fadc26f762826e7', 'request_id': 'req-3dbe41b5-f345-48cd-9a41-0619c88f222f'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:11.046773 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3dbe41b5-f345-48cd-9a41-0619c88f222f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4406c01d83014a6d8fadc26f762826e7', 'request_id': 'req-3dbe41b5-f345-48cd-9a41-0619c88f222f'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:11.062238 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3dbe41b5-f345-48cd-9a41-0619c88f222f admin admin] The token cache is being invalidate because project 4406c01d83014a6d8fadc26f762826e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:47:11.062629 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3dbe41b5-f345-48cd-9a41-0619c88f222f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:11.063282 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3dbe41b5-f345-48cd-9a41-0619c88f222f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:11.064841 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1395/2756] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:47:10 2022] DELETE /identity/v3/projects/4406c01d83014a6d8fadc26f762826e7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:11.068707 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe41b5-f345-48cd-9a41-0619c88f222f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:11.069987 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3dbe41b5-f345-48cd-9a41-0619c88f222f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:11.079035 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1362/2757] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:47:11.088568 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e95f90-b29f-417e-b133-bbcdfabf5dc9 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:11.090144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-87e95f90-b29f-417e-b133-bbcdfabf5dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:11.116097 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:11.140078 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe41b5-f345-48cd-9a41-0619c88f222f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:11.144909 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47af11-58d1-4b87-8c49-13316e5ba989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:11.145804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47af11-58d1-4b87-8c49-13316e5ba989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:11.146086 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47af11-58d1-4b87-8c49-13316e5ba989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:11.146358 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47af11-58d1-4b87-8c49-13316e5ba989 admin admin] PATH_INFO: `/v3/users/8507c339dc184a6391feb05dd836ae9b` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:11.147618 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47af11-58d1-4b87-8c49-13316e5ba989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8507c339dc184a6391feb05dd836ae9b)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:11.149523 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47af11-58d1-4b87-8c49-13316e5ba989 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:11.150343 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e95f90-b29f-417e-b133-bbcdfabf5dc9 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:11.200015 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6b47af11-58d1-4b87-8c49-13316e5ba989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8507c339dc184a6391feb05dd836ae9b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:11.206917 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90f2b0-0d36-471c-ae13-00cefa877b27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:11.207679 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90f2b0-0d36-471c-ae13-00cefa877b27 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:11.208103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90f2b0-0d36-471c-ae13-00cefa877b27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:11.208358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90f2b0-0d36-471c-ae13-00cefa877b27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:11.208825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6b47af11-58d1-4b87-8c49-13316e5ba989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8507c339dc184a6391feb05dd836ae9b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:11.209471 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6b47af11-58d1-4b87-8c49-13316e5ba989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8507c339dc184a6391feb05dd836ae9b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:11.218015 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90f2b0-0d36-471c-ae13-00cefa877b27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:11.219546 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90f2b0-0d36-471c-ae13-00cefa877b27 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:11.222202 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6b47af11-58d1-4b87-8c49-13316e5ba989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8507c339dc184a6391feb05dd836ae9b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:11.222911 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6b47af11-58d1-4b87-8c49-13316e5ba989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8507c339dc184a6391feb05dd836ae9b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:11.229384 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1363/2758] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:47:11.235843 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1396/2759] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:47:11 2022] DELETE /identity/v3/users/8507c339dc184a6391feb05dd836ae9b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:47:11.502815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90f2b0-0d36-471c-ae13-00cefa877b27 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:11.504807 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ab90f2b0-0d36-471c-ae13-00cefa877b27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:11.519485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90f2b0-0d36-471c-ae13-00cefa877b27 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:11.596684 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089a25a-998e-40d1-a75f-dc1c7aa16737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:11.597589 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089a25a-998e-40d1-a75f-dc1c7aa16737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:11.597862 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089a25a-998e-40d1-a75f-dc1c7aa16737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:11.598134 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089a25a-998e-40d1-a75f-dc1c7aa16737 admin admin] PATH_INFO: `/v3/users/a1d702d7f1ba4fdbb0d4286ec5e7ab94` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:11.599364 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089a25a-998e-40d1-a75f-dc1c7aa16737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1d702d7f1ba4fdbb0d4286ec5e7ab94)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:11.601287 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089a25a-998e-40d1-a75f-dc1c7aa16737 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:11.640032 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47af11-58d1-4b87-8c49-13316e5ba989 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:11.646125 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6b47af11-58d1-4b87-8c49-13316e5ba989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:11.663718 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47af11-58d1-4b87-8c49-13316e5ba989 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:11.668815 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf67d1-a16d-4519-8d6e-977504d73dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:11.669691 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf67d1-a16d-4519-8d6e-977504d73dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:11.669972 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf67d1-a16d-4519-8d6e-977504d73dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:11.670410 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf67d1-a16d-4519-8d6e-977504d73dbb admin admin] PATH_INFO: `/v3/projects/c1b1b37f3d114b0ba66867f9ec350eb2` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:11.672304 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf67d1-a16d-4519-8d6e-977504d73dbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1b1b37f3d114b0ba66867f9ec350eb2)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:11.674229 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf67d1-a16d-4519-8d6e-977504d73dbb admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:11.680797 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c089a25a-998e-40d1-a75f-dc1c7aa16737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1d702d7f1ba4fdbb0d4286ec5e7ab94'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:11.691466 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c089a25a-998e-40d1-a75f-dc1c7aa16737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1d702d7f1ba4fdbb0d4286ec5e7ab94'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:11.692066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c089a25a-998e-40d1-a75f-dc1c7aa16737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1d702d7f1ba4fdbb0d4286ec5e7ab94'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:11.704363 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c089a25a-998e-40d1-a75f-dc1c7aa16737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1d702d7f1ba4fdbb0d4286ec5e7ab94'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:11.718338 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c089a25a-998e-40d1-a75f-dc1c7aa16737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1d702d7f1ba4fdbb0d4286ec5e7ab94'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:11.720764 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:11.724422 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:11.725851 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1364/2760] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:47:11 2022] DELETE /identity/v3/users/a1d702d7f1ba4fdbb0d4286ec5e7ab94 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:11.727749 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089a25a-998e-40d1-a75f-dc1c7aa16737 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:11.730080 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c089a25a-998e-40d1-a75f-dc1c7aa16737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:11.736594 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-eeaf67d1-a16d-4519-8d6e-977504d73dbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1b1b37f3d114b0ba66867f9ec350eb2', 'request_id': 'req-eeaf67d1-a16d-4519-8d6e-977504d73dbb'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:11.742867 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-eeaf67d1-a16d-4519-8d6e-977504d73dbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1b1b37f3d114b0ba66867f9ec350eb2', 'request_id': 'req-eeaf67d1-a16d-4519-8d6e-977504d73dbb'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:11.749268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-eeaf67d1-a16d-4519-8d6e-977504d73dbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1b1b37f3d114b0ba66867f9ec350eb2', 'request_id': 'req-eeaf67d1-a16d-4519-8d6e-977504d73dbb'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:11.762301 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-eeaf67d1-a16d-4519-8d6e-977504d73dbb admin admin] The token cache is being invalidate because project c1b1b37f3d114b0ba66867f9ec350eb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:47:11.762614 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-eeaf67d1-a16d-4519-8d6e-977504d73dbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:11.763249 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-eeaf67d1-a16d-4519-8d6e-977504d73dbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:11.764980 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1397/2761] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:47:11 2022] DELETE /identity/v3/projects/c1b1b37f3d114b0ba66867f9ec350eb2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:11.766350 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b850689-f956-41cb-8167-7c692eb39310 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:11.766668 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b850689-f956-41cb-8167-7c692eb39310 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:11.766948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b850689-f956-41cb-8167-7c692eb39310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:11.785398 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0b850689-f956-41cb-8167-7c692eb39310 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:11.786604 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0b850689-f956-41cb-8167-7c692eb39310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:11.799864 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089a25a-998e-40d1-a75f-dc1c7aa16737 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:11.804463 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4000ec-68f2-439e-a024-38201117bbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:11.805334 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4000ec-68f2-439e-a024-38201117bbf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:11.805615 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4000ec-68f2-439e-a024-38201117bbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:11.805904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4000ec-68f2-439e-a024-38201117bbf4 admin admin] PATH_INFO: `/v3/projects/5bd7af9c7d6241feacd20090122984c0` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:11.807117 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4000ec-68f2-439e-a024-38201117bbf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bd7af9c7d6241feacd20090122984c0)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:11.809153 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4000ec-68f2-439e-a024-38201117bbf4 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:11.847322 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1398/2762] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:11.848788 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283b1f0-b405-4308-ba68-ee31441c2b65 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:11.849080 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283b1f0-b405-4308-ba68-ee31441c2b65 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:11.849355 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283b1f0-b405-4308-ba68-ee31441c2b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:11.856639 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bb4000ec-68f2-439e-a024-38201117bbf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bd7af9c7d6241feacd20090122984c0', 'request_id': 'req-bb4000ec-68f2-439e-a024-38201117bbf4'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:11.862103 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bb4000ec-68f2-439e-a024-38201117bbf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bd7af9c7d6241feacd20090122984c0', 'request_id': 'req-bb4000ec-68f2-439e-a024-38201117bbf4'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:11.867757 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c283b1f0-b405-4308-ba68-ee31441c2b65 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:11.869177 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c283b1f0-b405-4308-ba68-ee31441c2b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:11.869789 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bb4000ec-68f2-439e-a024-38201117bbf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bd7af9c7d6241feacd20090122984c0', 'request_id': 'req-bb4000ec-68f2-439e-a024-38201117bbf4'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:11.884629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bb4000ec-68f2-439e-a024-38201117bbf4 admin admin] The token cache is being invalidate because project 5bd7af9c7d6241feacd20090122984c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:47:11.885256 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bb4000ec-68f2-439e-a024-38201117bbf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:11.886288 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bb4000ec-68f2-439e-a024-38201117bbf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:11.887957 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1365/2763] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:47:11 2022] DELETE /identity/v3/projects/5bd7af9c7d6241feacd20090122984c0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:11.889010 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4000ec-68f2-439e-a024-38201117bbf4 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:11.890339 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-bb4000ec-68f2-439e-a024-38201117bbf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:11.938377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1399/2764] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:11.938377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283b1f0-b405-4308-ba68-ee31441c2b65 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:11.938377 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c283b1f0-b405-4308-ba68-ee31441c2b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:11.944783 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283b1f0-b405-4308-ba68-ee31441c2b65 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:11.949394 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc82cea-0ce8-424f-8475-ffe984d8c456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:11.950268 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc82cea-0ce8-424f-8475-ffe984d8c456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:11.950531 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc82cea-0ce8-424f-8475-ffe984d8c456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:11.950824 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc82cea-0ce8-424f-8475-ffe984d8c456 admin admin] PATH_INFO: `/v3/users/b8b750fa15aa4b1987eded1e8c93bccd` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:11.952006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc82cea-0ce8-424f-8475-ffe984d8c456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8b750fa15aa4b1987eded1e8c93bccd)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:11.953911 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc82cea-0ce8-424f-8475-ffe984d8c456 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:11.954755 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4000ec-68f2-439e-a024-38201117bbf4 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:11.959040 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7ad35-7684-4adb-b3fc-2280413b682e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:11.959695 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7ad35-7684-4adb-b3fc-2280413b682e service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:11.959969 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7ad35-7684-4adb-b3fc-2280413b682e service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:11.960235 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7ad35-7684-4adb-b3fc-2280413b682e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:11.962195 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a0b7ad35-7684-4adb-b3fc-2280413b682e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:11.975364 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7ad35-7684-4adb-b3fc-2280413b682e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:11.976819 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7ad35-7684-4adb-b3fc-2280413b682e service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:11.989419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1366/2765] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:11.990908 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5dd21-d2a1-4de4-8af0-0f925d205547 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:11.991269 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5dd21-d2a1-4de4-8af0-0f925d205547 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:11.991652 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5dd21-d2a1-4de4-8af0-0f925d205547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:12.003916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3bc82cea-0ce8-424f-8475-ffe984d8c456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8b750fa15aa4b1987eded1e8c93bccd'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:12.013900 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-29b5dd21-d2a1-4de4-8af0-0f925d205547 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:12.015362 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-29b5dd21-d2a1-4de4-8af0-0f925d205547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:12.015918 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3bc82cea-0ce8-424f-8475-ffe984d8c456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8b750fa15aa4b1987eded1e8c93bccd'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:12.016632 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3bc82cea-0ce8-424f-8475-ffe984d8c456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8b750fa15aa4b1987eded1e8c93bccd'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:12.024242 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1367/2766] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:12.028701 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5dd21-d2a1-4de4-8af0-0f925d205547 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:12.031859 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:12.038346 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3bc82cea-0ce8-424f-8475-ffe984d8c456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8b750fa15aa4b1987eded1e8c93bccd'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:12.038924 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5dd21-d2a1-4de4-8af0-0f925d205547 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:12.039950 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3bc82cea-0ce8-424f-8475-ffe984d8c456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8b750fa15aa4b1987eded1e8c93bccd'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:12.044546 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee5204-0c00-471a-b847-5fa033776d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:12.045217 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee5204-0c00-471a-b847-5fa033776d32 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:12.045553 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee5204-0c00-471a-b847-5fa033776d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:12.045948 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee5204-0c00-471a-b847-5fa033776d32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:12.046870 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee5204-0c00-471a-b847-5fa033776d32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:47:12.047251 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee5204-0c00-471a-b847-5fa033776d32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:12.049124 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee5204-0c00-471a-b847-5fa033776d32 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:12.060280 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1400/2767] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:47:11 2022] DELETE /identity/v3/users/b8b750fa15aa4b1987eded1e8c93bccd => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:12.069772 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1368/2768] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:47:12.071951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc82cea-0ce8-424f-8475-ffe984d8c456 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:12.150144 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc82cea-0ce8-424f-8475-ffe984d8c456 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:12.156053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c6e11-3b4c-43f6-83c7-fba4dbd4d68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:12.156927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c6e11-3b4c-43f6-83c7-fba4dbd4d68b admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:12.157214 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c6e11-3b4c-43f6-83c7-fba4dbd4d68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:12.157469 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c6e11-3b4c-43f6-83c7-fba4dbd4d68b admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:12.158167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c6e11-3b4c-43f6-83c7-fba4dbd4d68b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:12.160159 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c6e11-3b4c-43f6-83c7-fba4dbd4d68b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:12.192468 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1401/2769] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:47:12 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:47:12.194069 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee5204-0c00-471a-b847-5fa033776d32 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:12.204777 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee5204-0c00-471a-b847-5fa033776d32 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:12.216558 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:12.285235 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c15c2-a41a-4ec5-9e64-29e7b6acb103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:12.286167 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c15c2-a41a-4ec5-9e64-29e7b6acb103 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:12.286548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c15c2-a41a-4ec5-9e64-29e7b6acb103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:12.286977 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c15c2-a41a-4ec5-9e64-29e7b6acb103 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:12.287689 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c15c2-a41a-4ec5-9e64-29e7b6acb103 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:12.289727 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c15c2-a41a-4ec5-9e64-29e7b6acb103 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:12.310436 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c6e11-3b4c-43f6-83c7-fba4dbd4d68b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:12.312190 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ad4c6e11-3b4c-43f6-83c7-fba4dbd4d68b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:12.322400 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1369/2770] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:47:12 2022] POST /identity/v3/users => generated 284 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:47:12.326665 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c15c2-a41a-4ec5-9e64-29e7b6acb103 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:12.331608 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c6e11-3b4c-43f6-83c7-fba4dbd4d68b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:12.336691 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a4694-c876-4319-9e64-b80492fb725b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:12.337574 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a4694-c876-4319-9e64-b80492fb725b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:12.337854 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a4694-c876-4319-9e64-b80492fb725b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:12.338126 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a4694-c876-4319-9e64-b80492fb725b admin admin] PATH_INFO: `/v3/projects/43acab2f145c46639029913875208cae` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:12.339388 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a4694-c876-4319-9e64-b80492fb725b admin admin] RBAC: Authorizing `identity:delete_project(project_id=43acab2f145c46639029913875208cae)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:12.341321 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a4694-c876-4319-9e64-b80492fb725b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:12.344961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c15c2-a41a-4ec5-9e64-29e7b6acb103 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:12.353136 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565f646-d060-4903-a0a8-4ec2351f1370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:12.354137 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565f646-d060-4903-a0a8-4ec2351f1370 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:12.354483 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565f646-d060-4903-a0a8-4ec2351f1370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:12.355586 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565f646-d060-4903-a0a8-4ec2351f1370 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:12.356537 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565f646-d060-4903-a0a8-4ec2351f1370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:12.358247 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565f646-d060-4903-a0a8-4ec2351f1370 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:12.376959 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1370/2771] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:47:12.379079 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565f646-d060-4903-a0a8-4ec2351f1370 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:12.396804 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565f646-d060-4903-a0a8-4ec2351f1370 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:12.399156 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9d6a4694-c876-4319-9e64-b80492fb725b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43acab2f145c46639029913875208cae', 'request_id': 'req-9d6a4694-c876-4319-9e64-b80492fb725b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:12.405811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9d6a4694-c876-4319-9e64-b80492fb725b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43acab2f145c46639029913875208cae', 'request_id': 'req-9d6a4694-c876-4319-9e64-b80492fb725b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:12.419205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9d6a4694-c876-4319-9e64-b80492fb725b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43acab2f145c46639029913875208cae', 'request_id': 'req-9d6a4694-c876-4319-9e64-b80492fb725b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:12.433369 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9d6a4694-c876-4319-9e64-b80492fb725b admin admin] The token cache is being invalidate because project 43acab2f145c46639029913875208cae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:47:12.433633 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9d6a4694-c876-4319-9e64-b80492fb725b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:12.434289 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9d6a4694-c876-4319-9e64-b80492fb725b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:12.436333 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1402/2772] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:47:12 2022] DELETE /identity/v3/projects/43acab2f145c46639029913875208cae => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:47:12.436887 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a4694-c876-4319-9e64-b80492fb725b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:12.438141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9d6a4694-c876-4319-9e64-b80492fb725b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:12.461066 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4a31c-2a53-408a-9396-d0e9ac1c5149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:12.461762 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4a31c-2a53-408a-9396-d0e9ac1c5149 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:12.462037 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4a31c-2a53-408a-9396-d0e9ac1c5149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:12.462302 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4a31c-2a53-408a-9396-d0e9ac1c5149 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:12.463063 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4a31c-2a53-408a-9396-d0e9ac1c5149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:12.464672 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4a31c-2a53-408a-9396-d0e9ac1c5149 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:12.474383 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1371/2773] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:47:12.478438 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4a31c-2a53-408a-9396-d0e9ac1c5149 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:12.480413 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-dba4a31c-2a53-408a-9396-d0e9ac1c5149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:12.492946 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4a31c-2a53-408a-9396-d0e9ac1c5149 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:12.494905 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:12.498907 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e079a-4433-465b-8022-d342f002a67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:12.499791 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e079a-4433-465b-8022-d342f002a67a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:12.500073 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e079a-4433-465b-8022-d342f002a67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:12.500345 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e079a-4433-465b-8022-d342f002a67a admin admin] PATH_INFO: `/v3/users/03fe7640172743efb68a70872f9ba892` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:12.501547 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e079a-4433-465b-8022-d342f002a67a admin admin] RBAC: Authorizing `identity:delete_user(user_id=03fe7640172743efb68a70872f9ba892)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:12.503544 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e079a-4433-465b-8022-d342f002a67a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:12.511082 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a4694-c876-4319-9e64-b80492fb725b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:12.516118 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000c03b-ec0e-43a7-95f5-b953bf637ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:12.517004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000c03b-ec0e-43a7-95f5-b953bf637ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:12.517285 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000c03b-ec0e-43a7-95f5-b953bf637ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:12.517557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000c03b-ec0e-43a7-95f5-b953bf637ca9 admin admin] PATH_INFO: `/v3/projects/099163b6179141b48766f7ca8c281976` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:12.518773 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000c03b-ec0e-43a7-95f5-b953bf637ca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=099163b6179141b48766f7ca8c281976)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:12.520708 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000c03b-ec0e-43a7-95f5-b953bf637ca9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:12.554985 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b85e079a-4433-465b-8022-d342f002a67a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03fe7640172743efb68a70872f9ba892'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:12.563952 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b85e079a-4433-465b-8022-d342f002a67a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03fe7640172743efb68a70872f9ba892'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:12.564613 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b85e079a-4433-465b-8022-d342f002a67a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03fe7640172743efb68a70872f9ba892'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:12.572143 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b000c03b-ec0e-43a7-95f5-b953bf637ca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '099163b6179141b48766f7ca8c281976', 'request_id': 'req-b000c03b-ec0e-43a7-95f5-b953bf637ca9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:12.572545 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b85e079a-4433-465b-8022-d342f002a67a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03fe7640172743efb68a70872f9ba892'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:12.578085 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b000c03b-ec0e-43a7-95f5-b953bf637ca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '099163b6179141b48766f7ca8c281976', 'request_id': 'req-b000c03b-ec0e-43a7-95f5-b953bf637ca9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:12.584232 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b000c03b-ec0e-43a7-95f5-b953bf637ca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '099163b6179141b48766f7ca8c281976', 'request_id': 'req-b000c03b-ec0e-43a7-95f5-b953bf637ca9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:12.585444 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b85e079a-4433-465b-8022-d342f002a67a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03fe7640172743efb68a70872f9ba892'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:12.587736 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:12.592683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1372/2774] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:47:12 2022] DELETE /identity/v3/users/03fe7640172743efb68a70872f9ba892 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:12.594015 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e079a-4433-465b-8022-d342f002a67a admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:12.599518 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b85e079a-4433-465b-8022-d342f002a67a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:12.600629 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b000c03b-ec0e-43a7-95f5-b953bf637ca9 admin admin] The token cache is being invalidate because project 099163b6179141b48766f7ca8c281976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:47:12.600779 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b000c03b-ec0e-43a7-95f5-b953bf637ca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:12.601414 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b000c03b-ec0e-43a7-95f5-b953bf637ca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:12.603690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1403/2775] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:47:12 2022] DELETE /identity/v3/projects/099163b6179141b48766f7ca8c281976 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:12.608345 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f65420-b021-4ca6-8627-094341eb9076 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:12.608633 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f65420-b021-4ca6-8627-094341eb9076 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:12.608910 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f65420-b021-4ca6-8627-094341eb9076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:12.636078 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-35f65420-b021-4ca6-8627-094341eb9076 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:12.637674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-35f65420-b021-4ca6-8627-094341eb9076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:12.685473 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e079a-4433-465b-8022-d342f002a67a admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:12.692231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9c8ef-0837-4bf4-bf88-fe3ebf5260b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:12.693314 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9c8ef-0837-4bf4-bf88-fe3ebf5260b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:12.693593 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9c8ef-0837-4bf4-bf88-fe3ebf5260b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:12.694192 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9c8ef-0837-4bf4-bf88-fe3ebf5260b1 admin admin] PATH_INFO: `/v3/projects/1b54860cd08f40ddbc8a6c6973c85085/users/7a32fd410dc44ad384a73f048d903c25/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:12.711855 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9c8ef-0837-4bf4-bf88-fe3ebf5260b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b54860cd08f40ddbc8a6c6973c85085, user_id=7a32fd410dc44ad384a73f048d903c25, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:12.712453 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1404/2776] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:47:12.715274 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9c8ef-0837-4bf4-bf88-fe3ebf5260b1 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:12.721359 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c062ea1-8cc1-4c14-a553-1cf69e315dca None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:12.721676 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c062ea1-8cc1-4c14-a553-1cf69e315dca None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:12.721951 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c062ea1-8cc1-4c14-a553-1cf69e315dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:12.733337 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1373/2777] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:47:12 2022] PUT /identity/v3/projects/1b54860cd08f40ddbc8a6c6973c85085/users/7a32fd410dc44ad384a73f048d903c25/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:12.744262 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026320d-6034-4c74-a2f7-2cf233dc3a1f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:12.744548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026320d-6034-4c74-a2f7-2cf233dc3a1f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:12.744824 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026320d-6034-4c74-a2f7-2cf233dc3a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:12.745681 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-7c062ea1-8cc1-4c14-a553-1cf69e315dca None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:12.747096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7c062ea1-8cc1-4c14-a553-1cf69e315dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:12.775780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-1026320d-6034-4c74-a2f7-2cf233dc3a1f None None] MFA Rules not processed for user `7a32fd410dc44ad384a73f048d903c25`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:12.777224 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1026320d-6034-4c74-a2f7-2cf233dc3a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:12.819092 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1405/2778] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:47:12.823547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c062ea1-8cc1-4c14-a553-1cf69e315dca None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:12.833053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c062ea1-8cc1-4c14-a553-1cf69e315dca None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:12.838849 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6beb0a2-3369-42a6-81f4-e1c4667440f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:12.839680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6beb0a2-3369-42a6-81f4-e1c4667440f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:12.840583 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6beb0a2-3369-42a6-81f4-e1c4667440f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:12.840583 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6beb0a2-3369-42a6-81f4-e1c4667440f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:12.841167 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6beb0a2-3369-42a6-81f4-e1c4667440f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:47:12.841541 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6beb0a2-3369-42a6-81f4-e1c4667440f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:12.843380 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6beb0a2-3369-42a6-81f4-e1c4667440f3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:12.861365 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1406/2779] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:47:12.861919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1374/2780] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:12.863002 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6beb0a2-3369-42a6-81f4-e1c4667440f3 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:12.874514 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6beb0a2-3369-42a6-81f4-e1c4667440f3 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:12.877039 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026320d-6034-4c74-a2f7-2cf233dc3a1f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:12.878666 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1026320d-6034-4c74-a2f7-2cf233dc3a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:12.880806 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578de39-5e85-448c-8777-8ffd31e3dae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:12.881486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578de39-5e85-448c-8777-8ffd31e3dae6 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:12.881746 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578de39-5e85-448c-8777-8ffd31e3dae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:12.882013 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578de39-5e85-448c-8777-8ffd31e3dae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:12.882755 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578de39-5e85-448c-8777-8ffd31e3dae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:12.885191 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578de39-5e85-448c-8777-8ffd31e3dae6 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:12.890053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:12.920823 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1407/2781] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:47:12 2022] POST /identity/v3/projects => generated 397 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:47:12.922556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578de39-5e85-448c-8777-8ffd31e3dae6 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:12.924506 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1578de39-5e85-448c-8777-8ffd31e3dae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:12.975027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026320d-6034-4c74-a2f7-2cf233dc3a1f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:12.980072 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:12.995813 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578de39-5e85-448c-8777-8ffd31e3dae6 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:13.000449 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd96046-c7f5-4d4b-92bf-01582aaea0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:13.001327 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd96046-c7f5-4d4b-92bf-01582aaea0ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:13.001601 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd96046-c7f5-4d4b-92bf-01582aaea0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:13.001871 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd96046-c7f5-4d4b-92bf-01582aaea0ec admin admin] PATH_INFO: `/v3/projects/0ac50b3b3c43461bbb3224b405f9525d` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:13.003364 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd96046-c7f5-4d4b-92bf-01582aaea0ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ac50b3b3c43461bbb3224b405f9525d)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:13.005257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd96046-c7f5-4d4b-92bf-01582aaea0ec admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:13.028119 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9bba1-f8a6-4c95-a5ea-b14ba7379cf5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22df4e0d98e34758963d3b1465a3a377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:13.029035 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9bba1-f8a6-4c95-a5ea-b14ba7379cf5 service glance] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:13.029171 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9bba1-f8a6-4c95-a5ea-b14ba7379cf5 service glance] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:13.029344 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9bba1-f8a6-4c95-a5ea-b14ba7379cf5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:13.054499 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6cd96046-c7f5-4d4b-92bf-01582aaea0ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ac50b3b3c43461bbb3224b405f9525d', 'request_id': 'req-6cd96046-c7f5-4d4b-92bf-01582aaea0ec'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:13.061606 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6cd96046-c7f5-4d4b-92bf-01582aaea0ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ac50b3b3c43461bbb3224b405f9525d', 'request_id': 'req-6cd96046-c7f5-4d4b-92bf-01582aaea0ec'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:13.068089 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6cd96046-c7f5-4d4b-92bf-01582aaea0ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ac50b3b3c43461bbb3224b405f9525d', 'request_id': 'req-6cd96046-c7f5-4d4b-92bf-01582aaea0ec'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:13.082205 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6cd96046-c7f5-4d4b-92bf-01582aaea0ec admin admin] The token cache is being invalidate because project 0ac50b3b3c43461bbb3224b405f9525d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:47:13.082413 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6cd96046-c7f5-4d4b-92bf-01582aaea0ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:13.083163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6cd96046-c7f5-4d4b-92bf-01582aaea0ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:13.084761 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1408/2782] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:47:12 2022] DELETE /identity/v3/projects/0ac50b3b3c43461bbb3224b405f9525d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:13.085499 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd96046-c7f5-4d4b-92bf-01582aaea0ec admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:13.086817 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6cd96046-c7f5-4d4b-92bf-01582aaea0ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:13.090815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9bba1-f8a6-4c95-a5ea-b14ba7379cf5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:13.092275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9bba1-f8a6-4c95-a5ea-b14ba7379cf5 service glance] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:13.101615 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1375/2783] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:12 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:47:13.103264 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3231b7-1c2a-42ac-9932-bcf139d76a19 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:13.103403 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3231b7-1c2a-42ac-9932-bcf139d76a19 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:13.103645 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3231b7-1c2a-42ac-9932-bcf139d76a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:13.126815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-2f3231b7-1c2a-42ac-9932-bcf139d76a19 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:13.126815 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2f3231b7-1c2a-42ac-9932-bcf139d76a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:13.153252 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd96046-c7f5-4d4b-92bf-01582aaea0ec admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:13.158418 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a1394-f452-4212-bca8-479c938661ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:13.159153 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a1394-f452-4212-bca8-479c938661ef admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:13.159456 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a1394-f452-4212-bca8-479c938661ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:13.159723 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a1394-f452-4212-bca8-479c938661ef admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:13.160399 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a1394-f452-4212-bca8-479c938661ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:13.163771 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a1394-f452-4212-bca8-479c938661ef admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:13.189421 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1409/2784] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:47:13 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:47:13.190525 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a1394-f452-4212-bca8-479c938661ef admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:13.193096 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1376/2785] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:13.201063 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a1394-f452-4212-bca8-479c938661ef admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:13.201375 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7d8be-1717-4e05-82ad-2ccaaaff9371 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:13.201760 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7d8be-1717-4e05-82ad-2ccaaaff9371 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:13.202125 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7d8be-1717-4e05-82ad-2ccaaaff9371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:13.205855 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520cb90-ef4a-4b41-9829-74a4b3573e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:13.206399 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520cb90-ef4a-4b41-9829-74a4b3573e98 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:13.206711 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520cb90-ef4a-4b41-9829-74a4b3573e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:13.206979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520cb90-ef4a-4b41-9829-74a4b3573e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:13.207704 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520cb90-ef4a-4b41-9829-74a4b3573e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:13.209307 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520cb90-ef4a-4b41-9829-74a4b3573e98 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:13.211181 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:13.226522 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-dcc7d8be-1717-4e05-82ad-2ccaaaff9371 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:13.227796 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1410/2786] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:47:13.229227 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520cb90-ef4a-4b41-9829-74a4b3573e98 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:13.231170 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-dcc7d8be-1717-4e05-82ad-2ccaaaff9371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:13.239828 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1377/2787] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:13.246389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520cb90-ef4a-4b41-9829-74a4b3573e98 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:13.246879 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7d8be-1717-4e05-82ad-2ccaaaff9371 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:13.251009 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca886d1-ed5c-47a3-9720-e94c5e5427d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:13.251680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca886d1-ed5c-47a3-9720-e94c5e5427d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:13.251952 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca886d1-ed5c-47a3-9720-e94c5e5427d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:13.252245 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca886d1-ed5c-47a3-9720-e94c5e5427d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:13.253136 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca886d1-ed5c-47a3-9720-e94c5e5427d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:13.254756 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca886d1-ed5c-47a3-9720-e94c5e5427d5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:13.257045 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7d8be-1717-4e05-82ad-2ccaaaff9371 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:13.262394 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c401686-51ff-4009-9523-e5fc2be8964a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:13.263088 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c401686-51ff-4009-9523-e5fc2be8964a admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:13.263482 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c401686-51ff-4009-9523-e5fc2be8964a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:13.263955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c401686-51ff-4009-9523-e5fc2be8964a admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:13.264658 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c401686-51ff-4009-9523-e5fc2be8964a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:47:13.264960 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c401686-51ff-4009-9523-e5fc2be8964a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:13.266527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c401686-51ff-4009-9523-e5fc2be8964a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:13.270923 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1411/2788] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:47:13.275284 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca886d1-ed5c-47a3-9720-e94c5e5427d5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:13.282100 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1378/2789] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:47:13.286137 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c401686-51ff-4009-9523-e5fc2be8964a admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:13.292396 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca886d1-ed5c-47a3-9720-e94c5e5427d5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:13.297346 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c401686-51ff-4009-9523-e5fc2be8964a admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:13.298099 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133a4c0-cb73-4983-81f3-039ca65c501b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:13.299403 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133a4c0-cb73-4983-81f3-039ca65c501b admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:13.299729 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133a4c0-cb73-4983-81f3-039ca65c501b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:13.300006 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133a4c0-cb73-4983-81f3-039ca65c501b admin admin] PATH_INFO: `/v3/projects/1383844c2ebd44c2827a32c9249621d6/users/c9a761f34ae1469a87159cb62d2cb436/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:13.302912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaee4b9-8614-4cb0-b1b5-42a8fdbef333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:13.304099 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaee4b9-8614-4cb0-b1b5-42a8fdbef333 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:13.304099 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaee4b9-8614-4cb0-b1b5-42a8fdbef333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:13.304320 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaee4b9-8614-4cb0-b1b5-42a8fdbef333 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:13.305034 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaee4b9-8614-4cb0-b1b5-42a8fdbef333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:13.307170 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaee4b9-8614-4cb0-b1b5-42a8fdbef333 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:13.317166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133a4c0-cb73-4983-81f3-039ca65c501b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1383844c2ebd44c2827a32c9249621d6, user_id=c9a761f34ae1469a87159cb62d2cb436, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:13.319826 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133a4c0-cb73-4983-81f3-039ca65c501b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:13.339309 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1412/2790] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:47:13 2022] PUT /identity/v3/projects/1383844c2ebd44c2827a32c9249621d6/users/c9a761f34ae1469a87159cb62d2cb436/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:13.340090 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1379/2791] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:47:13 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:47:13.341078 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133a4c0-cb73-4983-81f3-039ca65c501b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:13.349930 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c46507-0147-4243-b6d1-046d8cc32af7 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:13.350210 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c46507-0147-4243-b6d1-046d8cc32af7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:13.350483 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c46507-0147-4243-b6d1-046d8cc32af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:13.380614 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-18c46507-0147-4243-b6d1-046d8cc32af7 None None] MFA Rules not processed for user `c9a761f34ae1469a87159cb62d2cb436`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:13.381931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-18c46507-0147-4243-b6d1-046d8cc32af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:13.394439 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:13.414869 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133a4c0-cb73-4983-81f3-039ca65c501b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:13.462271 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1380/2792] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:47:13.475467 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c46507-0147-4243-b6d1-046d8cc32af7 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:13.477520 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-18c46507-0147-4243-b6d1-046d8cc32af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:13.483135 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529d468-52be-4aeb-9593-34bb56d7abee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:13.484450 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529d468-52be-4aeb-9593-34bb56d7abee admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:13.485001 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529d468-52be-4aeb-9593-34bb56d7abee admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:13.485322 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529d468-52be-4aeb-9593-34bb56d7abee admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:13.486038 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529d468-52be-4aeb-9593-34bb56d7abee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:13.488106 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529d468-52be-4aeb-9593-34bb56d7abee admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:13.510556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1413/2793] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:47:13 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:47:13.515126 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529d468-52be-4aeb-9593-34bb56d7abee admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:13.527645 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529d468-52be-4aeb-9593-34bb56d7abee admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:13.533705 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e70aaa-f9bf-42a2-9293-357cb607ea7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:13.534427 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e70aaa-f9bf-42a2-9293-357cb607ea7c admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:13.534642 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e70aaa-f9bf-42a2-9293-357cb607ea7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:13.534895 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e70aaa-f9bf-42a2-9293-357cb607ea7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:13.535631 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e70aaa-f9bf-42a2-9293-357cb607ea7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:13.537233 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e70aaa-f9bf-42a2-9293-357cb607ea7c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:13.546548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c46507-0147-4243-b6d1-046d8cc32af7 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:13.548242 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1414/2794] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:47:13.551986 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e70aaa-f9bf-42a2-9293-357cb607ea7c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:13.553243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d92280-afdf-4869-8e29-5d45e2905244 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:13.554010 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d92280-afdf-4869-8e29-5d45e2905244 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:13.554464 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d92280-afdf-4869-8e29-5d45e2905244 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:13.554924 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d92280-afdf-4869-8e29-5d45e2905244 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:13.567811 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d92280-afdf-4869-8e29-5d45e2905244 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:13.568672 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e70aaa-f9bf-42a2-9293-357cb607ea7c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:13.569986 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d92280-afdf-4869-8e29-5d45e2905244 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:13.574982 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe7fae-e29f-4817-bce6-48e535f2a9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:13.577564 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe7fae-e29f-4817-bce6-48e535f2a9ec admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:13.578011 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe7fae-e29f-4817-bce6-48e535f2a9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:13.578455 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe7fae-e29f-4817-bce6-48e535f2a9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:13.579373 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe7fae-e29f-4817-bce6-48e535f2a9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:13.581095 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1381/2795] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:47:13.581573 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe7fae-e29f-4817-bce6-48e535f2a9ec admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:13.595508 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1415/2796] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:47:13.599204 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d92280-afdf-4869-8e29-5d45e2905244 service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:13.612718 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d92280-afdf-4869-8e29-5d45e2905244 service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:13.617723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86308c-622d-4e91-b461-a1446e62ff49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:13.618530 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86308c-622d-4e91-b461-a1446e62ff49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:13.618950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86308c-622d-4e91-b461-a1446e62ff49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:13.619094 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86308c-622d-4e91-b461-a1446e62ff49 admin admin] PATH_INFO: `/v3/projects/8902f0d19a4c4dc4884ec452da55ea93/users/367df4b7d56b4aeca492a3b3798c2681/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:13.637042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86308c-622d-4e91-b461-a1446e62ff49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8902f0d19a4c4dc4884ec452da55ea93, user_id=367df4b7d56b4aeca492a3b3798c2681, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:13.642048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86308c-622d-4e91-b461-a1446e62ff49 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:13.665063 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1382/2797] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:47:13 2022] PUT /identity/v3/projects/8902f0d19a4c4dc4884ec452da55ea93/users/367df4b7d56b4aeca492a3b3798c2681/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:13.671596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969557ee-973e-4ad7-924f-ccc7963cf940 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:13.671883 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969557ee-973e-4ad7-924f-ccc7963cf940 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:13.672152 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969557ee-973e-4ad7-924f-ccc7963cf940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:13.703247 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-969557ee-973e-4ad7-924f-ccc7963cf940 None None] MFA Rules not processed for user `367df4b7d56b4aeca492a3b3798c2681`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:13.704662 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-969557ee-973e-4ad7-924f-ccc7963cf940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:13.736208 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:13.777900 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1416/2798] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:13.782411 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86308c-622d-4e91-b461-a1446e62ff49 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:13.852350 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86308c-622d-4e91-b461-a1446e62ff49 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:13.857890 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a3c8e-11db-4c27-9562-ed15440b1a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:13.858561 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a3c8e-11db-4c27-9562-ed15440b1a36 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:13.858869 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a3c8e-11db-4c27-9562-ed15440b1a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:13.859207 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a3c8e-11db-4c27-9562-ed15440b1a36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:13.859842 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a3c8e-11db-4c27-9562-ed15440b1a36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:13.861887 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a3c8e-11db-4c27-9562-ed15440b1a36 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:13.890881 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1383/2799] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:47:13 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:47:13.894783 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969557ee-973e-4ad7-924f-ccc7963cf940 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:13.908416 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969557ee-973e-4ad7-924f-ccc7963cf940 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:13.968169 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c699a9e-7a0e-415a-a41b-15b5229795f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:13.968759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c699a9e-7a0e-415a-a41b-15b5229795f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:13.969038 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c699a9e-7a0e-415a-a41b-15b5229795f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:13.969319 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c699a9e-7a0e-415a-a41b-15b5229795f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:13.969996 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c699a9e-7a0e-415a-a41b-15b5229795f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:13.971921 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c699a9e-7a0e-415a-a41b-15b5229795f2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:14.010158 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a3c8e-11db-4c27-9562-ed15440b1a36 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:14.018773 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1417/2800] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:47:13 2022] POST /identity/v3/users => generated 298 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:47:14.025612 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a3c8e-11db-4c27-9562-ed15440b1a36 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:14.033231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0c21c-4414-42a0-9dd6-23cbc731d487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:14.034053 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0c21c-4414-42a0-9dd6-23cbc731d487 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:14.034589 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0c21c-4414-42a0-9dd6-23cbc731d487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:14.035075 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0c21c-4414-42a0-9dd6-23cbc731d487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:14.036232 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0c21c-4414-42a0-9dd6-23cbc731d487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:14.038691 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0c21c-4414-42a0-9dd6-23cbc731d487 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:14.064275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1384/2801] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:47:14.068992 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c699a9e-7a0e-415a-a41b-15b5229795f2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:14.082939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c699a9e-7a0e-415a-a41b-15b5229795f2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:14.091491 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d6be0-ff73-4186-b3f5-3839be4a2066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:14.092549 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d6be0-ff73-4186-b3f5-3839be4a2066 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:14.092941 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d6be0-ff73-4186-b3f5-3839be4a2066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:14.093257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d6be0-ff73-4186-b3f5-3839be4a2066 admin admin] PATH_INFO: `/v3/projects/d5d741d232cc44509986fd4cd8f892ee/users/94407b90fc1d481398d5bad016daa017/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:14.111413 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d6be0-ff73-4186-b3f5-3839be4a2066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d741d232cc44509986fd4cd8f892ee, user_id=94407b90fc1d481398d5bad016daa017, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:14.114691 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d6be0-ff73-4186-b3f5-3839be4a2066 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:14.130545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1418/2802] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:47:14 2022] PUT /identity/v3/projects/d5d741d232cc44509986fd4cd8f892ee/users/94407b90fc1d481398d5bad016daa017/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:47:14.135208 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0c21c-4414-42a0-9dd6-23cbc731d487 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:14.142139 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:14.146133 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0c21c-4414-42a0-9dd6-23cbc731d487 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:14.208338 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3081c-fe30-4524-95df-1a446dc2fb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:14.209012 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3081c-fe30-4524-95df-1a446dc2fb88 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:14.209313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3081c-fe30-4524-95df-1a446dc2fb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:14.209573 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3081c-fe30-4524-95df-1a446dc2fb88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:14.210300 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3081c-fe30-4524-95df-1a446dc2fb88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:14.211911 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3081c-fe30-4524-95df-1a446dc2fb88 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:14.222377 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1385/2803] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:47:14.226811 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d6be0-ff73-4186-b3f5-3839be4a2066 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:14.237718 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d6be0-ff73-4186-b3f5-3839be4a2066 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:14.242470 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145615b6-c598-4539-ad29-408e050ae567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:14.243394 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145615b6-c598-4539-ad29-408e050ae567 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:14.243677 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145615b6-c598-4539-ad29-408e050ae567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:14.243948 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145615b6-c598-4539-ad29-408e050ae567 admin admin] PATH_INFO: `/v3/projects/d5d741d232cc44509986fd4cd8f892ee/users/94407b90fc1d481398d5bad016daa017/roles/6edd584a77084fa78240661ea76cddb5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:14.246026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145615b6-c598-4539-ad29-408e050ae567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d741d232cc44509986fd4cd8f892ee, user_id=94407b90fc1d481398d5bad016daa017, role_id=6edd584a77084fa78240661ea76cddb5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:14.248705 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145615b6-c598-4539-ad29-408e050ae567 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:14.258944 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1419/2804] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:47:14 2022] PUT /identity/v3/projects/d5d741d232cc44509986fd4cd8f892ee/users/94407b90fc1d481398d5bad016daa017/roles/6edd584a77084fa78240661ea76cddb5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:14.271620 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3f2f5-847d-440e-9472-7701e1472a44 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:14.271987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3f2f5-847d-440e-9472-7701e1472a44 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:14.272367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3f2f5-847d-440e-9472-7701e1472a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:14.302021 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-cda3f2f5-847d-440e-9472-7701e1472a44 None None] MFA Rules not processed for user `94407b90fc1d481398d5bad016daa017`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:14.303248 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-cda3f2f5-847d-440e-9472-7701e1472a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:14.390243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1386/2805] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:14.407486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145615b6-c598-4539-ad29-408e050ae567 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:14.410096 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-145615b6-c598-4539-ad29-408e050ae567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:14.474166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145615b6-c598-4539-ad29-408e050ae567 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:14.478540 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e829e-b34c-47a4-b332-ed32cee65904 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:14.479263 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e829e-b34c-47a4-b332-ed32cee65904 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:14.479575 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e829e-b34c-47a4-b332-ed32cee65904 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:14.479966 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e829e-b34c-47a4-b332-ed32cee65904 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:14.490192 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e829e-b34c-47a4-b332-ed32cee65904 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:14.491680 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e829e-b34c-47a4-b332-ed32cee65904 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:14.501965 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1420/2806] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:14.604565 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3f2f5-847d-440e-9472-7701e1472a44 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:14.615644 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3f2f5-847d-440e-9472-7701e1472a44 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:14.619780 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485bd150-8f25-475b-bd9e-efbbc14cf7cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:14.620435 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bd150-8f25-475b-bd9e-efbbc14cf7cc service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:14.620733 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bd150-8f25-475b-bd9e-efbbc14cf7cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:14.621132 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bd150-8f25-475b-bd9e-efbbc14cf7cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:14.695778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485bd150-8f25-475b-bd9e-efbbc14cf7cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:14.697212 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485bd150-8f25-475b-bd9e-efbbc14cf7cc service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:14.706521 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1387/2807] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:17.355947 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e829e-b34c-47a4-b332-ed32cee65904 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:17.379488 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:17.428306 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e829e-b34c-47a4-b332-ed32cee65904 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:17.436453 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433f731-2e47-40a7-b733-811485572285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:17.437773 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433f731-2e47-40a7-b733-811485572285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:17.438076 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433f731-2e47-40a7-b733-811485572285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:17.438346 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433f731-2e47-40a7-b733-811485572285 admin admin] PATH_INFO: `/v3/users/367df4b7d56b4aeca492a3b3798c2681` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:17.440361 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433f731-2e47-40a7-b733-811485572285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=367df4b7d56b4aeca492a3b3798c2681)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:17.443042 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433f731-2e47-40a7-b733-811485572285 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:17.495884 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b433f731-2e47-40a7-b733-811485572285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '367df4b7d56b4aeca492a3b3798c2681'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:17.505588 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b433f731-2e47-40a7-b733-811485572285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '367df4b7d56b4aeca492a3b3798c2681'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:17.506287 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b433f731-2e47-40a7-b733-811485572285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '367df4b7d56b4aeca492a3b3798c2681'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:17.521306 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b433f731-2e47-40a7-b733-811485572285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '367df4b7d56b4aeca492a3b3798c2681'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:17.522203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b433f731-2e47-40a7-b733-811485572285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '367df4b7d56b4aeca492a3b3798c2681'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:17.537607 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1421/2808] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:47:17 2022] DELETE /identity/v3/users/367df4b7d56b4aeca492a3b3798c2681 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:17.542759 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7aec89-2296-449f-836c-0a644dc55e1b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:17.543272 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7aec89-2296-449f-836c-0a644dc55e1b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:17.543372 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7aec89-2296-449f-836c-0a644dc55e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:17.563924 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-2f7aec89-2296-449f-836c-0a644dc55e1b None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:17.565310 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2f7aec89-2296-449f-836c-0a644dc55e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:17.585610 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:17.631101 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1388/2809] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:17.642816 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433f731-2e47-40a7-b733-811485572285 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:17.644262 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b433f731-2e47-40a7-b733-811485572285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:17.706561 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433f731-2e47-40a7-b733-811485572285 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:17.710442 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561285c-f9d5-48a8-a832-cc7a63e27d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:17.711131 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561285c-f9d5-48a8-a832-cc7a63e27d0a service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:17.711411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561285c-f9d5-48a8-a832-cc7a63e27d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:17.711683 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561285c-f9d5-48a8-a832-cc7a63e27d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:17.720990 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561285c-f9d5-48a8-a832-cc7a63e27d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:17.722430 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561285c-f9d5-48a8-a832-cc7a63e27d0a service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:17.732641 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1422/2810] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:18.029046 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7aec89-2296-449f-836c-0a644dc55e1b None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:18.030755 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2f7aec89-2296-449f-836c-0a644dc55e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:18.043226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7aec89-2296-449f-836c-0a644dc55e1b None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:18.050117 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5a7a0-a3ba-4959-b1f3-842045f65928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:18.051193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5a7a0-a3ba-4959-b1f3-842045f65928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:18.051506 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5a7a0-a3ba-4959-b1f3-842045f65928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:18.051773 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5a7a0-a3ba-4959-b1f3-842045f65928 admin admin] PATH_INFO: `/v3/projects/8902f0d19a4c4dc4884ec452da55ea93` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:18.053118 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5a7a0-a3ba-4959-b1f3-842045f65928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8902f0d19a4c4dc4884ec452da55ea93)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:18.055223 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5a7a0-a3ba-4959-b1f3-842045f65928 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:18.104848 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-23d5a7a0-a3ba-4959-b1f3-842045f65928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8902f0d19a4c4dc4884ec452da55ea93', 'request_id': 'req-23d5a7a0-a3ba-4959-b1f3-842045f65928'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:18.110849 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-23d5a7a0-a3ba-4959-b1f3-842045f65928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8902f0d19a4c4dc4884ec452da55ea93', 'request_id': 'req-23d5a7a0-a3ba-4959-b1f3-842045f65928'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:18.117001 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-23d5a7a0-a3ba-4959-b1f3-842045f65928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8902f0d19a4c4dc4884ec452da55ea93', 'request_id': 'req-23d5a7a0-a3ba-4959-b1f3-842045f65928'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:18.133353 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-23d5a7a0-a3ba-4959-b1f3-842045f65928 admin admin] The token cache is being invalidate because project 8902f0d19a4c4dc4884ec452da55ea93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:47:18.133599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-23d5a7a0-a3ba-4959-b1f3-842045f65928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:18.134661 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-23d5a7a0-a3ba-4959-b1f3-842045f65928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:18.136189 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1389/2811] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:47:18 2022] DELETE /identity/v3/projects/8902f0d19a4c4dc4884ec452da55ea93 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:18.140514 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561285c-f9d5-48a8-a832-cc7a63e27d0a service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:18.150860 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561285c-f9d5-48a8-a832-cc7a63e27d0a service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:18.195446 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:18.214847 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28feeab0-5d13-4a52-b31a-06ed00b37437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:18.215887 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feeab0-5d13-4a52-b31a-06ed00b37437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:18.216194 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feeab0-5d13-4a52-b31a-06ed00b37437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:18.216476 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feeab0-5d13-4a52-b31a-06ed00b37437 admin admin] PATH_INFO: `/v3/users/94407b90fc1d481398d5bad016daa017` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:18.218055 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28feeab0-5d13-4a52-b31a-06ed00b37437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94407b90fc1d481398d5bad016daa017)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:18.220262 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28feeab0-5d13-4a52-b31a-06ed00b37437 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:18.272413 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-28feeab0-5d13-4a52-b31a-06ed00b37437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94407b90fc1d481398d5bad016daa017'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:18.281098 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-28feeab0-5d13-4a52-b31a-06ed00b37437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94407b90fc1d481398d5bad016daa017'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:18.281777 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-28feeab0-5d13-4a52-b31a-06ed00b37437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94407b90fc1d481398d5bad016daa017'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:18.295639 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-28feeab0-5d13-4a52-b31a-06ed00b37437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94407b90fc1d481398d5bad016daa017'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:18.296411 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-28feeab0-5d13-4a52-b31a-06ed00b37437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94407b90fc1d481398d5bad016daa017'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:18.313300 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1423/2812] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:47:18 2022] DELETE /identity/v3/users/94407b90fc1d481398d5bad016daa017 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:18.620360 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5a7a0-a3ba-4959-b1f3-842045f65928 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:18.621839 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-23d5a7a0-a3ba-4959-b1f3-842045f65928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:18.644054 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28feeab0-5d13-4a52-b31a-06ed00b37437 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:18.645820 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-28feeab0-5d13-4a52-b31a-06ed00b37437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:18.649700 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5a7a0-a3ba-4959-b1f3-842045f65928 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:18.709225 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8d011-b109-44e8-a21f-908b383bdc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:18.710538 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8d011-b109-44e8-a21f-908b383bdc32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:18.710932 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8d011-b109-44e8-a21f-908b383bdc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:18.711209 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8d011-b109-44e8-a21f-908b383bdc32 admin admin] PATH_INFO: `/v3/projects/d5d741d232cc44509986fd4cd8f892ee` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:18.712401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8d011-b109-44e8-a21f-908b383bdc32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d741d232cc44509986fd4cd8f892ee)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:18.714313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8d011-b109-44e8-a21f-908b383bdc32 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:18.725566 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28feeab0-5d13-4a52-b31a-06ed00b37437 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:18.730353 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedf8cc-a155-4410-85d7-cee7ee5c342c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:18.731529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedf8cc-a155-4410-85d7-cee7ee5c342c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:18.731807 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedf8cc-a155-4410-85d7-cee7ee5c342c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:18.732126 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedf8cc-a155-4410-85d7-cee7ee5c342c admin admin] PATH_INFO: `/v3/users/c9a761f34ae1469a87159cb62d2cb436` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:18.733600 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedf8cc-a155-4410-85d7-cee7ee5c342c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9a761f34ae1469a87159cb62d2cb436)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:18.735644 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedf8cc-a155-4410-85d7-cee7ee5c342c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:18.765276 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-17a8d011-b109-44e8-a21f-908b383bdc32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d741d232cc44509986fd4cd8f892ee', 'request_id': 'req-17a8d011-b109-44e8-a21f-908b383bdc32'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:18.767074 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:18.775949 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-17a8d011-b109-44e8-a21f-908b383bdc32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d741d232cc44509986fd4cd8f892ee', 'request_id': 'req-17a8d011-b109-44e8-a21f-908b383bdc32'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:18.783364 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-17a8d011-b109-44e8-a21f-908b383bdc32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d741d232cc44509986fd4cd8f892ee', 'request_id': 'req-17a8d011-b109-44e8-a21f-908b383bdc32'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:18.800237 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8bedf8cc-a155-4410-85d7-cee7ee5c342c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9a761f34ae1469a87159cb62d2cb436'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:18.809162 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8bedf8cc-a155-4410-85d7-cee7ee5c342c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9a761f34ae1469a87159cb62d2cb436'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:18.810255 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-17a8d011-b109-44e8-a21f-908b383bdc32 admin admin] The token cache is being invalidate because project d5d741d232cc44509986fd4cd8f892ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:47:18.810441 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8bedf8cc-a155-4410-85d7-cee7ee5c342c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9a761f34ae1469a87159cb62d2cb436'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:18.810620 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-17a8d011-b109-44e8-a21f-908b383bdc32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:18.811282 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-17a8d011-b109-44e8-a21f-908b383bdc32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:18.813358 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1390/2813] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:47:18 2022] DELETE /identity/v3/projects/d5d741d232cc44509986fd4cd8f892ee => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:18.818158 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:18.818297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4dcea-9047-44be-8de4-d42ffa04547b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:18.818827 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4dcea-9047-44be-8de4-d42ffa04547b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:18.818827 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4dcea-9047-44be-8de4-d42ffa04547b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:18.824815 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8bedf8cc-a155-4410-85d7-cee7ee5c342c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9a761f34ae1469a87159cb62d2cb436'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:18.825913 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8bedf8cc-a155-4410-85d7-cee7ee5c342c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9a761f34ae1469a87159cb62d2cb436'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:18.838775 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-5bd4dcea-9047-44be-8de4-d42ffa04547b None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:18.839987 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5bd4dcea-9047-44be-8de4-d42ffa04547b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:18.841166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1424/2814] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:47:18 2022] DELETE /identity/v3/users/c9a761f34ae1469a87159cb62d2cb436 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:47:18.845699 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc04d29-d800-467b-bd77-1a68e9cffc06 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:18.846060 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc04d29-d800-467b-bd77-1a68e9cffc06 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:18.846378 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc04d29-d800-467b-bd77-1a68e9cffc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:18.866084 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-7cc04d29-d800-467b-bd77-1a68e9cffc06 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:18.867373 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7cc04d29-d800-467b-bd77-1a68e9cffc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:18.921413 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1391/2815] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:18.929452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4444e-b501-41a7-8f5b-3828caf9ba2c None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:18.929724 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4444e-b501-41a7-8f5b-3828caf9ba2c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:18.930000 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4444e-b501-41a7-8f5b-3828caf9ba2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:18.937599 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1425/2816] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:18.947471 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc04d29-d800-467b-bd77-1a68e9cffc06 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:18.948363 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-82c4444e-b501-41a7-8f5b-3828caf9ba2c None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:18.948931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7cc04d29-d800-467b-bd77-1a68e9cffc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:18.949555 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-82c4444e-b501-41a7-8f5b-3828caf9ba2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:18.959508 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1392/2817] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:47:18.964423 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4444e-b501-41a7-8f5b-3828caf9ba2c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:18.974409 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4444e-b501-41a7-8f5b-3828caf9ba2c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:18.980014 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0072b2-da48-45b3-8758-b080b8134ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:18.980692 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0072b2-da48-45b3-8758-b080b8134ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:18.980973 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0072b2-da48-45b3-8758-b080b8134ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:18.981242 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0072b2-da48-45b3-8758-b080b8134ba1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:18.981980 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0072b2-da48-45b3-8758-b080b8134ba1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:47:18.982280 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0072b2-da48-45b3-8758-b080b8134ba1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:18.984174 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0072b2-da48-45b3-8758-b080b8134ba1 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:19.000576 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1393/2818] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:47:19.001640 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0072b2-da48-45b3-8758-b080b8134ba1 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:19.012039 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0072b2-da48-45b3-8758-b080b8134ba1 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:19.013252 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc04d29-d800-467b-bd77-1a68e9cffc06 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:19.016992 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e04a1e-6b26-4d0d-9c41-d1751f46093a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:19.017311 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff276e1-4275-4086-a6c5-4a7233650461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:19.017652 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e04a1e-6b26-4d0d-9c41-d1751f46093a admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:19.017941 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e04a1e-6b26-4d0d-9c41-d1751f46093a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:19.018064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff276e1-4275-4086-a6c5-4a7233650461 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:19.018222 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e04a1e-6b26-4d0d-9c41-d1751f46093a admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:19.018374 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff276e1-4275-4086-a6c5-4a7233650461 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:19.018635 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff276e1-4275-4086-a6c5-4a7233650461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:19.018941 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e04a1e-6b26-4d0d-9c41-d1751f46093a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:19.020834 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e04a1e-6b26-4d0d-9c41-d1751f46093a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:19.027707 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff276e1-4275-4086-a6c5-4a7233650461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:19.029783 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff276e1-4275-4086-a6c5-4a7233650461 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:19.040449 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1426/2819] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:19.053131 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1394/2820] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:47:19 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:47:19.055722 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff276e1-4275-4086-a6c5-4a7233650461 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:19.068017 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff276e1-4275-4086-a6c5-4a7233650461 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:19.132657 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b92b96-a5e0-4bcf-b5d6-9b7d4ec358ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:19.133333 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b92b96-a5e0-4bcf-b5d6-9b7d4ec358ee admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:19.133616 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b92b96-a5e0-4bcf-b5d6-9b7d4ec358ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:19.134226 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b92b96-a5e0-4bcf-b5d6-9b7d4ec358ee admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:19.134976 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b92b96-a5e0-4bcf-b5d6-9b7d4ec358ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:19.136885 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b92b96-a5e0-4bcf-b5d6-9b7d4ec358ee admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:19.168557 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1427/2821] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:47:19 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:47:19.169860 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e04a1e-6b26-4d0d-9c41-d1751f46093a admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:19.180809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e04a1e-6b26-4d0d-9c41-d1751f46093a admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:19.186123 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64d70e-9cd9-4a62-b0c0-0d881baa80d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:19.186935 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64d70e-9cd9-4a62-b0c0-0d881baa80d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:19.187220 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64d70e-9cd9-4a62-b0c0-0d881baa80d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:19.187490 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64d70e-9cd9-4a62-b0c0-0d881baa80d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:19.188211 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64d70e-9cd9-4a62-b0c0-0d881baa80d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:19.189838 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64d70e-9cd9-4a62-b0c0-0d881baa80d6 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:19.203697 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1395/2822] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:47:19.206609 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b92b96-a5e0-4bcf-b5d6-9b7d4ec358ee admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:19.218004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b92b96-a5e0-4bcf-b5d6-9b7d4ec358ee admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:19.223319 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65ee70-5ae6-46a3-b53e-36536ba67289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:19.224061 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65ee70-5ae6-46a3-b53e-36536ba67289 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:19.224406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65ee70-5ae6-46a3-b53e-36536ba67289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:19.224761 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65ee70-5ae6-46a3-b53e-36536ba67289 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:19.225609 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65ee70-5ae6-46a3-b53e-36536ba67289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:19.227358 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65ee70-5ae6-46a3-b53e-36536ba67289 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:19.239888 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1428/2823] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:47:19.246239 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64d70e-9cd9-4a62-b0c0-0d881baa80d6 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:19.256783 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64d70e-9cd9-4a62-b0c0-0d881baa80d6 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:19.261948 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a4fd5-c147-4772-9a24-a476dfee3d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:19.262878 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a4fd5-c147-4772-9a24-a476dfee3d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:19.263156 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a4fd5-c147-4772-9a24-a476dfee3d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:19.263429 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a4fd5-c147-4772-9a24-a476dfee3d87 admin admin] PATH_INFO: `/v3/projects/512e5f49ccf9467c85713affc037c6be/users/f707513cbc1940d4b259002bd6e4e3a6/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:19.279289 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a4fd5-c147-4772-9a24-a476dfee3d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=512e5f49ccf9467c85713affc037c6be, user_id=f707513cbc1940d4b259002bd6e4e3a6, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:19.282169 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a4fd5-c147-4772-9a24-a476dfee3d87 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:19.296281 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1396/2824] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:47:19 2022] PUT /identity/v3/projects/512e5f49ccf9467c85713affc037c6be/users/f707513cbc1940d4b259002bd6e4e3a6/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:19.301554 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bf3a1-3ed4-4c74-9e3e-113baf20a830 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:19.301979 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bf3a1-3ed4-4c74-9e3e-113baf20a830 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:19.302190 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bf3a1-3ed4-4c74-9e3e-113baf20a830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:19.308066 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:19.323320 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c41bf3a1-3ed4-4c74-9e3e-113baf20a830 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:19.324599 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c41bf3a1-3ed4-4c74-9e3e-113baf20a830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:19.367221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a4fd5-c147-4772-9a24-a476dfee3d87 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:19.369167 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-056a4fd5-c147-4772-9a24-a476dfee3d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:19.400678 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1429/2825] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:47:19.410773 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bf3a1-3ed4-4c74-9e3e-113baf20a830 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:19.449163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a4fd5-c147-4772-9a24-a476dfee3d87 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:19.454009 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883edb66-d9d5-4039-87a2-967d51794291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:19.454930 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883edb66-d9d5-4039-87a2-967d51794291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:19.455225 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883edb66-d9d5-4039-87a2-967d51794291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:19.455499 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883edb66-d9d5-4039-87a2-967d51794291 admin admin] PATH_INFO: `/v3/projects/1383844c2ebd44c2827a32c9249621d6` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:19.456683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883edb66-d9d5-4039-87a2-967d51794291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1383844c2ebd44c2827a32c9249621d6)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:19.458633 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883edb66-d9d5-4039-87a2-967d51794291 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:19.461198 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:19.471839 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bf3a1-3ed4-4c74-9e3e-113baf20a830 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:19.475698 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50055419-1da9-439c-a0db-6d98b4a54c84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:19.476348 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50055419-1da9-439c-a0db-6d98b4a54c84 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:19.476622 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50055419-1da9-439c-a0db-6d98b4a54c84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:19.476896 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50055419-1da9-439c-a0db-6d98b4a54c84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:19.486474 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50055419-1da9-439c-a0db-6d98b4a54c84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:19.487931 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50055419-1da9-439c-a0db-6d98b4a54c84 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:19.498376 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1430/2826] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:47:19.513638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-883edb66-d9d5-4039-87a2-967d51794291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1383844c2ebd44c2827a32c9249621d6', 'request_id': 'req-883edb66-d9d5-4039-87a2-967d51794291'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:19.521461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-883edb66-d9d5-4039-87a2-967d51794291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1383844c2ebd44c2827a32c9249621d6', 'request_id': 'req-883edb66-d9d5-4039-87a2-967d51794291'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:19.528060 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-883edb66-d9d5-4039-87a2-967d51794291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1383844c2ebd44c2827a32c9249621d6', 'request_id': 'req-883edb66-d9d5-4039-87a2-967d51794291'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:19.542490 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-883edb66-d9d5-4039-87a2-967d51794291 admin admin] The token cache is being invalidate because project 1383844c2ebd44c2827a32c9249621d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:47:19.542808 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-883edb66-d9d5-4039-87a2-967d51794291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:19.543466 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-883edb66-d9d5-4039-87a2-967d51794291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:19.545163 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1397/2827] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:47:19 2022] DELETE /identity/v3/projects/1383844c2ebd44c2827a32c9249621d6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:47:20.481860 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472f4d7-0563-41c9-a21e-a4545793b379 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:20.482425 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472f4d7-0563-41c9-a21e-a4545793b379 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:20.482425 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472f4d7-0563-41c9-a21e-a4545793b379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:20.511185 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0472f4d7-0563-41c9-a21e-a4545793b379 None None] MFA Rules not processed for user `f707513cbc1940d4b259002bd6e4e3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:20.512417 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0472f4d7-0563-41c9-a21e-a4545793b379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:20.589036 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1431/2828] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:20.600288 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883edb66-d9d5-4039-87a2-967d51794291 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:20.601689 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-883edb66-d9d5-4039-87a2-967d51794291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:20.674436 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883edb66-d9d5-4039-87a2-967d51794291 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:20.678000 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462ef36-1e15-4fbe-a50f-197b2ba87668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:20.678685 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462ef36-1e15-4fbe-a50f-197b2ba87668 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:20.678961 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462ef36-1e15-4fbe-a50f-197b2ba87668 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:20.679260 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462ef36-1e15-4fbe-a50f-197b2ba87668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:20.687795 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462ef36-1e15-4fbe-a50f-197b2ba87668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:20.689221 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462ef36-1e15-4fbe-a50f-197b2ba87668 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:20.697908 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1398/2829] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:22.090043 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84503e30-36cd-427b-b20c-d618a3926bba None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:22.090660 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84503e30-36cd-427b-b20c-d618a3926bba None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:22.090660 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84503e30-36cd-427b-b20c-d618a3926bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:22.108949 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-84503e30-36cd-427b-b20c-d618a3926bba None None] MFA Rules not processed for user `f707513cbc1940d4b259002bd6e4e3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:22.110345 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-84503e30-36cd-427b-b20c-d618a3926bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:22.117548 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1432/2830] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:30.693920 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=49,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:32.103385 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=87 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:36.253995 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f48d4-e15e-4962-b020-e217014b58d7 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:36.254610 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f48d4-e15e-4962-b020-e217014b58d7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:36.254610 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f48d4-e15e-4962-b020-e217014b58d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:36.277823 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-e46f48d4-e15e-4962-b020-e217014b58d7 None None] MFA Rules not processed for user `f707513cbc1940d4b259002bd6e4e3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:36.279091 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e46f48d4-e15e-4962-b020-e217014b58d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:36.287230 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1399/2831] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:36.552050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84503e30-36cd-427b-b20c-d618a3926bba None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:36.553751 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-84503e30-36cd-427b-b20c-d618a3926bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:36.615379 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84503e30-36cd-427b-b20c-d618a3926bba None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:36.619093 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50833ad-4732-4cd6-93f3-455c79936b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:36.619777 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50833ad-4732-4cd6-93f3-455c79936b3d service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:36.620050 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50833ad-4732-4cd6-93f3-455c79936b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:36.620317 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50833ad-4732-4cd6-93f3-455c79936b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:36.622264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e50833ad-4732-4cd6-93f3-455c79936b3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:36.633198 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50833ad-4732-4cd6-93f3-455c79936b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:36.635046 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50833ad-4732-4cd6-93f3-455c79936b3d service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:36.645062 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1433/2832] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:37.135296 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f48d4-e15e-4962-b020-e217014b58d7 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:37.136872 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e46f48d4-e15e-4962-b020-e217014b58d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:37.219746 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f48d4-e15e-4962-b020-e217014b58d7 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:37.225280 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bf78d-7414-49e7-9984-92db1e497288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:37.227397 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bf78d-7414-49e7-9984-92db1e497288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:37.227833 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bf78d-7414-49e7-9984-92db1e497288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:37.228227 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bf78d-7414-49e7-9984-92db1e497288 admin admin] PATH_INFO: `/v3/users/7a32fd410dc44ad384a73f048d903c25` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:37.230308 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bf78d-7414-49e7-9984-92db1e497288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a32fd410dc44ad384a73f048d903c25)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:37.232502 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bf78d-7414-49e7-9984-92db1e497288 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:37.314093 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-218bf78d-7414-49e7-9984-92db1e497288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a32fd410dc44ad384a73f048d903c25'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:37.323178 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-218bf78d-7414-49e7-9984-92db1e497288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a32fd410dc44ad384a73f048d903c25'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:37.323950 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-218bf78d-7414-49e7-9984-92db1e497288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a32fd410dc44ad384a73f048d903c25'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:37.332465 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-218bf78d-7414-49e7-9984-92db1e497288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a32fd410dc44ad384a73f048d903c25'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:37.348189 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-218bf78d-7414-49e7-9984-92db1e497288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a32fd410dc44ad384a73f048d903c25'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:37.355284 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1400/2833] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:47:37 2022] DELETE /identity/v3/users/7a32fd410dc44ad384a73f048d903c25 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:37.359653 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d780d4c-88b2-4f41-b125-d5482432165c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:37.359942 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d780d4c-88b2-4f41-b125-d5482432165c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:37.360215 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d780d4c-88b2-4f41-b125-d5482432165c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:37.378292 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4d780d4c-88b2-4f41-b125-d5482432165c None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:37.379556 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4d780d4c-88b2-4f41-b125-d5482432165c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:37.445004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1434/2834] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:37.455657 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bf78d-7414-49e7-9984-92db1e497288 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:37.457116 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-218bf78d-7414-49e7-9984-92db1e497288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:37.526889 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bf78d-7414-49e7-9984-92db1e497288 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:37.532516 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0c6d1-f2e7-4263-bff4-377368ef0b46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:37.533627 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0c6d1-f2e7-4263-bff4-377368ef0b46 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:37.534091 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0c6d1-f2e7-4263-bff4-377368ef0b46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:37.534617 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0c6d1-f2e7-4263-bff4-377368ef0b46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:37.548397 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0c6d1-f2e7-4263-bff4-377368ef0b46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:37.550027 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0c6d1-f2e7-4263-bff4-377368ef0b46 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:37.561485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1401/2835] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:37.949302 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d780d4c-88b2-4f41-b125-d5482432165c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:37.950878 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4d780d4c-88b2-4f41-b125-d5482432165c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:37.962973 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d780d4c-88b2-4f41-b125-d5482432165c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:37.967532 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965a57a-b9a9-445c-af7f-8ff44596b6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:37.968406 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965a57a-b9a9-445c-af7f-8ff44596b6a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:37.968686 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965a57a-b9a9-445c-af7f-8ff44596b6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:37.968960 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965a57a-b9a9-445c-af7f-8ff44596b6a5 admin admin] PATH_INFO: `/v3/projects/1b54860cd08f40ddbc8a6c6973c85085` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:37.970488 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965a57a-b9a9-445c-af7f-8ff44596b6a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b54860cd08f40ddbc8a6c6973c85085)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:37.972478 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965a57a-b9a9-445c-af7f-8ff44596b6a5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:38.021504 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0965a57a-b9a9-445c-af7f-8ff44596b6a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b54860cd08f40ddbc8a6c6973c85085', 'request_id': 'req-0965a57a-b9a9-445c-af7f-8ff44596b6a5'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:38.026956 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0965a57a-b9a9-445c-af7f-8ff44596b6a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b54860cd08f40ddbc8a6c6973c85085', 'request_id': 'req-0965a57a-b9a9-445c-af7f-8ff44596b6a5'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:38.033135 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0965a57a-b9a9-445c-af7f-8ff44596b6a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b54860cd08f40ddbc8a6c6973c85085', 'request_id': 'req-0965a57a-b9a9-445c-af7f-8ff44596b6a5'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:38.046862 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0965a57a-b9a9-445c-af7f-8ff44596b6a5 admin admin] The token cache is being invalidate because project 1b54860cd08f40ddbc8a6c6973c85085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:47:38.047080 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0965a57a-b9a9-445c-af7f-8ff44596b6a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:38.047763 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0965a57a-b9a9-445c-af7f-8ff44596b6a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:38.049481 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1435/2836] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:47:37 2022] DELETE /identity/v3/projects/1b54860cd08f40ddbc8a6c6973c85085 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:38.054595 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076386c5-d975-4456-80b3-fd74870daf07 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:38.054904 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076386c5-d975-4456-80b3-fd74870daf07 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:38.055187 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076386c5-d975-4456-80b3-fd74870daf07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:38.075912 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-076386c5-d975-4456-80b3-fd74870daf07 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:38.077257 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-076386c5-d975-4456-80b3-fd74870daf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:38.089001 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:38.146023 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1402/2837] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:38.154193 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f47f25-5f18-4999-8b67-7b19f2727ffe None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:38.154478 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f47f25-5f18-4999-8b67-7b19f2727ffe None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:38.154783 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f47f25-5f18-4999-8b67-7b19f2727ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:38.174106 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d3f47f25-5f18-4999-8b67-7b19f2727ffe None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:38.175342 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d3f47f25-5f18-4999-8b67-7b19f2727ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:38.183792 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1436/2838] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:38.188598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076386c5-d975-4456-80b3-fd74870daf07 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:38.198825 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076386c5-d975-4456-80b3-fd74870daf07 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:38.203988 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f817997-1ec6-44cf-a46b-441645facc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:38.204757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f817997-1ec6-44cf-a46b-441645facc0d admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:38.205048 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f817997-1ec6-44cf-a46b-441645facc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:38.205297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f817997-1ec6-44cf-a46b-441645facc0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:38.206049 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f817997-1ec6-44cf-a46b-441645facc0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:47:38.206362 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f817997-1ec6-44cf-a46b-441645facc0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:38.208300 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f817997-1ec6-44cf-a46b-441645facc0d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:38.223640 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1403/2839] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:47:38.225119 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f47f25-5f18-4999-8b67-7b19f2727ffe None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:38.235282 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f47f25-5f18-4999-8b67-7b19f2727ffe None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:38.241455 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e329912-20b4-42eb-a773-fd981b475721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:38.242139 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e329912-20b4-42eb-a773-fd981b475721 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:38.242416 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e329912-20b4-42eb-a773-fd981b475721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:38.242720 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e329912-20b4-42eb-a773-fd981b475721 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:38.243588 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e329912-20b4-42eb-a773-fd981b475721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:38.245375 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e329912-20b4-42eb-a773-fd981b475721 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:38.269649 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:38.282749 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1437/2840] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:47:38 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:47:38.284289 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f817997-1ec6-44cf-a46b-441645facc0d admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:38.298754 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f817997-1ec6-44cf-a46b-441645facc0d admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:38.392161 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c167d1d-b018-4985-b865-d6a3acba4c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:38.393453 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c167d1d-b018-4985-b865-d6a3acba4c4e admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:38.393453 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c167d1d-b018-4985-b865-d6a3acba4c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:38.393453 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c167d1d-b018-4985-b865-d6a3acba4c4e admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:38.394458 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c167d1d-b018-4985-b865-d6a3acba4c4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:38.396677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c167d1d-b018-4985-b865-d6a3acba4c4e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:38.420593 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1404/2841] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:47:38 2022] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:47:38.425397 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e329912-20b4-42eb-a773-fd981b475721 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:38.443982 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e329912-20b4-42eb-a773-fd981b475721 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:38.456187 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e9014-4179-46ac-b033-bb0f1ced2b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:38.457773 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e9014-4179-46ac-b033-bb0f1ced2b1e admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:38.458141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e9014-4179-46ac-b033-bb0f1ced2b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:38.458486 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e9014-4179-46ac-b033-bb0f1ced2b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:38.460630 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e9014-4179-46ac-b033-bb0f1ced2b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:38.462674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e9014-4179-46ac-b033-bb0f1ced2b1e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:38.475959 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1438/2842] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:47:38.479818 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c167d1d-b018-4985-b865-d6a3acba4c4e admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:38.490486 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c167d1d-b018-4985-b865-d6a3acba4c4e admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:38.495813 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70158da-29c8-4304-9404-bcd45f8d062b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:38.496471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70158da-29c8-4304-9404-bcd45f8d062b admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:38.496795 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70158da-29c8-4304-9404-bcd45f8d062b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:38.497312 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70158da-29c8-4304-9404-bcd45f8d062b admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:38.498370 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70158da-29c8-4304-9404-bcd45f8d062b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:38.500491 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70158da-29c8-4304-9404-bcd45f8d062b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:38.513226 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1405/2843] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:47:38.517660 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e9014-4179-46ac-b033-bb0f1ced2b1e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:38.528561 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e9014-4179-46ac-b033-bb0f1ced2b1e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:38.534841 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf642b7c-6a3a-4c64-a66d-821629a5a0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:38.535917 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf642b7c-6a3a-4c64-a66d-821629a5a0d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:38.536206 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf642b7c-6a3a-4c64-a66d-821629a5a0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:38.536476 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf642b7c-6a3a-4c64-a66d-821629a5a0d3 admin admin] PATH_INFO: `/v3/projects/98fd5b810bfc4406bd936575836e2b26/users/33a27493111a4a6ab72a6c6b03a35776/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:38.552275 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf642b7c-6a3a-4c64-a66d-821629a5a0d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98fd5b810bfc4406bd936575836e2b26, user_id=33a27493111a4a6ab72a6c6b03a35776, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:38.554872 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf642b7c-6a3a-4c64-a66d-821629a5a0d3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:38.568705 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1439/2844] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:47:38 2022] PUT /identity/v3/projects/98fd5b810bfc4406bd936575836e2b26/users/33a27493111a4a6ab72a6c6b03a35776/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:38.580980 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fb1d6-7ff3-4a5b-9396-e75f15a340c7 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:38.581350 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fb1d6-7ff3-4a5b-9396-e75f15a340c7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:38.581696 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fb1d6-7ff3-4a5b-9396-e75f15a340c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:38.610611 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-e80fb1d6-7ff3-4a5b-9396-e75f15a340c7 None None] MFA Rules not processed for user `33a27493111a4a6ab72a6c6b03a35776`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:38.611975 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e80fb1d6-7ff3-4a5b-9396-e75f15a340c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:38.686649 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1406/2845] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:38.698026 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf642b7c-6a3a-4c64-a66d-821629a5a0d3 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:38.700221 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cf642b7c-6a3a-4c64-a66d-821629a5a0d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:38.762103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf642b7c-6a3a-4c64-a66d-821629a5a0d3 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:38.765924 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9066d-e182-4e91-866e-dbe2c7c113cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:38.766596 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9066d-e182-4e91-866e-dbe2c7c113cf service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:38.766883 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9066d-e182-4e91-866e-dbe2c7c113cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:38.767234 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9066d-e182-4e91-866e-dbe2c7c113cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:38.776478 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9066d-e182-4e91-866e-dbe2c7c113cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:38.777967 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9066d-e182-4e91-866e-dbe2c7c113cf service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:38.787476 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1440/2846] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:42.907399 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8fe69-0ff8-41e0-ae5c-e5a80e08111b None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:42.907992 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8fe69-0ff8-41e0-ae5c-e5a80e08111b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:42.907992 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8fe69-0ff8-41e0-ae5c-e5a80e08111b None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:42.909633 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1407/2847] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 13:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:47:42.916359 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cf9e2-f8ea-499f-8ae7-830441d81949 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:42.916880 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cf9e2-f8ea-499f-8ae7-830441d81949 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:42.916880 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cf9e2-f8ea-499f-8ae7-830441d81949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:42.936657 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-428cf9e2-f8ea-499f-8ae7-830441d81949 None None] MFA Rules not processed for user `a072e8e01bc64c9b92579bb8f1d513a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:42.938094 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-428cf9e2-f8ea-499f-8ae7-830441d81949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:43.000463 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1441/2848] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 13:47:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:47:43.014271 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8fe69-0ff8-41e0-ae5c-e5a80e08111b None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:43.016248 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c2e8fe69-0ff8-41e0-ae5c-e5a80e08111b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:43.031515 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8fe69-0ff8-41e0-ae5c-e5a80e08111b None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:43.035586 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0acc5-337e-4194-ae52-3779d9bd473c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:43.036297 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0acc5-337e-4194-ae52-3779d9bd473c service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:43.036676 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0acc5-337e-4194-ae52-3779d9bd473c service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:43.037042 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0acc5-337e-4194-ae52-3779d9bd473c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:43.052919 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0acc5-337e-4194-ae52-3779d9bd473c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:43.054699 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0acc5-337e-4194-ae52-3779d9bd473c service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:43.058079 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:43.068313 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1408/2849] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:43.155376 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904b7c1-6e76-49f9-ad79-b0fe6f6af518 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:43.155660 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904b7c1-6e76-49f9-ad79-b0fe6f6af518 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:43.155957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904b7c1-6e76-49f9-ad79-b0fe6f6af518 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:43.157447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1442/2850] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 13:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:47:43.164668 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa750fd-bb84-4d9e-8073-f86d90f5f589 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:43.165262 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa750fd-bb84-4d9e-8073-f86d90f5f589 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:43.165537 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa750fd-bb84-4d9e-8073-f86d90f5f589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:43.189718 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-3fa750fd-bb84-4d9e-8073-f86d90f5f589 None None] MFA Rules not processed for user `5a0061e2927843cf86769d2beab18743`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:43.191091 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3fa750fd-bb84-4d9e-8073-f86d90f5f589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:43.277243 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1409/2851] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 13:47:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:47:43.287768 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904b7c1-6e76-49f9-ad79-b0fe6f6af518 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:43.299528 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904b7c1-6e76-49f9-ad79-b0fe6f6af518 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:43.303148 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df939e-1131-4a82-b552-a48d71429a63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:43.303786 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df939e-1131-4a82-b552-a48d71429a63 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:43.304065 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df939e-1131-4a82-b552-a48d71429a63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:43.304337 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df939e-1131-4a82-b552-a48d71429a63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:43.314555 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df939e-1131-4a82-b552-a48d71429a63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:43.316078 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df939e-1131-4a82-b552-a48d71429a63 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:43.326815 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1443/2852] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:48.817983 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa750fd-bb84-4d9e-8073-f86d90f5f589 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:48.880971 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa750fd-bb84-4d9e-8073-f86d90f5f589 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:48.886002 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a382d1-fca8-4e69-ab40-0899d3da8615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:48.886859 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a382d1-fca8-4e69-ab40-0899d3da8615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:48.887137 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a382d1-fca8-4e69-ab40-0899d3da8615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:48.887408 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a382d1-fca8-4e69-ab40-0899d3da8615 admin admin] PATH_INFO: `/v3/users/33a27493111a4a6ab72a6c6b03a35776` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:48.888590 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a382d1-fca8-4e69-ab40-0899d3da8615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33a27493111a4a6ab72a6c6b03a35776)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:48.890498 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a382d1-fca8-4e69-ab40-0899d3da8615 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:48.939112 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-88a382d1-fca8-4e69-ab40-0899d3da8615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33a27493111a4a6ab72a6c6b03a35776'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:48.947778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-88a382d1-fca8-4e69-ab40-0899d3da8615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33a27493111a4a6ab72a6c6b03a35776'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:48.948459 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-88a382d1-fca8-4e69-ab40-0899d3da8615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33a27493111a4a6ab72a6c6b03a35776'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:48.955493 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-88a382d1-fca8-4e69-ab40-0899d3da8615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33a27493111a4a6ab72a6c6b03a35776'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:48.968795 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-88a382d1-fca8-4e69-ab40-0899d3da8615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33a27493111a4a6ab72a6c6b03a35776'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:48.976504 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1410/2853] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:47:48 2022] DELETE /identity/v3/users/33a27493111a4a6ab72a6c6b03a35776 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:48.981158 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef953d5-7260-455f-98cb-b300e1ff0f69 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:48.981574 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef953d5-7260-455f-98cb-b300e1ff0f69 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:48.981690 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef953d5-7260-455f-98cb-b300e1ff0f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:48.999182 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3ef953d5-7260-455f-98cb-b300e1ff0f69 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:49.000363 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3ef953d5-7260-455f-98cb-b300e1ff0f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:49.061612 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1444/2854] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:49.071650 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a382d1-fca8-4e69-ab40-0899d3da8615 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:49.073275 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-88a382d1-fca8-4e69-ab40-0899d3da8615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:49.086485 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:49.138765 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a382d1-fca8-4e69-ab40-0899d3da8615 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:49.142367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36655098-8f66-4625-a38c-03d7f0e85c69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:49.143061 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36655098-8f66-4625-a38c-03d7f0e85c69 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:49.143344 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36655098-8f66-4625-a38c-03d7f0e85c69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:49.143618 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36655098-8f66-4625-a38c-03d7f0e85c69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:49.153140 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36655098-8f66-4625-a38c-03d7f0e85c69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:49.154557 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36655098-8f66-4625-a38c-03d7f0e85c69 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:49.164761 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1411/2855] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:49.450825 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef953d5-7260-455f-98cb-b300e1ff0f69 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:49.452252 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3ef953d5-7260-455f-98cb-b300e1ff0f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:49.460194 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:49.466522 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef953d5-7260-455f-98cb-b300e1ff0f69 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:49.472692 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188efe7-2336-4b6c-b1c1-d498c4a3423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:49.473736 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188efe7-2336-4b6c-b1c1-d498c4a3423d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:49.474364 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188efe7-2336-4b6c-b1c1-d498c4a3423d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:49.475048 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188efe7-2336-4b6c-b1c1-d498c4a3423d admin admin] PATH_INFO: `/v3/projects/98fd5b810bfc4406bd936575836e2b26` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:49.476447 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188efe7-2336-4b6c-b1c1-d498c4a3423d admin admin] RBAC: Authorizing `identity:delete_project(project_id=98fd5b810bfc4406bd936575836e2b26)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:49.478491 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188efe7-2336-4b6c-b1c1-d498c4a3423d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:49.535803 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e188efe7-2336-4b6c-b1c1-d498c4a3423d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98fd5b810bfc4406bd936575836e2b26', 'request_id': 'req-e188efe7-2336-4b6c-b1c1-d498c4a3423d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:49.542078 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e188efe7-2336-4b6c-b1c1-d498c4a3423d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98fd5b810bfc4406bd936575836e2b26', 'request_id': 'req-e188efe7-2336-4b6c-b1c1-d498c4a3423d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:49.548650 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e188efe7-2336-4b6c-b1c1-d498c4a3423d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98fd5b810bfc4406bd936575836e2b26', 'request_id': 'req-e188efe7-2336-4b6c-b1c1-d498c4a3423d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:49.562927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e188efe7-2336-4b6c-b1c1-d498c4a3423d admin admin] The token cache is being invalidate because project 98fd5b810bfc4406bd936575836e2b26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:47:49.563316 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e188efe7-2336-4b6c-b1c1-d498c4a3423d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:49.564067 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e188efe7-2336-4b6c-b1c1-d498c4a3423d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:47:49.565804 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1445/2856] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:47:49 2022] DELETE /identity/v3/projects/98fd5b810bfc4406bd936575836e2b26 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:47:55.039843 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55193bd5-4165-4249-9c1b-44c8f6bd5a59 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:55.040342 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55193bd5-4165-4249-9c1b-44c8f6bd5a59 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:55.040448 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55193bd5-4165-4249-9c1b-44c8f6bd5a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:55.059298 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-55193bd5-4165-4249-9c1b-44c8f6bd5a59 None None] MFA Rules not processed for user `cbf7d6db675047cbb3a3f16631c59622`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:55.060494 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-55193bd5-4165-4249-9c1b-44c8f6bd5a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:55.118740 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1412/2857] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 13:47:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:55.172863 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188efe7-2336-4b6c-b1c1-d498c4a3423d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:55.174421 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e188efe7-2336-4b6c-b1c1-d498c4a3423d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:55.257617 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188efe7-2336-4b6c-b1c1-d498c4a3423d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:55.265849 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a73ac6-2045-4b46-af03-cb60e0c4fcd2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd0e37b0404419bb5752228bd809be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:55.266517 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a73ac6-2045-4b46-af03-cb60e0c4fcd2 service swift] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:55.266855 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a73ac6-2045-4b46-af03-cb60e0c4fcd2 service swift] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:55.267127 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a73ac6-2045-4b46-af03-cb60e0c4fcd2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:55.277403 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a73ac6-2045-4b46-af03-cb60e0c4fcd2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:55.279052 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a73ac6-2045-4b46-af03-cb60e0c4fcd2 service swift] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:55.288667 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1446/2858] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 13:47:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:48:05.110683 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=47 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:05.284475 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=58,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:09.789173 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad95d30-11c2-4aa3-bd2f-658e49d7a183 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:09.789653 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad95d30-11c2-4aa3-bd2f-658e49d7a183 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:09.789760 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad95d30-11c2-4aa3-bd2f-658e49d7a183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:09.808191 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-cad95d30-11c2-4aa3-bd2f-658e49d7a183 None None] MFA Rules not processed for user `cbf7d6db675047cbb3a3f16631c59622`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:09.809383 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-cad95d30-11c2-4aa3-bd2f-658e49d7a183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:09.817148 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1413/2859] 10.222.0.18 () {58 vars in 967 bytes} [Thu Jun 2 13:48:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:09.829326 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a73ac6-2045-4b46-af03-cb60e0c4fcd2 service swift] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:09.840266 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a73ac6-2045-4b46-af03-cb60e0c4fcd2 service swift] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:09.848745 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa32303-b75a-4aef-8cff-73e3f2e9d53c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd0e37b0404419bb5752228bd809be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:09.849391 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa32303-b75a-4aef-8cff-73e3f2e9d53c service swift] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:09.849674 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa32303-b75a-4aef-8cff-73e3f2e9d53c service swift] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:09.849920 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa32303-b75a-4aef-8cff-73e3f2e9d53c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:09.858810 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa32303-b75a-4aef-8cff-73e3f2e9d53c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:09.860405 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa32303-b75a-4aef-8cff-73e3f2e9d53c service swift] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:09.868942 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1447/2860] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 13:48:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:48:11.774386 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad95d30-11c2-4aa3-bd2f-658e49d7a183 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:11.776013 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-cad95d30-11c2-4aa3-bd2f-658e49d7a183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:11.834547 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa32303-b75a-4aef-8cff-73e3f2e9d53c service swift] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:11.836678 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0fa32303-b75a-4aef-8cff-73e3f2e9d53c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:11.851871 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad95d30-11c2-4aa3-bd2f-658e49d7a183 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:11.857593 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bd9f9-bda5-4d25-912e-1090eb65f061 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f7ea9741a5d409d87b8ebb4390a74ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:11.858189 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bd9f9-bda5-4d25-912e-1090eb65f061 service placement] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:11.858464 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bd9f9-bda5-4d25-912e-1090eb65f061 service placement] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:11.858765 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bd9f9-bda5-4d25-912e-1090eb65f061 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:11.860615 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-421bd9f9-bda5-4d25-912e-1090eb65f061 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:11.872848 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bd9f9-bda5-4d25-912e-1090eb65f061 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:11.874439 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bd9f9-bda5-4d25-912e-1090eb65f061 service placement] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:11.884776 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1414/2861] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:48:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:48:11.906583 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa32303-b75a-4aef-8cff-73e3f2e9d53c service swift] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:11.911769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccb61d-07b8-48e0-8697-43e804c1b060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:11.912659 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccb61d-07b8-48e0-8697-43e804c1b060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:11.912978 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccb61d-07b8-48e0-8697-43e804c1b060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:11.913257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccb61d-07b8-48e0-8697-43e804c1b060 admin admin] PATH_INFO: `/v3/users/f707513cbc1940d4b259002bd6e4e3a6` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:11.914469 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eccb61d-07b8-48e0-8697-43e804c1b060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f707513cbc1940d4b259002bd6e4e3a6)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:11.916407 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eccb61d-07b8-48e0-8697-43e804c1b060 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:11.964473 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4eccb61d-07b8-48e0-8697-43e804c1b060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f707513cbc1940d4b259002bd6e4e3a6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:11.973866 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4eccb61d-07b8-48e0-8697-43e804c1b060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f707513cbc1940d4b259002bd6e4e3a6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:11.974558 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4eccb61d-07b8-48e0-8697-43e804c1b060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f707513cbc1940d4b259002bd6e4e3a6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:11.986809 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4eccb61d-07b8-48e0-8697-43e804c1b060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f707513cbc1940d4b259002bd6e4e3a6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:11.987469 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4eccb61d-07b8-48e0-8697-43e804c1b060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f707513cbc1940d4b259002bd6e4e3a6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:12.001764 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1448/2862] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:48:11 2022] DELETE /identity/v3/users/f707513cbc1940d4b259002bd6e4e3a6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:48:12.184376 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bd9f9-bda5-4d25-912e-1090eb65f061 service placement] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:12.194954 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bd9f9-bda5-4d25-912e-1090eb65f061 service placement] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:12.250937 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dbb52-684f-4511-ae06-179ec00e31e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:12.251808 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dbb52-684f-4511-ae06-179ec00e31e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:12.252089 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dbb52-684f-4511-ae06-179ec00e31e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:12.252363 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dbb52-684f-4511-ae06-179ec00e31e7 admin admin] PATH_INFO: `/v3/projects/512e5f49ccf9467c85713affc037c6be` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:12.253524 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dbb52-684f-4511-ae06-179ec00e31e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=512e5f49ccf9467c85713affc037c6be)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:12.255452 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dbb52-684f-4511-ae06-179ec00e31e7 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:12.305787 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d62dbb52-684f-4511-ae06-179ec00e31e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '512e5f49ccf9467c85713affc037c6be', 'request_id': 'req-d62dbb52-684f-4511-ae06-179ec00e31e7'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:12.311710 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d62dbb52-684f-4511-ae06-179ec00e31e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '512e5f49ccf9467c85713affc037c6be', 'request_id': 'req-d62dbb52-684f-4511-ae06-179ec00e31e7'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:12.318196 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d62dbb52-684f-4511-ae06-179ec00e31e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '512e5f49ccf9467c85713affc037c6be', 'request_id': 'req-d62dbb52-684f-4511-ae06-179ec00e31e7'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:12.332621 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d62dbb52-684f-4511-ae06-179ec00e31e7 admin admin] The token cache is being invalidate because project 512e5f49ccf9467c85713affc037c6be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:48:12.332902 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d62dbb52-684f-4511-ae06-179ec00e31e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:12.333528 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d62dbb52-684f-4511-ae06-179ec00e31e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:12.335215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1415/2863] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:48:12 2022] DELETE /identity/v3/projects/512e5f49ccf9467c85713affc037c6be => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:48:12.340247 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0b927-c579-4af5-9264-fff27d5af005 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:12.340529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0b927-c579-4af5-9264-fff27d5af005 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:12.340805 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0b927-c579-4af5-9264-fff27d5af005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:12.358732 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-eef0b927-c579-4af5-9264-fff27d5af005 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:12.359916 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-eef0b927-c579-4af5-9264-fff27d5af005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:12.418237 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1449/2864] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:12.426507 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b8a95-785e-448c-af41-ffe3a2daf5e7 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:12.426851 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b8a95-785e-448c-af41-ffe3a2daf5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:12.427126 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b8a95-785e-448c-af41-ffe3a2daf5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:12.446246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-721b8a95-785e-448c-af41-ffe3a2daf5e7 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:12.447477 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-721b8a95-785e-448c-af41-ffe3a2daf5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:12.455638 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1416/2865] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:12.461145 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0b927-c579-4af5-9264-fff27d5af005 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:12.471279 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0b927-c579-4af5-9264-fff27d5af005 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:12.477957 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42531e5-50e7-48ee-983b-aa13a51195f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:12.478641 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42531e5-50e7-48ee-983b-aa13a51195f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:12.478903 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42531e5-50e7-48ee-983b-aa13a51195f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:12.479166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42531e5-50e7-48ee-983b-aa13a51195f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:12.479887 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42531e5-50e7-48ee-983b-aa13a51195f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:48:12.480187 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42531e5-50e7-48ee-983b-aa13a51195f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:12.481797 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42531e5-50e7-48ee-983b-aa13a51195f6 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:12.483331 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:12.496185 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1450/2866] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:48:12.500377 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b8a95-785e-448c-af41-ffe3a2daf5e7 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:12.510317 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b8a95-785e-448c-af41-ffe3a2daf5e7 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:12.515971 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99eda8-f6f1-437d-a1f6-a50c7e19179a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:12.516629 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99eda8-f6f1-437d-a1f6-a50c7e19179a admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:12.516923 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99eda8-f6f1-437d-a1f6-a50c7e19179a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:12.517193 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99eda8-f6f1-437d-a1f6-a50c7e19179a admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:12.517896 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99eda8-f6f1-437d-a1f6-a50c7e19179a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:12.519824 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99eda8-f6f1-437d-a1f6-a50c7e19179a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:12.523592 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:12.554403 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1417/2867] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:48:12 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:48:12.558759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42531e5-50e7-48ee-983b-aa13a51195f6 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:12.568901 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42531e5-50e7-48ee-983b-aa13a51195f6 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:12.630774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15b696-ae3b-4486-81f1-2b108fe0a1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:12.631494 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15b696-ae3b-4486-81f1-2b108fe0a1a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:12.631954 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15b696-ae3b-4486-81f1-2b108fe0a1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:12.632996 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15b696-ae3b-4486-81f1-2b108fe0a1a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:12.633241 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15b696-ae3b-4486-81f1-2b108fe0a1a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:12.635186 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15b696-ae3b-4486-81f1-2b108fe0a1a7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:12.661748 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1451/2868] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:48:12 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:48:12.668197 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99eda8-f6f1-437d-a1f6-a50c7e19179a admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:12.683237 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99eda8-f6f1-437d-a1f6-a50c7e19179a admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:12.691642 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ca0b0-ecb5-4589-b863-a1027b29a2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:12.692592 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ca0b0-ecb5-4589-b863-a1027b29a2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:12.692925 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ca0b0-ecb5-4589-b863-a1027b29a2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:12.693229 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ca0b0-ecb5-4589-b863-a1027b29a2c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:12.694174 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ca0b0-ecb5-4589-b863-a1027b29a2c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:12.696927 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ca0b0-ecb5-4589-b863-a1027b29a2c9 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:12.712529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1418/2869] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:48:12.716759 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15b696-ae3b-4486-81f1-2b108fe0a1a7 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:12.728154 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15b696-ae3b-4486-81f1-2b108fe0a1a7 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:12.734020 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e3228-f695-4998-b069-6a9e579772cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:12.734892 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e3228-f695-4998-b069-6a9e579772cf admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:12.735388 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e3228-f695-4998-b069-6a9e579772cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:12.735823 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e3228-f695-4998-b069-6a9e579772cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:12.737111 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e3228-f695-4998-b069-6a9e579772cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:12.738431 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e3228-f695-4998-b069-6a9e579772cf admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:12.749735 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1452/2870] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:48:12.754281 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ca0b0-ecb5-4589-b863-a1027b29a2c9 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:12.765186 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ca0b0-ecb5-4589-b863-a1027b29a2c9 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:12.769892 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c4b1c-dc5c-4b27-a9b3-b84ed94667d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:12.770867 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c4b1c-dc5c-4b27-a9b3-b84ed94667d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:12.771144 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c4b1c-dc5c-4b27-a9b3-b84ed94667d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:12.771417 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c4b1c-dc5c-4b27-a9b3-b84ed94667d7 admin admin] PATH_INFO: `/v3/projects/536a58206e0a4cc6a8944e102d761870/users/c5a8df16a9084e319341cb2dd8c4489d/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:12.788237 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c4b1c-dc5c-4b27-a9b3-b84ed94667d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=536a58206e0a4cc6a8944e102d761870, user_id=c5a8df16a9084e319341cb2dd8c4489d, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:12.791012 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c4b1c-dc5c-4b27-a9b3-b84ed94667d7 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:12.806191 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1419/2871] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:48:12 2022] PUT /identity/v3/projects/536a58206e0a4cc6a8944e102d761870/users/c5a8df16a9084e319341cb2dd8c4489d/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:48:12.872261 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b0780-6872-448a-87a1-3a8dc800f7b2 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:12.873304 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b0780-6872-448a-87a1-3a8dc800f7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:12.873652 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b0780-6872-448a-87a1-3a8dc800f7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:12.902607 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-688b0780-6872-448a-87a1-3a8dc800f7b2 None None] MFA Rules not processed for user `c5a8df16a9084e319341cb2dd8c4489d`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:12.903824 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-688b0780-6872-448a-87a1-3a8dc800f7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:12.976853 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1453/2872] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:48:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:12.991084 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c4b1c-dc5c-4b27-a9b3-b84ed94667d7 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:12.992800 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-447c4b1c-dc5c-4b27-a9b3-b84ed94667d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:13.061941 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c4b1c-dc5c-4b27-a9b3-b84ed94667d7 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:13.068060 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e276cb-e0d8-4420-9aaa-2a0e8e03c7e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:13.069046 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e276cb-e0d8-4420-9aaa-2a0e8e03c7e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:13.069412 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e276cb-e0d8-4420-9aaa-2a0e8e03c7e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:13.069902 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e276cb-e0d8-4420-9aaa-2a0e8e03c7e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:13.079246 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e276cb-e0d8-4420-9aaa-2a0e8e03c7e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:13.080694 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e276cb-e0d8-4420-9aaa-2a0e8e03c7e9 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:13.090062 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1420/2873] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:48:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:48:15.679950 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b0780-6872-448a-87a1-3a8dc800f7b2 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:15.744737 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b0780-6872-448a-87a1-3a8dc800f7b2 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:15.750868 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa996ee8-d62a-4cca-91da-53d699d5b8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:15.751769 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa996ee8-d62a-4cca-91da-53d699d5b8d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:15.752044 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa996ee8-d62a-4cca-91da-53d699d5b8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:15.752297 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa996ee8-d62a-4cca-91da-53d699d5b8d0 admin admin] PATH_INFO: `/v3/users/c5a8df16a9084e319341cb2dd8c4489d` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:15.753610 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa996ee8-d62a-4cca-91da-53d699d5b8d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5a8df16a9084e319341cb2dd8c4489d)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:15.755584 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa996ee8-d62a-4cca-91da-53d699d5b8d0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:15.758437 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:15.807179 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-aa996ee8-d62a-4cca-91da-53d699d5b8d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5a8df16a9084e319341cb2dd8c4489d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:15.816280 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-aa996ee8-d62a-4cca-91da-53d699d5b8d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5a8df16a9084e319341cb2dd8c4489d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:15.816917 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-aa996ee8-d62a-4cca-91da-53d699d5b8d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5a8df16a9084e319341cb2dd8c4489d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:15.829481 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-aa996ee8-d62a-4cca-91da-53d699d5b8d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5a8df16a9084e319341cb2dd8c4489d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:15.830124 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-aa996ee8-d62a-4cca-91da-53d699d5b8d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5a8df16a9084e319341cb2dd8c4489d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:15.842509 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1454/2874] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:48:15 2022] DELETE /identity/v3/users/c5a8df16a9084e319341cb2dd8c4489d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:48:15.847128 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286b8d1-6f7c-4b5a-985e-81b260375f48 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:15.847598 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286b8d1-6f7c-4b5a-985e-81b260375f48 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:15.847723 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286b8d1-6f7c-4b5a-985e-81b260375f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:15.866978 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-2286b8d1-6f7c-4b5a-985e-81b260375f48 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:15.868185 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2286b8d1-6f7c-4b5a-985e-81b260375f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:15.930072 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1421/2875] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:48:15.943973 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa996ee8-d62a-4cca-91da-53d699d5b8d0 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:15.946379 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-aa996ee8-d62a-4cca-91da-53d699d5b8d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:16.009182 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa996ee8-d62a-4cca-91da-53d699d5b8d0 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:16.013709 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d12df-0a28-4249-b86b-d3b214e8a1e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:16.014398 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d12df-0a28-4249-b86b-d3b214e8a1e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:16.014710 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d12df-0a28-4249-b86b-d3b214e8a1e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:16.014980 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d12df-0a28-4249-b86b-d3b214e8a1e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:16.025135 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d12df-0a28-4249-b86b-d3b214e8a1e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:16.026595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d12df-0a28-4249-b86b-d3b214e8a1e7 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:16.038898 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1455/2876] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:48:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:48:16.335843 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286b8d1-6f7c-4b5a-985e-81b260375f48 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:16.337410 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2286b8d1-6f7c-4b5a-985e-81b260375f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:16.350710 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286b8d1-6f7c-4b5a-985e-81b260375f48 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:16.356819 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596c6f2-7b35-4161-898d-9277135f884e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:16.357471 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596c6f2-7b35-4161-898d-9277135f884e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:16.357748 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596c6f2-7b35-4161-898d-9277135f884e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:16.358024 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596c6f2-7b35-4161-898d-9277135f884e admin admin] PATH_INFO: `/v3/projects/536a58206e0a4cc6a8944e102d761870` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:16.359548 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596c6f2-7b35-4161-898d-9277135f884e admin admin] RBAC: Authorizing `identity:delete_project(project_id=536a58206e0a4cc6a8944e102d761870)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:16.361473 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596c6f2-7b35-4161-898d-9277135f884e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:16.414873 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:16.416602 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d596c6f2-7b35-4161-898d-9277135f884e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '536a58206e0a4cc6a8944e102d761870', 'request_id': 'req-d596c6f2-7b35-4161-898d-9277135f884e'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:16.423831 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d596c6f2-7b35-4161-898d-9277135f884e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '536a58206e0a4cc6a8944e102d761870', 'request_id': 'req-d596c6f2-7b35-4161-898d-9277135f884e'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:16.430433 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d596c6f2-7b35-4161-898d-9277135f884e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '536a58206e0a4cc6a8944e102d761870', 'request_id': 'req-d596c6f2-7b35-4161-898d-9277135f884e'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:16.445327 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d596c6f2-7b35-4161-898d-9277135f884e admin admin] The token cache is being invalidate because project 536a58206e0a4cc6a8944e102d761870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:48:16.445579 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d596c6f2-7b35-4161-898d-9277135f884e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:16.446231 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d596c6f2-7b35-4161-898d-9277135f884e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:16.447876 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1422/2877] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:48:16 2022] DELETE /identity/v3/projects/536a58206e0a4cc6a8944e102d761870 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:48:16.453858 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753a685-9776-48eb-982f-b1841dce6759 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:16.454145 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753a685-9776-48eb-982f-b1841dce6759 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:16.454421 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753a685-9776-48eb-982f-b1841dce6759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:16.474082 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b753a685-9776-48eb-982f-b1841dce6759 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:16.475399 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b753a685-9776-48eb-982f-b1841dce6759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:16.536083 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1456/2878] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:16.544287 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2d7c3-203e-4be8-b7d1-8867a49bd6f4 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:16.544513 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2d7c3-203e-4be8-b7d1-8867a49bd6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:16.544830 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2d7c3-203e-4be8-b7d1-8867a49bd6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:16.565030 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-bdc2d7c3-203e-4be8-b7d1-8867a49bd6f4 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:16.566228 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-bdc2d7c3-203e-4be8-b7d1-8867a49bd6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:16.575345 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1423/2879] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:16.580843 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753a685-9776-48eb-982f-b1841dce6759 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:16.596601 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753a685-9776-48eb-982f-b1841dce6759 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:16.604413 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ccb6f-364b-46f4-8650-184223c9e6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:16.605466 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ccb6f-364b-46f4-8650-184223c9e6fd admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:16.605922 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ccb6f-364b-46f4-8650-184223c9e6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:16.606336 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ccb6f-364b-46f4-8650-184223c9e6fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:16.607103 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ccb6f-364b-46f4-8650-184223c9e6fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:48:16.607408 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ccb6f-364b-46f4-8650-184223c9e6fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:16.609004 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ccb6f-364b-46f4-8650-184223c9e6fd admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:16.621223 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1457/2880] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 13:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:48:16.625890 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2d7c3-203e-4be8-b7d1-8867a49bd6f4 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:16.638940 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2d7c3-203e-4be8-b7d1-8867a49bd6f4 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:16.649846 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba14c76-15d4-401f-9fc8-3ba1f78b3c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:16.650527 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba14c76-15d4-401f-9fc8-3ba1f78b3c40 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:16.650831 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba14c76-15d4-401f-9fc8-3ba1f78b3c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:16.651112 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba14c76-15d4-401f-9fc8-3ba1f78b3c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:16.651809 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba14c76-15d4-401f-9fc8-3ba1f78b3c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:16.653704 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba14c76-15d4-401f-9fc8-3ba1f78b3c40 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:16.685508 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1424/2881] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 13:48:16 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:48:16.690464 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ccb6f-364b-46f4-8650-184223c9e6fd admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:16.703111 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ccb6f-364b-46f4-8650-184223c9e6fd admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:16.712218 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:16.765049 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b838c0b-3015-4517-8c62-c6f88ad2e97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:16.765725 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b838c0b-3015-4517-8c62-c6f88ad2e97d admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:16.766005 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b838c0b-3015-4517-8c62-c6f88ad2e97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:16.766281 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b838c0b-3015-4517-8c62-c6f88ad2e97d admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:16.767008 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b838c0b-3015-4517-8c62-c6f88ad2e97d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:16.768999 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b838c0b-3015-4517-8c62-c6f88ad2e97d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:16.791189 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1458/2882] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 13:48:16 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:48:16.795630 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba14c76-15d4-401f-9fc8-3ba1f78b3c40 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:16.806677 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba14c76-15d4-401f-9fc8-3ba1f78b3c40 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:16.812861 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35646f-c1be-4250-abeb-0fc59988d3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:16.813531 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35646f-c1be-4250-abeb-0fc59988d3bc admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:16.813808 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35646f-c1be-4250-abeb-0fc59988d3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:16.814110 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35646f-c1be-4250-abeb-0fc59988d3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:16.814872 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35646f-c1be-4250-abeb-0fc59988d3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:16.816462 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35646f-c1be-4250-abeb-0fc59988d3bc admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:16.827764 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1425/2883] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:48:16.831880 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b838c0b-3015-4517-8c62-c6f88ad2e97d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:16.842343 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b838c0b-3015-4517-8c62-c6f88ad2e97d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:16.847598 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e253220-0aef-47e1-ad61-c38dabc19f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:16.848264 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e253220-0aef-47e1-ad61-c38dabc19f08 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:16.848545 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e253220-0aef-47e1-ad61-c38dabc19f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:16.848841 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e253220-0aef-47e1-ad61-c38dabc19f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:16.849597 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e253220-0aef-47e1-ad61-c38dabc19f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:16.851243 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e253220-0aef-47e1-ad61-c38dabc19f08 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:16.861543 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1459/2884] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 13:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:48:16.865868 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35646f-c1be-4250-abeb-0fc59988d3bc admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:16.876746 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35646f-c1be-4250-abeb-0fc59988d3bc admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:16.881504 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafcd07-e9b9-48f2-ac06-ae76c31782a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:16.882822 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafcd07-e9b9-48f2-ac06-ae76c31782a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:16.883104 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafcd07-e9b9-48f2-ac06-ae76c31782a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:16.883375 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafcd07-e9b9-48f2-ac06-ae76c31782a0 admin admin] PATH_INFO: `/v3/projects/11d42f653f974ffa844ccebed442a944/users/695a01bcbef64dbaaeb94fe5b9c3e986/roles/891bd78dbb334259bdef8495ca3f4132` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:16.898599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebafcd07-e9b9-48f2-ac06-ae76c31782a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11d42f653f974ffa844ccebed442a944, user_id=695a01bcbef64dbaaeb94fe5b9c3e986, role_id=891bd78dbb334259bdef8495ca3f4132)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:16.901248 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebafcd07-e9b9-48f2-ac06-ae76c31782a0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:16.918378 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1426/2885] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 13:48:16 2022] PUT /identity/v3/projects/11d42f653f974ffa844ccebed442a944/users/695a01bcbef64dbaaeb94fe5b9c3e986/roles/891bd78dbb334259bdef8495ca3f4132 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:48:16.930252 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3fa67-07d3-4962-ad8b-dbf6c9b7d985 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:16.930562 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3fa67-07d3-4962-ad8b-dbf6c9b7d985 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:16.930863 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3fa67-07d3-4962-ad8b-dbf6c9b7d985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:16.963448 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e9e3fa67-07d3-4962-ad8b-dbf6c9b7d985 None None] MFA Rules not processed for user `695a01bcbef64dbaaeb94fe5b9c3e986`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:16.965203 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e9e3fa67-07d3-4962-ad8b-dbf6c9b7d985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:17.048376 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1460/2886] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:48:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:17.063401 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafcd07-e9b9-48f2-ac06-ae76c31782a0 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:17.065265 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ebafcd07-e9b9-48f2-ac06-ae76c31782a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:17.129386 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafcd07-e9b9-48f2-ac06-ae76c31782a0 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:17.134215 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660cc6e-8591-48eb-9209-9590617b71d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b2f0101284461398a95538466002bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:17.134903 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660cc6e-8591-48eb-9209-9590617b71d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:17.135183 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660cc6e-8591-48eb-9209-9590617b71d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:17.135459 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660cc6e-8591-48eb-9209-9590617b71d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:17.145294 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660cc6e-8591-48eb-9209-9590617b71d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:17.146836 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660cc6e-8591-48eb-9209-9590617b71d7 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:17.156417 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1427/2887] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:48:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:48:18.520544 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489a4d9-5ce4-43af-81c0-cfa318692711 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:18.521046 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489a4d9-5ce4-43af-81c0-cfa318692711 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:18.521142 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489a4d9-5ce4-43af-81c0-cfa318692711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:18.540705 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6489a4d9-5ce4-43af-81c0-cfa318692711 None None] MFA Rules not processed for user `695a01bcbef64dbaaeb94fe5b9c3e986`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:18.541927 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6489a4d9-5ce4-43af-81c0-cfa318692711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:18.549529 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1461/2888] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:48:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:27.151718 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=60,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:28.533829 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=64,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:30.996921 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660cc6e-8591-48eb-9209-9590617b71d7 service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:30.998444 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b660cc6e-8591-48eb-9209-9590617b71d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:31.083918 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660cc6e-8591-48eb-9209-9590617b71d7 service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:31.090798 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baea61b-bf5d-4802-b958-19413a80bfc3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f7ea9741a5d409d87b8ebb4390a74ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:31.091583 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baea61b-bf5d-4802-b958-19413a80bfc3 service placement] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:31.091964 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baea61b-bf5d-4802-b958-19413a80bfc3 service placement] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:31.092360 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baea61b-bf5d-4802-b958-19413a80bfc3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:31.094631 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8baea61b-bf5d-4802-b958-19413a80bfc3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:31.106763 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baea61b-bf5d-4802-b958-19413a80bfc3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:31.108316 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baea61b-bf5d-4802-b958-19413a80bfc3 service placement] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:31.118419 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1428/2889] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:48:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:48:32.556029 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b908b-52c4-444d-b5ac-b4800610bb84 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:32.556555 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b908b-52c4-444d-b5ac-b4800610bb84 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:32.556660 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b908b-52c4-444d-b5ac-b4800610bb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:32.576864 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-518b908b-52c4-444d-b5ac-b4800610bb84 None None] MFA Rules not processed for user `cbf7d6db675047cbb3a3f16631c59622`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:32.578391 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-518b908b-52c4-444d-b5ac-b4800610bb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:32.636933 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1462/2890] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 13:48:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:32.652120 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baea61b-bf5d-4802-b958-19413a80bfc3 service placement] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:32.653870 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8baea61b-bf5d-4802-b958-19413a80bfc3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:32.733604 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baea61b-bf5d-4802-b958-19413a80bfc3 service placement] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:32.739238 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bf92d-0787-44e6-8517-144baa908858 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd0e37b0404419bb5752228bd809be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:32.739894 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bf92d-0787-44e6-8517-144baa908858 service swift] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:32.740171 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bf92d-0787-44e6-8517-144baa908858 service swift] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:32.740438 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bf92d-0787-44e6-8517-144baa908858 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:32.748853 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05bf92d-0787-44e6-8517-144baa908858 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:32.750440 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05bf92d-0787-44e6-8517-144baa908858 service swift] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:32.759082 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1429/2891] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 13:48:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:48:33.323943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b6704-3b8e-4f09-893a-6d9342520dfe None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:33.324240 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b6704-3b8e-4f09-893a-6d9342520dfe None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:33.324508 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b6704-3b8e-4f09-893a-6d9342520dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:33.343074 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8f4b6704-3b8e-4f09-893a-6d9342520dfe None None] MFA Rules not processed for user `cbf7d6db675047cbb3a3f16631c59622`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:33.344257 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8f4b6704-3b8e-4f09-893a-6d9342520dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:33.352017 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1463/2892] 10.222.0.18 () {58 vars in 967 bytes} [Thu Jun 2 13:48:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:33.364505 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bf92d-0787-44e6-8517-144baa908858 service swift] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:33.376284 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bf92d-0787-44e6-8517-144baa908858 service swift] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:33.382529 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1343b43-85b4-46aa-955f-41c9e85bfc39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd0e37b0404419bb5752228bd809be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:33.383189 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1343b43-85b4-46aa-955f-41c9e85bfc39 service swift] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:33.383468 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1343b43-85b4-46aa-955f-41c9e85bfc39 service swift] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:33.383733 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1343b43-85b4-46aa-955f-41c9e85bfc39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:33.392662 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1343b43-85b4-46aa-955f-41c9e85bfc39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:33.394299 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1343b43-85b4-46aa-955f-41c9e85bfc39 service swift] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:33.402532 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1430/2893] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 13:48:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:48:33.618501 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d46028-a7c8-4598-8087-f01e06c8a6f7 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:33.619021 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d46028-a7c8-4598-8087-f01e06c8a6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:33.619141 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d46028-a7c8-4598-8087-f01e06c8a6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:33.639384 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-17d46028-a7c8-4598-8087-f01e06c8a6f7 None None] MFA Rules not processed for user `cbf7d6db675047cbb3a3f16631c59622`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:33.640583 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-17d46028-a7c8-4598-8087-f01e06c8a6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:33.649363 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1464/2894] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 13:48:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:33.661406 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1343b43-85b4-46aa-955f-41c9e85bfc39 service swift] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:33.672397 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1343b43-85b4-46aa-955f-41c9e85bfc39 service swift] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:33.678757 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832abff8-ac0c-4cd5-937d-3d919568b9aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd0e37b0404419bb5752228bd809be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:33.679393 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832abff8-ac0c-4cd5-937d-3d919568b9aa service swift] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:33.679671 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832abff8-ac0c-4cd5-937d-3d919568b9aa service swift] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:33.679927 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832abff8-ac0c-4cd5-937d-3d919568b9aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:33.688205 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832abff8-ac0c-4cd5-937d-3d919568b9aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:33.689778 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832abff8-ac0c-4cd5-937d-3d919568b9aa service swift] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:33.698100 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1431/2895] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 13:48:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:48:34.059163 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367174d-88de-40b0-9f61-dd4807100657 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:34.059488 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367174d-88de-40b0-9f61-dd4807100657 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:34.059842 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367174d-88de-40b0-9f61-dd4807100657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:34.079451 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f367174d-88de-40b0-9f61-dd4807100657 None None] MFA Rules not processed for user `cbf7d6db675047cbb3a3f16631c59622`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:34.080611 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f367174d-88de-40b0-9f61-dd4807100657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:34.089857 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1465/2896] 10.222.0.18 () {58 vars in 967 bytes} [Thu Jun 2 13:48:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:34.104204 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832abff8-ac0c-4cd5-937d-3d919568b9aa service swift] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:34.115490 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832abff8-ac0c-4cd5-937d-3d919568b9aa service swift] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:34.121461 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407077ac-de64-4013-a91e-75e43a436fa0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd0e37b0404419bb5752228bd809be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:34.122098 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407077ac-de64-4013-a91e-75e43a436fa0 service swift] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:34.122379 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407077ac-de64-4013-a91e-75e43a436fa0 service swift] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:34.122685 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407077ac-de64-4013-a91e-75e43a436fa0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:34.131255 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407077ac-de64-4013-a91e-75e43a436fa0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:34.133191 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407077ac-de64-4013-a91e-75e43a436fa0 service swift] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:34.141541 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1432/2897] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 13:48:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:48:36.275647 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367174d-88de-40b0-9f61-dd4807100657 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:36.344876 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367174d-88de-40b0-9f61-dd4807100657 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:36.349864 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a5bc4-4ef8-48d0-b31b-4cd36bd9e8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:36.350774 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a5bc4-4ef8-48d0-b31b-4cd36bd9e8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:36.351053 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a5bc4-4ef8-48d0-b31b-4cd36bd9e8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:36.351323 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a5bc4-4ef8-48d0-b31b-4cd36bd9e8fe admin admin] PATH_INFO: `/v3/users/695a01bcbef64dbaaeb94fe5b9c3e986` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:36.352524 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a5bc4-4ef8-48d0-b31b-4cd36bd9e8fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=695a01bcbef64dbaaeb94fe5b9c3e986)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:36.354419 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a5bc4-4ef8-48d0-b31b-4cd36bd9e8fe admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:36.411453 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c71a5bc4-4ef8-48d0-b31b-4cd36bd9e8fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '695a01bcbef64dbaaeb94fe5b9c3e986'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:36.420772 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c71a5bc4-4ef8-48d0-b31b-4cd36bd9e8fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '695a01bcbef64dbaaeb94fe5b9c3e986'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:36.421398 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c71a5bc4-4ef8-48d0-b31b-4cd36bd9e8fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '695a01bcbef64dbaaeb94fe5b9c3e986'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:36.433359 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c71a5bc4-4ef8-48d0-b31b-4cd36bd9e8fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '695a01bcbef64dbaaeb94fe5b9c3e986'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:36.434038 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c71a5bc4-4ef8-48d0-b31b-4cd36bd9e8fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '695a01bcbef64dbaaeb94fe5b9c3e986'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:36.447039 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1466/2898] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:48:36 2022] DELETE /identity/v3/users/695a01bcbef64dbaaeb94fe5b9c3e986 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:48:36.451841 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d12d9-7899-4319-a430-626cba01fc68 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:36.452367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d12d9-7899-4319-a430-626cba01fc68 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:36.452367 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d12d9-7899-4319-a430-626cba01fc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:36.471245 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-563d12d9-7899-4319-a430-626cba01fc68 None None] MFA Rules not processed for user `27881d4c1bda4cb38dd2046d66b10c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:36.472442 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-563d12d9-7899-4319-a430-626cba01fc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:36.507676 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:36.545776 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1433/2899] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 13:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:36.552265 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a5bc4-4ef8-48d0-b31b-4cd36bd9e8fe admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:36.553833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c71a5bc4-4ef8-48d0-b31b-4cd36bd9e8fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:36.560663 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:36.620378 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a5bc4-4ef8-48d0-b31b-4cd36bd9e8fe admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:36.625827 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4aed4-18ed-4e39-912d-f57cf2176a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a072e8e01bc64c9b92579bb8f1d513a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:36.626491 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4aed4-18ed-4e39-912d-f57cf2176a7a service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:36.626793 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4aed4-18ed-4e39-912d-f57cf2176a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:36.627064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4aed4-18ed-4e39-912d-f57cf2176a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:36.638016 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa4aed4-18ed-4e39-912d-f57cf2176a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:36.639503 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa4aed4-18ed-4e39-912d-f57cf2176a7a service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:36.649702 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1467/2900] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:48:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:48:36.847459 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d12d9-7899-4319-a430-626cba01fc68 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:36.848938 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-563d12d9-7899-4319-a430-626cba01fc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:36.860628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d12d9-7899-4319-a430-626cba01fc68 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:36.865460 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29980b7-eaac-43b8-8d5d-c48bea84725b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:36.866330 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29980b7-eaac-43b8-8d5d-c48bea84725b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:36.866628 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29980b7-eaac-43b8-8d5d-c48bea84725b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:36.866896 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29980b7-eaac-43b8-8d5d-c48bea84725b admin admin] PATH_INFO: `/v3/projects/11d42f653f974ffa844ccebed442a944` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:36.868077 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29980b7-eaac-43b8-8d5d-c48bea84725b admin admin] RBAC: Authorizing `identity:delete_project(project_id=11d42f653f974ffa844ccebed442a944)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:36.869951 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29980b7-eaac-43b8-8d5d-c48bea84725b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:36.917170 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f29980b7-eaac-43b8-8d5d-c48bea84725b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11d42f653f974ffa844ccebed442a944', 'request_id': 'req-f29980b7-eaac-43b8-8d5d-c48bea84725b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:36.922808 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f29980b7-eaac-43b8-8d5d-c48bea84725b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11d42f653f974ffa844ccebed442a944', 'request_id': 'req-f29980b7-eaac-43b8-8d5d-c48bea84725b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:36.929955 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f29980b7-eaac-43b8-8d5d-c48bea84725b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11d42f653f974ffa844ccebed442a944', 'request_id': 'req-f29980b7-eaac-43b8-8d5d-c48bea84725b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:36.945505 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f29980b7-eaac-43b8-8d5d-c48bea84725b admin admin] The token cache is being invalidate because project 11d42f653f974ffa844ccebed442a944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:48:36.945869 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f29980b7-eaac-43b8-8d5d-c48bea84725b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:36.946931 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f29980b7-eaac-43b8-8d5d-c48bea84725b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:48:36.949322 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1434/2901] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:48:36 2022] DELETE /identity/v3/projects/11d42f653f974ffa844ccebed442a944 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:48:46.644943 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=24 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:46.941309 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:49:13.549272 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4aed4-18ed-4e39-912d-f57cf2176a7a service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:49:13.551030 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-efa4aed4-18ed-4e39-912d-f57cf2176a7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:13.564539 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4aed4-18ed-4e39-912d-f57cf2176a7a service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:49:13.632409 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dffe3-3d84-4ee3-b3e8-50ef29674c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:49:13.633329 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dffe3-3d84-4ee3-b3e8-50ef29674c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:13.633593 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dffe3-3d84-4ee3-b3e8-50ef29674c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:13.633848 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dffe3-3d84-4ee3-b3e8-50ef29674c15 admin admin] PATH_INFO: `/v3/users/cd9388ebdfa4425a834fd73d9fadcc33` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:13.635370 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289dffe3-3d84-4ee3-b3e8-50ef29674c15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd9388ebdfa4425a834fd73d9fadcc33)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:49:13.638038 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289dffe3-3d84-4ee3-b3e8-50ef29674c15 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:49:13.691166 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-289dffe3-3d84-4ee3-b3e8-50ef29674c15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd9388ebdfa4425a834fd73d9fadcc33'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:49:13.700431 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-289dffe3-3d84-4ee3-b3e8-50ef29674c15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd9388ebdfa4425a834fd73d9fadcc33'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:49:13.701104 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-289dffe3-3d84-4ee3-b3e8-50ef29674c15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd9388ebdfa4425a834fd73d9fadcc33'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:49:13.713550 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-289dffe3-3d84-4ee3-b3e8-50ef29674c15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd9388ebdfa4425a834fd73d9fadcc33'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:49:13.714219 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-289dffe3-3d84-4ee3-b3e8-50ef29674c15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd9388ebdfa4425a834fd73d9fadcc33'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:49:13.728061 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1468/2902] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:49:13 2022] DELETE /identity/v3/users/cd9388ebdfa4425a834fd73d9fadcc33 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:49:13.917067 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29980b7-eaac-43b8-8d5d-c48bea84725b admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:49:13.918599 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f29980b7-eaac-43b8-8d5d-c48bea84725b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:13.932956 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29980b7-eaac-43b8-8d5d-c48bea84725b admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:49:13.997326 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f8720-9dbf-4a54-98cb-96baa0589093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:49:13.998234 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f8720-9dbf-4a54-98cb-96baa0589093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:13.998539 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f8720-9dbf-4a54-98cb-96baa0589093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:13.998847 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f8720-9dbf-4a54-98cb-96baa0589093 admin admin] PATH_INFO: `/v3/projects/830099cdefd6444f9593af1ba8462470` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:14.000053 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f8720-9dbf-4a54-98cb-96baa0589093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=830099cdefd6444f9593af1ba8462470)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:49:14.001959 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f8720-9dbf-4a54-98cb-96baa0589093 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:49:14.051259 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fb3f8720-9dbf-4a54-98cb-96baa0589093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '830099cdefd6444f9593af1ba8462470', 'request_id': 'req-fb3f8720-9dbf-4a54-98cb-96baa0589093'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:49:14.057150 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fb3f8720-9dbf-4a54-98cb-96baa0589093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '830099cdefd6444f9593af1ba8462470', 'request_id': 'req-fb3f8720-9dbf-4a54-98cb-96baa0589093'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:49:14.063321 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fb3f8720-9dbf-4a54-98cb-96baa0589093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '830099cdefd6444f9593af1ba8462470', 'request_id': 'req-fb3f8720-9dbf-4a54-98cb-96baa0589093'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:49:14.076600 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fb3f8720-9dbf-4a54-98cb-96baa0589093 admin admin] The token cache is being invalidate because project 830099cdefd6444f9593af1ba8462470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:49:14.076886 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fb3f8720-9dbf-4a54-98cb-96baa0589093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:49:14.077502 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fb3f8720-9dbf-4a54-98cb-96baa0589093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:49:14.079071 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1435/2903] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:49:13 2022] DELETE /identity/v3/projects/830099cdefd6444f9593af1ba8462470 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:49:14.083144 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dffe3-3d84-4ee3-b3e8-50ef29674c15 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:49:14.084595 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-289dffe3-3d84-4ee3-b3e8-50ef29674c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:14.097828 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dffe3-3d84-4ee3-b3e8-50ef29674c15 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:49:14.167784 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34a493-2b11-4ecd-8873-6df33659a407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:49:14.168714 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34a493-2b11-4ecd-8873-6df33659a407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:14.168995 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34a493-2b11-4ecd-8873-6df33659a407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:14.169247 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34a493-2b11-4ecd-8873-6df33659a407 admin admin] PATH_INFO: `/v3/users/1ac3a81103f549538c0e34909eacbdd8` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:14.170626 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34a493-2b11-4ecd-8873-6df33659a407 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ac3a81103f549538c0e34909eacbdd8)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:49:14.172534 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34a493-2b11-4ecd-8873-6df33659a407 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:49:14.197363 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:49:14.223075 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5e34a493-2b11-4ecd-8873-6df33659a407 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ac3a81103f549538c0e34909eacbdd8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:49:14.230881 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5e34a493-2b11-4ecd-8873-6df33659a407 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ac3a81103f549538c0e34909eacbdd8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:49:14.231490 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5e34a493-2b11-4ecd-8873-6df33659a407 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ac3a81103f549538c0e34909eacbdd8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:49:14.243580 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5e34a493-2b11-4ecd-8873-6df33659a407 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ac3a81103f549538c0e34909eacbdd8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:49:14.244302 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5e34a493-2b11-4ecd-8873-6df33659a407 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ac3a81103f549538c0e34909eacbdd8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:49:14.257389 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1469/2904] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 13:49:14 2022] DELETE /identity/v3/users/1ac3a81103f549538c0e34909eacbdd8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:49:14.443369 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f8720-9dbf-4a54-98cb-96baa0589093 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:49:14.444908 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-fb3f8720-9dbf-4a54-98cb-96baa0589093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:14.459528 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f8720-9dbf-4a54-98cb-96baa0589093 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:49:14.524413 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fb538-0efb-47c3-b4a0-f12e6731b58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27881d4c1bda4cb38dd2046d66b10c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '119d80c3d10b4ce0978a2de4f94e5475', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:49:14.525690 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fb538-0efb-47c3-b4a0-f12e6731b58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:14.526060 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fb538-0efb-47c3-b4a0-f12e6731b58d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:14.526352 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fb538-0efb-47c3-b4a0-f12e6731b58d admin admin] PATH_INFO: `/v3/projects/c5ea2facadb44ec99af635bf1899debf` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:14.528095 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805fb538-0efb-47c3-b4a0-f12e6731b58d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5ea2facadb44ec99af635bf1899debf)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:49:14.531030 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805fb538-0efb-47c3-b4a0-f12e6731b58d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:49:14.571782 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:49:14.585730 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-805fb538-0efb-47c3-b4a0-f12e6731b58d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5ea2facadb44ec99af635bf1899debf', 'request_id': 'req-805fb538-0efb-47c3-b4a0-f12e6731b58d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:49:14.591504 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-805fb538-0efb-47c3-b4a0-f12e6731b58d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5ea2facadb44ec99af635bf1899debf', 'request_id': 'req-805fb538-0efb-47c3-b4a0-f12e6731b58d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:49:14.598129 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-805fb538-0efb-47c3-b4a0-f12e6731b58d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5ea2facadb44ec99af635bf1899debf', 'request_id': 'req-805fb538-0efb-47c3-b4a0-f12e6731b58d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:49:14.611799 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-805fb538-0efb-47c3-b4a0-f12e6731b58d admin admin] The token cache is being invalidate because project c5ea2facadb44ec99af635bf1899debf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:49:14.612087 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-805fb538-0efb-47c3-b4a0-f12e6731b58d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:49:14.612742 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-805fb538-0efb-47c3-b4a0-f12e6731b58d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:49:14.614594 dv-cinder-836083-8-smb devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1436/2905] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 13:49:14 2022] DELETE /identity/v3/projects/c5ea2facadb44ec99af635bf1899debf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:49:24.253248 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:49:24.608670 dv-cinder-836083-8-smb devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:07.255878 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34a493-2b11-4ecd-8873-6df33659a407 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:07.257541 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5e34a493-2b11-4ecd-8873-6df33659a407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:07.417939 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34a493-2b11-4ecd-8873-6df33659a407 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:07.483078 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7a956-26f8-40fe-8450-9ac0d425b789 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f7ea9741a5d409d87b8ebb4390a74ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af45a1ec7c94408bb638c55fb43fa961', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:07.483734 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7a956-26f8-40fe-8450-9ac0d425b789 service placement] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:07.484014 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7a956-26f8-40fe-8450-9ac0d425b789 service placement] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:07.484269 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7a956-26f8-40fe-8450-9ac0d425b789 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:07.486064 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-68f7a956-26f8-40fe-8450-9ac0d425b789 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:07.497833 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7a956-26f8-40fe-8450-9ac0d425b789 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:07.499462 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7a956-26f8-40fe-8450-9ac0d425b789 service placement] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:07.509993 dv-cinder-836083-8-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1470/2906] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:17.505475 dv-cinder-836083-8-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}